-- Logs begin at Tue 2022-08-30 00:29:13 UTC, end at Tue 2022-08-30 01:30:24 UTC. -- Aug 30 00:58:09.739219 dv-cinder-819667-6-smb systemd[1]: Starting Devstack devstack@keystone.service... Aug 30 00:58:09.748437 dv-cinder-819667-6-smb devstack@keystone.service[81986]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 30 00:58:09.750515 dv-cinder-819667-6-smb devstack@keystone.service[81986]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Aug 30 00:58:09 2022] *** Aug 30 00:58:09.750515 dv-cinder-819667-6-smb devstack@keystone.service[81986]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 30 00:58:09.750515 dv-cinder-819667-6-smb devstack@keystone.service[81986]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 30 00:58:09.750515 dv-cinder-819667-6-smb devstack@keystone.service[81986]: nodename: dv-cinder-819667-6-smb Aug 30 00:58:09.750515 dv-cinder-819667-6-smb devstack@keystone.service[81986]: machine: x86_64 Aug 30 00:58:09.750515 dv-cinder-819667-6-smb devstack@keystone.service[81986]: clock source: unix Aug 30 00:58:09.750515 dv-cinder-819667-6-smb devstack@keystone.service[81986]: pcre jit disabled Aug 30 00:58:09.750515 dv-cinder-819667-6-smb devstack@keystone.service[81986]: detected number of CPU cores: 4 Aug 30 00:58:09.750515 dv-cinder-819667-6-smb devstack@keystone.service[81986]: current working directory: / Aug 30 00:58:09.750515 dv-cinder-819667-6-smb devstack@keystone.service[81986]: detected binary path: /usr/bin/uwsgi-core Aug 30 00:58:09.750515 dv-cinder-819667-6-smb devstack@keystone.service[81986]: your processes number limit is 47680 Aug 30 00:58:09.751210 dv-cinder-819667-6-smb devstack@keystone.service[81986]: your memory page size is 4096 bytes Aug 30 00:58:09.751210 dv-cinder-819667-6-smb devstack@keystone.service[81986]: detected max file descriptor number: 2048 Aug 30 00:58:09.751210 dv-cinder-819667-6-smb devstack@keystone.service[81986]: lock engine: pthread robust mutexes Aug 30 00:58:09.751210 dv-cinder-819667-6-smb devstack@keystone.service[81986]: thunder lock: enabled Aug 30 00:58:09.751210 dv-cinder-819667-6-smb devstack@keystone.service[81986]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 30 00:58:09.751210 dv-cinder-819667-6-smb devstack@keystone.service[81986]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 30 00:58:09.790929 dv-cinder-819667-6-smb devstack@keystone.service[81986]: Python main interpreter initialized at 0x55a8abe8c9c0 Aug 30 00:58:09.790929 dv-cinder-819667-6-smb devstack@keystone.service[81986]: python threads support enabled Aug 30 00:58:09.790929 dv-cinder-819667-6-smb devstack@keystone.service[81986]: your server socket listen backlog is limited to 100 connections Aug 30 00:58:09.790929 dv-cinder-819667-6-smb devstack@keystone.service[81986]: your mercy for graceful operations on workers is 90 seconds Aug 30 00:58:09.791368 dv-cinder-819667-6-smb devstack@keystone.service[81986]: mapped 403077 bytes (393 KB) for 2 cores Aug 30 00:58:09.791445 dv-cinder-819667-6-smb devstack@keystone.service[81986]: *** Operational MODE: preforking *** Aug 30 00:58:09.791702 dv-cinder-819667-6-smb devstack@keystone.service[81986]: *** uWSGI is running in multiple interpreter mode *** Aug 30 00:58:09.791702 dv-cinder-819667-6-smb devstack@keystone.service[81986]: spawned uWSGI master process (pid: 81986) Aug 30 00:58:09.791915 dv-cinder-819667-6-smb systemd[1]: Started Devstack devstack@keystone.service. Aug 30 00:58:09.792641 dv-cinder-819667-6-smb devstack@keystone.service[81986]: spawned uWSGI worker 1 (pid: 81998, cores: 1) Aug 30 00:58:09.793704 dv-cinder-819667-6-smb devstack@keystone.service[81986]: spawned uWSGI worker 2 (pid: 81999, cores: 1) Aug 30 00:58:09.793704 dv-cinder-819667-6-smb devstack@keystone.service[81986]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 30 00:58:14.135561 dv-cinder-819667-6-smb devstack@keystone.service[81999]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 00:58:14.135561 dv-cinder-819667-6-smb devstack@keystone.service[81999]: from cryptography.utils import int_from_bytes Aug 30 00:58:14.136363 dv-cinder-819667-6-smb devstack@keystone.service[81999]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 00:58:14.136363 dv-cinder-819667-6-smb devstack@keystone.service[81999]: from cryptography.utils import int_from_bytes Aug 30 00:58:14.137631 dv-cinder-819667-6-smb devstack@keystone.service[81998]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 00:58:14.137631 dv-cinder-819667-6-smb devstack@keystone.service[81998]: from cryptography.utils import int_from_bytes Aug 30 00:58:14.138130 dv-cinder-819667-6-smb devstack@keystone.service[81998]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 00:58:14.138130 dv-cinder-819667-6-smb devstack@keystone.service[81998]: from cryptography.utils import int_from_bytes Aug 30 00:58:14.187891 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 30 00:58:14.188095 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 30 00:58:14.188249 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] command line args: [] {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 30 00:58:14.188462 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 30 00:58:14.188548 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 30 00:58:14.188916 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 30 00:58:14.189005 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] ================================================================================ {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 30 00:58:14.189112 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] command line args: [] {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 30 00:58:14.189191 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] admin_token = **** {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:58:14.189386 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 30 00:58:14.189469 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] config_dir = [] {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:58:14.189570 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] ================================================================================ {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 30 00:58:14.189655 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:58:14.189754 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] config_source = [] {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:58:14.189836 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] admin_token = **** {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:58:14.189935 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] debug = True {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:58:14.190054 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] config_dir = [] {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:58:14.190142 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:58:14.190436 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:58:14.190436 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] config_source = [] {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:58:14.190615 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:58:14.190713 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] debug = True {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:58:14.190818 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:58:14.190923 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:58:14.191048 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:58:14.191179 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:58:14.191281 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:58:14.191392 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:58:14.191487 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] list_limit = None {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:58:14.191586 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:58:14.191679 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] log_config_append = None {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:58:14.191776 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:58:14.191877 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:58:14.191979 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] list_limit = None {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:58:14.192079 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] log_dir = None {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:58:14.192173 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] log_config_append = None {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:58:14.192272 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] log_file = None {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:58:14.192371 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:58:14.192487 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:58:14.192568 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] log_dir = None {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:58:14.192689 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:58:14.192763 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] log_file = None {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:58:14.192763 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:58:14.192953 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:58:14.193030 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:58:14.193153 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:58:14.193153 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:58:14.193347 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:58:14.193425 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:58:14.193502 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:58:14.193626 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:58:14.193705 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:58:14.193782 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:58:14.193901 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:58:14.193976 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:58:14.194096 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:58:14.194213 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:58:14.194297 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:58:14.194444 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:58:14.194518 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:58:14.194674 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:58:14.194755 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:58:14.194902 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:58:14.195026 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:58:14.195169 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:58:14.195296 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:58:14.195415 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:58:14.195532 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:58:14.195652 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:58:14.195875 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:58:14.195996 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.79/identity {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:58:14.196109 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] publish_errors = False {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:58:14.196308 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:58:14.196429 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.79/identity {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:58:14.196541 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] publish_errors = False {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:58:14.196658 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:58:14.196769 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:58:14.196878 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:58:14.196988 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:58:14.197105 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:58:14.197105 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:58:14.197339 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:58:14.197516 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:58:14.197636 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] standard_threads = False {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:58:14.197747 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:58:14.197863 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:58:14.197982 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] standard_threads = False {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:58:14.198095 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:58:14.198095 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:58:14.198309 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:58:14.198419 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] use_journal = False {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:58:14.198537 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:58:14.198656 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] use_json = False {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:58:14.198767 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:58:14.198883 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] use_stderr = False {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:58:14.198994 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] use_journal = False {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:58:14.199110 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] use_syslog = False {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:58:14.199244 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] use_json = False {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:58:14.199367 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:58:14.199480 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] use_stderr = False {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:58:14.199480 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] use_syslog = False {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:58:14.199699 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.199811 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:58:14.199921 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.200041 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.200153 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.200264 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.200512 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.200512 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.200733 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.200852 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.200964 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.201073 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.201183 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.201300 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.201417 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.201537 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.201649 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.201765 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.201882 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.201993 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.202108 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.202227 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.202340 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.202450 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.202551 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.202660 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.202777 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.202964 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.203082 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.203219 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.203342 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.203461 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.203579 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.203691 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.203807 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.203918 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.204028 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.204143 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.204262 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.204380 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.204492 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.204602 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.204711 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.204820 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.204937 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.205054 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.205165 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.205274 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.205384 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.205500 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.205618 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.205730 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.205839 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.205949 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.206058 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.206173 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.206292 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.206394 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.206493 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.206604 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.206715 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.206824 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.206944 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.207061 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.207184 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.207295 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.207405 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.207513 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.207635 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.207747 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.207856 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.207977 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.208095 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.208207 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.208391 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.208511 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.208623 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.208733 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.208842 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.208951 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.209073 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.209185 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.209295 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.209404 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.209513 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.209623 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.209741 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.209852 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.209962 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.210072 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.210195 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.210291 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.210397 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.210493 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.210586 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.210678 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.210777 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.210879 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.210975 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.211068 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.211208 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.211309 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.211421 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.211548 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.211661 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.211777 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.211879 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.211988 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.212097 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.212214 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.212355 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.212477 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.212595 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.212707 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.212818 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.212936 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.213047 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.213158 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.213269 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.213383 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.213494 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.213615 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.213727 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.213838 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.213956 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.214068 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.214184 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.214184 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.214413 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.214413 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.214621 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.214740 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.214853 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.214955 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.215070 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.215070 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.215309 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.215948 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.216079 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.216192 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.216309 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.216428 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.216532 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.216641 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.216752 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.216868 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.216868 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.217092 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.217210 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.217322 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.217433 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.217549 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.217661 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.217779 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.217897 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.218009 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.218121 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.218232 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.218341 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.218463 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.218575 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.218686 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.218796 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.218907 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.219018 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.219152 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.219267 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.219388 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.219501 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.219612 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.219722 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.219908 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.220022 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.220140 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.220253 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.220369 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.220579 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.220710 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.220823 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.220935 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.221045 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.221156 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.221267 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.221389 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.221502 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.221603 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.221713 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.221823 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.221934 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.222057 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.222185 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.222299 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.222410 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.222521 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.222631 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.222747 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.222867 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.222980 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.223091 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.223219 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.223333 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.223444 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.223566 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.223680 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.223791 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.223911 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.224029 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.224142 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.224260 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.224374 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.224486 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.224597 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.224707 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.224818 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.224966 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.225089 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] auth.external = None {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.225211 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] auth.external = None {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.225325 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.225435 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.225551 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.225668 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.225782 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.225906 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.226020 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] auth.password = None {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.226132 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] auth.password = None {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.226243 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] auth.token = None {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.226354 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] auth.token = None {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.226472 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.226592 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.226705 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.226816 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.226928 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.227039 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.227197 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.227325 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.227440 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.227554 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.227667 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.227779 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.227891 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.228010 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.228124 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] credential.caching = True {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.228236 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] credential.caching = True {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.228348 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.228450 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.228545 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.228648 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.228746 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.228840 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.228941 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.229038 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.229133 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.229235 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.229332 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.229426 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.229520 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.229628 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.229736 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.229833 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.229928 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.230029 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.230125 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.230220 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.230322 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.230418 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.230519 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.230615 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.230710 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.230804 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.230912 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.231008 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.232096 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.232220 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.232321 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] federation.caching = True {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.232425 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] federation.caching = True {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.232529 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.232529 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.232707 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.232808 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.232904 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.232997 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.233099 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.233201 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.233297 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.233391 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.233484 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.233585 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.233757 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.233863 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.233988 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.234092 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.234187 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.234281 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.234383 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.234486 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.234581 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.234703 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] identity.caching = True {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.234809 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.234954 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.235032 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] identity.caching = True {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.235228 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.235302 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.235470 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.235538 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.235711 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.235840 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.235939 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.236034 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.236180 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.236284 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.236414 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.236527 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.236654 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.236759 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.236906 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.237040 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.237144 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.237300 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.237405 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.237537 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.237641 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.237773 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.237883 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.238009 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.238121 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.238257 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.238378 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.238511 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.238629 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.238751 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.238865 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.239009 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.239202 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.239846 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.239977 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.240096 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.240215 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.240329 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.240441 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.240561 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.240674 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.240787 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.240899 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.241011 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.241124 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.241251 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.241365 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.241477 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.241589 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.241701 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.241819 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.241942 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.242056 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.242170 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.242282 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.242394 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.242506 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.242625 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.242739 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.242851 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.242963 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.243075 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.243224 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.243351 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.243466 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.243578 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.243691 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.243803 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.243915 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.244035 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.244149 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.244262 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.244375 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.244490 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.244604 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.244724 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.244838 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.244951 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.245063 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.245175 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.245286 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.245408 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.245507 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.245602 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.245695 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.245792 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.245910 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.246037 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.246157 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.246270 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.246384 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.246495 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.246607 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.246727 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.246840 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.246952 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.247063 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.247218 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] ldap.user = None {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.247333 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.247333 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.247560 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.247560 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.247772 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] ldap.user = None {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.247884 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.247995 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.248115 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.248229 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.248341 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.248454 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.248567 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.248679 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.248798 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.248912 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.249024 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.249135 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.249248 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.249360 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.249480 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.249596 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.249708 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.249820 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.249932 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.250049 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.250171 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.250284 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.250396 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.250507 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.250620 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.250731 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.250852 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.250965 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.251078 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.251218 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.251332 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.251443 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.251568 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.251683 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.251795 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.251907 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.252018 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.252130 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.252251 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.252364 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.252476 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.252588 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.252701 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.252812 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.252932 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.253045 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.253163 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.253276 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.253389 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.253500 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.253620 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.253735 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.253846 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.253958 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.254069 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.254180 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.254300 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.254413 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.254529 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.254641 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.254754 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.254873 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.254873 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.255085 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.255085 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.255336 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.255449 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.255572 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.255572 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.255787 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] resource.caching = True {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.255899 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.256010 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.256121 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] resource.caching = True {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.256309 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.256425 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.256538 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.256650 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.256763 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.256876 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.256996 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.257110 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.257222 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.257334 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.257445 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.257557 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.257676 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.257790 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.257903 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.258015 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.258127 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] role.caching = True {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.258238 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.258358 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] role.driver = sql {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.258535 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] role.caching = True {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.258651 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.258763 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] role.driver = sql {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.258874 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.258985 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.259104 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.259245 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.259358 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.259470 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.259582 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.259694 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.259818 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.259932 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.260045 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.260156 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.260269 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.260380 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.260500 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.260613 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.260725 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.260836 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.260948 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.261061 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.261180 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.261294 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.261406 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.261518 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.261630 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.261741 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.261741 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.261960 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.261960 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.262171 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.262283 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.262404 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.262518 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.262630 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.262742 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.262875 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.263032 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.263225 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.263348 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.263483 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.263600 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.263747 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.263865 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.264009 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.264133 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.264249 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.264362 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.264474 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.264590 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.264712 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.264826 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.264938 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.265050 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.265162 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.265276 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.265396 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.265511 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.265623 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.265735 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.265847 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.265959 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.266079 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.266193 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.266307 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.266419 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.266531 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] token.caching = True {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.266643 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] token.caching = True {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.266763 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.266877 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.266989 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.267101 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.267247 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.267361 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.267489 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.267603 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.267715 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.267826 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.267937 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.268048 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.268167 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.268279 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.268392 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.268502 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.268613 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.268724 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.268843 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.268956 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.269067 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.269178 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.269288 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.269399 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.269518 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.269631 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.269771 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.269888 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.269999 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.270119 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.270244 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.270365 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.270479 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.270603 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.270717 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] database.connection = **** {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.270828 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] database.connection = **** {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.270963 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.271080 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.271313 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.271444 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.271560 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.271670 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.271782 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.271892 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.272003 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.272126 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.272239 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.272351 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.272462 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.272575 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.272686 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.272806 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.272919 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.273031 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.273142 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.273253 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.273364 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.273483 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.273596 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.273709 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.273820 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.273931 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.274050 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.274163 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.274274 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.274386 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.274498 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.274613 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.274805 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.274920 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.275031 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.275175 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:58:14.275291 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 30 00:58:14.275403 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 30 00:58:14.305635 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81999) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:58:14.305796 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81998) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:58:14.305874 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81999) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:58:14.305947 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81998) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:58:14.306069 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81999) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:58:14.306172 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81998) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:58:14.314996 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81999) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:58:14.315091 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81998) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:58:14.343575 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81999) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:58:14.343710 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81998) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:58:14.343837 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81998) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:58:14.343936 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81999) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:58:14.397666 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81998) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:58:14.397943 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81999) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:58:14.452712 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81999) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:58:14.452947 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81999) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:58:14.453861 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81998) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:58:14.454100 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81998) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:58:14.609015 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81999) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:58:14.609242 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81999) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:58:14.609469 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81999) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:58:14.609692 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81999) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:58:14.609776 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81998) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:58:14.609914 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81999) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:58:14.609995 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81998) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:58:14.610134 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81999) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:58:14.610226 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81998) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:58:14.610415 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81998) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:58:14.610634 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81998) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:58:14.610853 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81998) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:58:14.633782 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81998) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:58:14.633901 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81999) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:58:14.633996 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81998) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:58:14.634120 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81999) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:58:14.634225 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81998) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:58:14.634352 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81999) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:58:14.634434 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81998) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:58:14.634583 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81999) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:58:14.634666 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81998) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:58:14.634806 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81999) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:58:14.634888 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81998) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:58:14.635020 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81999) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:58:14.635109 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81998) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:58:14.635258 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81999) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:58:14.646316 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81998) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:58:14.646417 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81999) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:58:14.659262 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81999) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:58:14.659392 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81998) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:58:14.659472 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81999) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:58:14.659546 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81998) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:58:14.659618 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81999) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:58:14.659687 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81998) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:58:14.659806 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81999) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:58:14.659898 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81998) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:58:14.660028 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81999) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:58:14.660111 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81998) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:58:14.660244 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81998) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:58:14.660324 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81999) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:58:14.660456 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81998) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:58:14.660539 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81999) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:58:14.677625 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:58:14.677835 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 30 00:58:14.678172 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:58:14.678255 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:58:14.678368 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 30 00:58:14.678450 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 30 00:58:14.678639 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:58:14.678719 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:58:14.678901 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:58:14.678991 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 30 00:58:14.679200 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:58:14.679442 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:58:14.679525 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:58:14.679708 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:58:14.679788 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:58:14.679969 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:58:14.690022 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:58:14.690298 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:58:14.690505 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:58:14.690589 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:58:14.690788 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:58:14.690872 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:58:14.691062 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:58:14.691371 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:58:14.697828 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81998) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 00:58:14.698437 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81999) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 00:58:14.700792 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81998) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 00:58:14.701073 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:58:14.701355 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:58:14.701436 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81999) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 00:58:14.701635 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:58:14.701728 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:58:14.701915 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:58:14.701997 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:58:14.702174 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:58:14.702256 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:58:14.702444 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:58:14.702527 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:58:14.702715 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:58:14.702797 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:58:14.703025 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:58:14.703112 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:58:14.703329 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:58:14.703410 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:58:14.703604 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:58:14.703685 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:58:14.703880 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:58:14.704146 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:58:14.726553 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:58:14.727193 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:58:14.728043 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81998) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 00:58:14.728328 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:58:14.728668 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81999) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 00:58:14.728956 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:58:14.733551 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81998) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 00:58:14.733833 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:58:14.734118 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:58:14.734211 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81999) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 00:58:14.734492 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:58:14.734777 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:58:14.740495 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81998) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 00:58:14.740779 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:58:14.741323 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81999) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 00:58:14.741616 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:58:14.744885 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81998) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 00:58:14.745177 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:58:14.745463 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:58:14.745612 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81999) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 00:58:14.745743 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:58:14.745907 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:58:14.746014 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:58:14.746195 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:58:14.746275 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:58:14.746485 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:58:14.746566 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:58:14.746839 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:58:14.746972 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:58:14.748934 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:58:14.749229 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:58:14.749520 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:58:14.764615 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:58:14.764895 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:58:14.765959 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:58:14.766244 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:58:14.768796 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81998) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 00:58:14.770104 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81999) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 00:58:14.772042 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:58:14.772339 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:58:14.773229 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:58:14.773530 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:58:14.776569 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81998) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 00:58:14.777846 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81999) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 00:58:14.779847 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81998) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 00:58:14.781237 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81999) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 00:58:14.783052 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:58:14.783378 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:58:14.783665 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:58:14.783950 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:58:14.784245 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:58:14.784381 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:58:14.784671 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:58:14.784752 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:58:14.784955 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:58:14.785242 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:58:14.785525 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:58:14.785908 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:58:14.800936 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81998) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 00:58:14.801225 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:58:14.801495 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:58:14.801757 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:58:14.802565 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81999) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 00:58:14.802857 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:58:14.803160 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:58:14.803432 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:58:14.808651 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:58:14.810934 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:58:14.811028 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:58:14.812520 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:58:14.812673 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:58:14.812794 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:58:14.814511 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:58:14.814791 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:58:14.815747 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81998) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 00:58:14.816032 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:58:14.816432 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:58:14.816726 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:58:14.817013 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:58:14.818428 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81999) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 00:58:14.818718 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:58:14.819013 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:58:14.819336 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:58:14.819629 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:58:14.829117 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81998) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 00:58:14.829403 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:58:14.829781 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:58:14.830066 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:58:14.830350 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:58:14.830629 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:58:14.830923 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:58:14.831166 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81999) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 00:58:14.831454 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:58:14.831735 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:58:14.832016 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:58:14.832297 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:58:14.832577 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:58:14.832876 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:58:14.846438 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81998) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 00:58:14.848748 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81999) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 00:58:14.849388 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81998) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 00:58:14.851841 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81999) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 00:58:14.852288 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:58:14.853732 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:58:14.854754 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:58:14.855375 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81998) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 00:58:14.855660 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:58:14.855956 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:58:14.856777 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:58:14.858272 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81999) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 00:58:14.858558 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:58:14.858859 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:58:14.863341 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:58:14.864819 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81998) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 00:58:14.865529 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:58:14.867011 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81999) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 00:58:14.867836 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:58:14.868136 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:58:14.868425 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:58:14.868705 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:58:14.869925 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:58:14.870221 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:58:14.870510 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:58:14.870792 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:58:14.877560 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81998) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 00:58:14.877853 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:58:14.878134 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:58:14.879439 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81999) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 00:58:14.879734 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:58:14.880018 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:58:14.885076 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81998) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 00:58:14.885370 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:58:14.885652 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:58:14.885926 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:58:14.886195 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:58:14.886464 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:58:14.886735 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:58:14.887006 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81999) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 00:58:14.887089 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:58:14.887341 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:58:14.887485 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:58:14.887629 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:58:14.887750 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:58:14.887910 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:58:14.888040 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:58:14.888186 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:58:14.888269 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:58:14.888461 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:58:14.888541 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:58:14.888738 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:58:14.888825 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:58:14.889019 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:58:14.889309 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:58:14.889588 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:58:14.889858 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:58:14.890119 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:58:14.890385 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:58:14.890661 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:58:14.923424 dv-cinder-819667-6-smb devstack@keystone.service[81998]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55a8abe8c9c0 pid: 81998 (default app) Aug 30 00:58:14.925507 dv-cinder-819667-6-smb devstack@keystone.service[81999]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55a8abe8c9c0 pid: 81999 (default app) Aug 30 00:58:14.926670 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064547af-5853-4f3c-b902-b59c7ea69f0b None None] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:14.926983 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064547af-5853-4f3c-b902-b59c7ea69f0b None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:14.927294 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064547af-5853-4f3c-b902-b59c7ea69f0b None None] PATH_INFO: `/v3` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:14.931462 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1/1] 10.222.0.79 () {50 vars in 791 bytes} [Tue Aug 30 00:58:14 2022] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:58:21.664693 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c294924-af3a-45b4-9573-8f8f1b9fcd69 None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:21.665178 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c294924-af3a-45b4-9573-8f8f1b9fcd69 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:21.665178 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c294924-af3a-45b4-9573-8f8f1b9fcd69 None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:21.669974 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1/2] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 00:58:21 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:58:21.675582 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e33c5f-2ced-410c-bd01-ef6a81a18bd6 None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:21.676075 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e33c5f-2ced-410c-bd01-ef6a81a18bd6 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:21.676212 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e33c5f-2ced-410c-bd01-ef6a81a18bd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:21.748653 dv-cinder-819667-6-smb devstack@keystone.service[81998]: INFO dbcounter [None req-69e33c5f-2ced-410c-bd01-ef6a81a18bd6 None None] Registered counter for database keystone Aug 30 00:58:21.767913 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG oslo_db.sqlalchemy.engines [None req-69e33c5f-2ced-410c-bd01-ef6a81a18bd6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81998) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 00:58:21.774260 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writer thread running {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 00:58:21.955047 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG passlib.handlers.bcrypt [None req-69e33c5f-2ced-410c-bd01-ef6a81a18bd6 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81998) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 30 00:58:21.955373 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG passlib.handlers.bcrypt [None req-69e33c5f-2ced-410c-bd01-ef6a81a18bd6 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81998) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 30 00:58:22.014747 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-69e33c5f-2ced-410c-bd01-ef6a81a18bd6 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:58:22.016398 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-69e33c5f-2ced-410c-bd01-ef6a81a18bd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:58:22.144575 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 2/3] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 00:58:21 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 470 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Aug 30 00:58:22.610183 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c294924-af3a-45b4-9573-8f8f1b9fcd69 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:22.680038 dv-cinder-819667-6-smb devstack@keystone.service[81999]: INFO dbcounter [None req-3c294924-af3a-45b4-9573-8f8f1b9fcd69 None None] Registered counter for database keystone Aug 30 00:58:22.702467 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG oslo_db.sqlalchemy.engines [None req-3c294924-af3a-45b4-9573-8f8f1b9fcd69 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81999) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 00:58:22.708628 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writer thread running {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 00:58:22.833627 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c294924-af3a-45b4-9573-8f8f1b9fcd69 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:22.837895 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b524c7-279e-48a4-9d3f-396f8bdf7018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:22.838528 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b524c7-279e-48a4-9d3f-396f8bdf7018 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:22.838811 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b524c7-279e-48a4-9d3f-396f8bdf7018 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:22.839085 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b524c7-279e-48a4-9d3f-396f8bdf7018 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:22.847910 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b524c7-279e-48a4-9d3f-396f8bdf7018 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:22.899670 dv-cinder-819667-6-smb devstack@keystone.service[81999]: WARNING keystone.common.rbac_enforcer.enforcer [None req-10b524c7-279e-48a4-9d3f-396f8bdf7018 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 30 00:58:22.899937 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b524c7-279e-48a4-9d3f-396f8bdf7018 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:22.910368 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 2/4] 10.222.0.79 () {58 vars in 1324 bytes} [Tue Aug 30 00:58:22 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 00:58:22.916353 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e33c5f-2ced-410c-bd01-ef6a81a18bd6 None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:22.930832 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e33c5f-2ced-410c-bd01-ef6a81a18bd6 None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:22.935704 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1df1358-e287-4379-a325-b6d74427d4e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:22.936801 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1df1358-e287-4379-a325-b6d74427d4e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:22.937080 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1df1358-e287-4379-a325-b6d74427d4e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:22.937351 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1df1358-e287-4379-a325-b6d74427d4e6 admin admin] PATH_INFO: `/v3/projects/7112c39aad764cbc9493ab829d1c571c` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:22.938942 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1df1358-e287-4379-a325-b6d74427d4e6 admin admin] RBAC: Authorizing `identity:get_project(project_id=7112c39aad764cbc9493ab829d1c571c)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:22.993688 dv-cinder-819667-6-smb devstack@keystone.service[81998]: WARNING keystone.common.rbac_enforcer.enforcer [None req-e1df1358-e287-4379-a325-b6d74427d4e6 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 30 00:58:22.994028 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1df1358-e287-4379-a325-b6d74427d4e6 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:22.999026 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 3/5] 10.222.0.79 () {56 vars in 1207 bytes} [Tue Aug 30 00:58:22 2022] GET /identity/v3/projects/7112c39aad764cbc9493ab829d1c571c => generated 344 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:58:24.880228 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4675a1-6045-4010-a57b-4cb0b80f5a3b None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:24.880842 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4675a1-6045-4010-a57b-4cb0b80f5a3b None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:24.880842 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4675a1-6045-4010-a57b-4cb0b80f5a3b None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:24.884833 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 3/6] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 00:58:24 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 00:58:24.890864 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda37d9c-9355-4227-9060-d03353a39a57 None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:24.891320 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda37d9c-9355-4227-9060-d03353a39a57 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:24.891450 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda37d9c-9355-4227-9060-d03353a39a57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:24.911884 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-bda37d9c-9355-4227-9060-d03353a39a57 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:58:24.913379 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-bda37d9c-9355-4227-9060-d03353a39a57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:58:24.921533 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 4/7] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 00:58:24 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 30 00:58:25.195202 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4675a1-6045-4010-a57b-4cb0b80f5a3b None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:25.207640 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4675a1-6045-4010-a57b-4cb0b80f5a3b None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:25.211752 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3036f5-b127-4952-9c32-58f96b55deb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:25.212337 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3036f5-b127-4952-9c32-58f96b55deb3 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:25.212611 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3036f5-b127-4952-9c32-58f96b55deb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:25.212877 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3036f5-b127-4952-9c32-58f96b55deb3 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:25.221161 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3036f5-b127-4952-9c32-58f96b55deb3 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:25.222952 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3036f5-b127-4952-9c32-58f96b55deb3 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:25.233251 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 4/8] 10.222.0.79 () {58 vars in 1324 bytes} [Tue Aug 30 00:58:25 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 00:58:25.238996 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda37d9c-9355-4227-9060-d03353a39a57 None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:25.249252 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda37d9c-9355-4227-9060-d03353a39a57 None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:25.253654 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34626300-f775-46f6-979a-3a3a98a24fc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:25.254298 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34626300-f775-46f6-979a-3a3a98a24fc5 admin admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:25.254580 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34626300-f775-46f6-979a-3a3a98a24fc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:25.254848 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34626300-f775-46f6-979a-3a3a98a24fc5 admin admin] PATH_INFO: `/v3/users/54c77b2049f04525ac7b6806a553b84c` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:25.256215 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34626300-f775-46f6-979a-3a3a98a24fc5 admin admin] RBAC: Authorizing `identity:get_user(user_id=54c77b2049f04525ac7b6806a553b84c)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:25.258041 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34626300-f775-46f6-979a-3a3a98a24fc5 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:25.259646 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 5/9] 10.222.0.79 () {56 vars in 1198 bytes} [Tue Aug 30 00:58:25 2022] GET /identity/v3/users/54c77b2049f04525ac7b6806a553b84c => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:58:27.240261 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee8c529-1181-4cf0-8141-3ae972a04f25 None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:27.240701 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee8c529-1181-4cf0-8141-3ae972a04f25 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:27.240789 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee8c529-1181-4cf0-8141-3ae972a04f25 None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:27.242113 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 5/10] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 00:58:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 00:58:27.247391 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348fa969-459c-4c6f-b665-3ccc61b8962f None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:27.248011 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348fa969-459c-4c6f-b665-3ccc61b8962f None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:27.248011 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348fa969-459c-4c6f-b665-3ccc61b8962f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:27.266036 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-348fa969-459c-4c6f-b665-3ccc61b8962f None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:58:27.267245 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-348fa969-459c-4c6f-b665-3ccc61b8962f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:58:27.301666 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a77f37d-a2e0-4ceb-af33-5c2c7e83ebb8 None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:27.301948 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a77f37d-a2e0-4ceb-af33-5c2c7e83ebb8 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:27.302226 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a77f37d-a2e0-4ceb-af33-5c2c7e83ebb8 None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:27.303569 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 6/11] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 00:58:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 00:58:27.308748 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c16553-98a0-4df6-beee-bf2c68abc623 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:27.309027 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c16553-98a0-4df6-beee-bf2c68abc623 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:27.309298 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c16553-98a0-4df6-beee-bf2c68abc623 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:27.351811 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 6/12] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 00:58:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 00:58:27.353448 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG passlib.handlers.bcrypt [None req-76c16553-98a0-4df6-beee-bf2c68abc623 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81999) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 30 00:58:27.353847 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG passlib.handlers.bcrypt [None req-76c16553-98a0-4df6-beee-bf2c68abc623 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81999) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 30 00:58:27.403890 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-76c16553-98a0-4df6-beee-bf2c68abc623 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:58:27.405610 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-76c16553-98a0-4df6-beee-bf2c68abc623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:58:27.518224 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 7/13] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 00:58:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 00:58:27.634164 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348fa969-459c-4c6f-b665-3ccc61b8962f None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:27.659907 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:27.742456 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348fa969-459c-4c6f-b665-3ccc61b8962f None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:27.776849 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c34283-afc9-4c16-a9dc-e84457eee301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:27.777408 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c34283-afc9-4c16-a9dc-e84457eee301 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:27.777689 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c34283-afc9-4c16-a9dc-e84457eee301 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:27.777962 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c34283-afc9-4c16-a9dc-e84457eee301 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:27.789495 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c34283-afc9-4c16-a9dc-e84457eee301 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:58:27.798116 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application [None req-d1c34283-afc9-4c16-a9dc-e84457eee301 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:58:27.798116 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:58:27.798116 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:58:27.798116 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:58:27.798116 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:58:27.798116 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:58:27.798116 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:58:27.798116 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:58:27.798116 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:58:27.798116 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:58:27.798116 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:58:27.798116 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:58:27.798116 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:58:27.798116 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:58:27.798116 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:58:27.798116 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:58:27.799075 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:58:27.799075 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:58:27.799075 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:58:27.799075 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:58:27.799075 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:58:27.799075 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:58:27.799075 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:58:27.799075 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:58:27.799075 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:58:27.799075 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:58:27.799075 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:58:27.799075 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application with Lock( Aug 30 00:58:27.799075 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:58:27.799075 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:58:27.799075 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:58:27.799075 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:58:27.799947 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:58:27.799947 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:58:27.799947 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:58:27.799947 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:58:27.799947 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:58:27.799947 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:58:27.799947 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:58:27.799947 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:58:27.799947 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:58:27.799947 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:58:27.799947 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:58:27.799947 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Aug 30 00:58:27.799947 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 7/14] 10.222.0.79 () {56 vars in 1096 bytes} [Tue Aug 30 00:58:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:58:27.805286 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c16553-98a0-4df6-beee-bf2c68abc623 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:27.813736 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c34283-afc9-4c16-a9dc-e84457eee301 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:27.898464 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:27.913287 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c16553-98a0-4df6-beee-bf2c68abc623 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:27.915790 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:27.920480 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c34283-afc9-4c16-a9dc-e84457eee301 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:27.955755 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4990ff-75ad-4183-b89e-c1ab75824686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:27.956102 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499e30dc-a6db-4a95-8872-8e79ed6c03b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:27.956369 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4990ff-75ad-4183-b89e-c1ab75824686 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:27.956651 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4990ff-75ad-4183-b89e-c1ab75824686 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:27.956916 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4990ff-75ad-4183-b89e-c1ab75824686 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:27.957020 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499e30dc-a6db-4a95-8872-8e79ed6c03b2 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:27.957240 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499e30dc-a6db-4a95-8872-8e79ed6c03b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:27.957517 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499e30dc-a6db-4a95-8872-8e79ed6c03b2 None admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:27.958359 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499e30dc-a6db-4a95-8872-8e79ed6c03b2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:58:27.958661 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499e30dc-a6db-4a95-8872-8e79ed6c03b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:27.960139 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499e30dc-a6db-4a95-8872-8e79ed6c03b2 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:27.972681 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 8/15] 10.222.0.79 () {56 vars in 1099 bytes} [Tue Aug 30 00:58:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:58:27.978379 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499e30dc-a6db-4a95-8872-8e79ed6c03b2 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:28.028480 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4990ff-75ad-4183-b89e-c1ab75824686 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:28.030553 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4990ff-75ad-4183-b89e-c1ab75824686 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:28.088095 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499e30dc-a6db-4a95-8872-8e79ed6c03b2 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:28.114984 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:28.124264 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9be447a-cdc3-4b70-887e-a5939513907f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:28.125126 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9be447a-cdc3-4b70-887e-a5939513907f None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:28.125405 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9be447a-cdc3-4b70-887e-a5939513907f None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:28.125685 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9be447a-cdc3-4b70-887e-a5939513907f None admin] PATH_INFO: `/v3/users/54c77b2049f04525ac7b6806a553b84c` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:28.127266 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9be447a-cdc3-4b70-887e-a5939513907f None admin] RBAC: Authorizing `identity:get_user(user_id=54c77b2049f04525ac7b6806a553b84c)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:28.128710 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9be447a-cdc3-4b70-887e-a5939513907f None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:28.130280 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 9/16] 10.222.0.79 () {56 vars in 1177 bytes} [Tue Aug 30 00:58:27 2022] GET /identity/v3/users/54c77b2049f04525ac7b6806a553b84c => generated 247 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:58:28.135154 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 8/17] 10.222.0.79 () {58 vars in 1282 bytes} [Tue Aug 30 00:58:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 30 00:58:28.135911 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9be447a-cdc3-4b70-887e-a5939513907f None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:28.140486 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4990ff-75ad-4183-b89e-c1ab75824686 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:28.172152 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:28.241837 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4990ff-75ad-4183-b89e-c1ab75824686 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:28.246719 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9be447a-cdc3-4b70-887e-a5939513907f None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:28.276725 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d3985b-1d84-4700-a4dd-9c100c4138d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:28.277363 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d3985b-1d84-4700-a4dd-9c100c4138d1 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:28.277638 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d3985b-1d84-4700-a4dd-9c100c4138d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:28.277914 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d3985b-1d84-4700-a4dd-9c100c4138d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:28.282706 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd89832b-c232-40a6-b4c6-78037a2fb6eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:28.283318 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd89832b-c232-40a6-b4c6-78037a2fb6eb None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:28.283597 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd89832b-c232-40a6-b4c6-78037a2fb6eb None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:28.283865 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd89832b-c232-40a6-b4c6-78037a2fb6eb None admin] PATH_INFO: `/v3/domains/default` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:28.284980 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd89832b-c232-40a6-b4c6-78037a2fb6eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:28.286433 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd89832b-c232-40a6-b4c6-78037a2fb6eb None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:28.288001 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 10/18] 10.222.0.79 () {56 vars in 1108 bytes} [Tue Aug 30 00:58:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:58:28.288566 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d3985b-1d84-4700-a4dd-9c100c4138d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:28.290025 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d3985b-1d84-4700-a4dd-9c100c4138d1 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:28.294301 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd89832b-c232-40a6-b4c6-78037a2fb6eb None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:28.306638 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application [None req-94d3985b-1d84-4700-a4dd-9c100c4138d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:58:28.306638 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:58:28.306638 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:58:28.306638 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:58:28.306638 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:58:28.306638 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:58:28.306638 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:58:28.306638 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:58:28.306638 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:58:28.306638 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:58:28.306638 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:58:28.306638 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:58:28.306638 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:58:28.306638 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:58:28.306638 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:58:28.306638 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:58:28.307665 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:58:28.307665 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:58:28.307665 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:58:28.307665 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:58:28.307665 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:58:28.307665 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:58:28.307665 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:58:28.307665 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application with Lock( Aug 30 00:58:28.307665 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:58:28.307665 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:58:28.307665 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:58:28.307665 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:58:28.307665 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:58:28.307665 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:58:28.307665 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:58:28.307665 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:58:28.307665 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:58:28.308475 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:58:28.308475 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:58:28.308475 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Aug 30 00:58:28.308475 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 9/19] 10.222.0.79 () {56 vars in 1108 bytes} [Tue Aug 30 00:58:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 00:58:28.314179 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d3985b-1d84-4700-a4dd-9c100c4138d1 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:28.348715 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:28.397451 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd89832b-c232-40a6-b4c6-78037a2fb6eb None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:28.399019 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:28.416354 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d3985b-1d84-4700-a4dd-9c100c4138d1 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:28.432891 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c9854e-221f-431a-a746-10d9ad55a847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:28.433499 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c9854e-221f-431a-a746-10d9ad55a847 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:28.433777 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c9854e-221f-431a-a746-10d9ad55a847 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:28.434046 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c9854e-221f-431a-a746-10d9ad55a847 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:28.435422 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c9854e-221f-431a-a746-10d9ad55a847 None admin] RBAC: Adding query filter params (role.id=d14c3070c9184d76a7b23df69bd3db07, scope.domain.id=default, user.id=54c77b2049f04525ac7b6806a553b84c) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:58:28.435724 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c9854e-221f-431a-a746-10d9ad55a847 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:28.437163 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c9854e-221f-431a-a746-10d9ad55a847 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:28.445753 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 11/20] 10.222.0.79 () {56 vars in 1322 bytes} [Tue Aug 30 00:58:28 2022] GET /identity/v3/role_assignments?user.id=54c77b2049f04525ac7b6806a553b84c&scope.domain.id=default&role.id=d14c3070c9184d76a7b23df69bd3db07 => generated 233 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:58:28.460121 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b0cbf6-6c00-4890-88e9-1b437983a2c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:28.460753 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b0cbf6-6c00-4890-88e9-1b437983a2c2 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:28.461028 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b0cbf6-6c00-4890-88e9-1b437983a2c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:28.461296 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b0cbf6-6c00-4890-88e9-1b437983a2c2 None admin] PATH_INFO: `/v3/domains` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:28.461953 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b0cbf6-6c00-4890-88e9-1b437983a2c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:58:28.462249 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b0cbf6-6c00-4890-88e9-1b437983a2c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:28.463724 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b0cbf6-6c00-4890-88e9-1b437983a2c2 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:28.484463 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 10/21] 10.222.0.79 () {56 vars in 1109 bytes} [Tue Aug 30 00:58:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:58:30.519286 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1915df0-91f7-47de-99c7-b577262e3b5e None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:30.519790 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1915df0-91f7-47de-99c7-b577262e3b5e None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:30.519790 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1915df0-91f7-47de-99c7-b577262e3b5e None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:30.521103 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 12/22] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 00:58:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:58:30.526509 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b862dad-b0b6-4fe7-91ac-56bc2b14667d None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:30.527345 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b862dad-b0b6-4fe7-91ac-56bc2b14667d None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:30.527835 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b862dad-b0b6-4fe7-91ac-56bc2b14667d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:30.556192 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-5b862dad-b0b6-4fe7-91ac-56bc2b14667d None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:58:30.557738 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-5b862dad-b0b6-4fe7-91ac-56bc2b14667d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:58:30.649572 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 11/23] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 00:58:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:58:31.009531 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1915df0-91f7-47de-99c7-b577262e3b5e None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:31.017080 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59760458-e441-4513-8b8b-ebc992d5b891 None None] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:31.017713 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59760458-e441-4513-8b8b-ebc992d5b891 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:31.018207 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59760458-e441-4513-8b8b-ebc992d5b891 None None] PATH_INFO: `/` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:31.019791 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 12/24] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 00:58:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 00:58:31.025020 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce179cfe-f5f9-49af-8849-29da55ef0824 None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:31.025573 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce179cfe-f5f9-49af-8849-29da55ef0824 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:31.026040 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce179cfe-f5f9-49af-8849-29da55ef0824 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:31.068886 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-ce179cfe-f5f9-49af-8849-29da55ef0824 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:58:31.073445 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-ce179cfe-f5f9-49af-8849-29da55ef0824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:58:31.103553 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:31.198304 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 13/25] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 00:58:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 00:58:31.201955 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dc5100-7dcb-4186-a887-5c257021017f None None] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:31.203334 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dc5100-7dcb-4186-a887-5c257021017f None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:31.206353 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dc5100-7dcb-4186-a887-5c257021017f None None] PATH_INFO: `/` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:31.207834 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 14/26] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 00:58:31 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:58:31.215382 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8d82d9-6363-47f2-8fef-7efea338296c None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:31.216523 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8d82d9-6363-47f2-8fef-7efea338296c None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:31.217009 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8d82d9-6363-47f2-8fef-7efea338296c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:31.235813 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1915df0-91f7-47de-99c7-b577262e3b5e None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:31.240550 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-9f8d82d9-6363-47f2-8fef-7efea338296c None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:58:31.241943 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-9f8d82d9-6363-47f2-8fef-7efea338296c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:58:31.335233 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2877ba-7c91-4d48-b827-166cf78cb6e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:31.335233 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2877ba-7c91-4d48-b827-166cf78cb6e1 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:31.335233 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2877ba-7c91-4d48-b827-166cf78cb6e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:31.335233 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2877ba-7c91-4d48-b827-166cf78cb6e1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:31.364110 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2877ba-7c91-4d48-b827-166cf78cb6e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:58:31.373314 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-7e2877ba-7c91-4d48-b827-166cf78cb6e1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:58:31.373314 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:58:31.373314 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:58:31.373314 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:58:31.373314 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:58:31.373314 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:58:31.373314 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:58:31.373314 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:58:31.373314 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:58:31.373314 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:58:31.373314 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:58:31.373314 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:58:31.373314 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:58:31.373314 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:58:31.373314 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:58:31.373314 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:58:31.374195 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:58:31.374195 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:58:31.374195 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:58:31.374195 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:58:31.374195 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:58:31.374195 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:58:31.374195 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:58:31.374195 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:58:31.374195 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:58:31.374195 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:58:31.374195 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:58:31.374195 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Aug 30 00:58:31.374195 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:58:31.374195 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:58:31.374195 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:58:31.374195 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:58:31.374941 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:58:31.374941 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:58:31.374941 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:58:31.374941 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:58:31.374941 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:58:31.374941 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:58:31.374941 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:58:31.374941 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:58:31.374941 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:58:31.374941 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:58:31.374941 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:58:31.374941 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Aug 30 00:58:31.379565 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 13/27] 10.222.0.79 () {56 vars in 1096 bytes} [Tue Aug 30 00:58:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 371 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:58:31.385418 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2877ba-7c91-4d48-b827-166cf78cb6e1 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:31.392311 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 15/28] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 00:58:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:58:31.433140 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:31.486237 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf19b68-2421-47cd-8aba-82d233e41bde None None] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:31.487166 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf19b68-2421-47cd-8aba-82d233e41bde None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:31.487643 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf19b68-2421-47cd-8aba-82d233e41bde None None] PATH_INFO: `/` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:31.489934 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 16/29] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 00:58:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 00:58:31.498795 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a489067-aa87-483c-a204-0c88ce79b9b7 None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:31.499740 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a489067-aa87-483c-a204-0c88ce79b9b7 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:31.500215 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a489067-aa87-483c-a204-0c88ce79b9b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:31.535746 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-4a489067-aa87-483c-a204-0c88ce79b9b7 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:58:31.538197 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-4a489067-aa87-483c-a204-0c88ce79b9b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:58:31.570981 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2877ba-7c91-4d48-b827-166cf78cb6e1 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:31.660700 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264022ac-25b0-4801-87eb-152ca177a371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:31.661611 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264022ac-25b0-4801-87eb-152ca177a371 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:31.662022 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264022ac-25b0-4801-87eb-152ca177a371 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:31.662442 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264022ac-25b0-4801-87eb-152ca177a371 None admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:31.663278 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264022ac-25b0-4801-87eb-152ca177a371 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:58:31.663710 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264022ac-25b0-4801-87eb-152ca177a371 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:31.665233 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264022ac-25b0-4801-87eb-152ca177a371 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:31.677922 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 17/30] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 00:58:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:58:31.681280 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 14/31] 10.222.0.79 () {56 vars in 1099 bytes} [Tue Aug 30 00:58:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:58:31.687465 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a489067-aa87-483c-a204-0c88ce79b9b7 None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:31.720295 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:31.765969 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264022ac-25b0-4801-87eb-152ca177a371 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:31.861654 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a489067-aa87-483c-a204-0c88ce79b9b7 None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:31.900183 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37d3385-9ea4-4be2-9571-d94d60158676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:31.901284 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37d3385-9ea4-4be2-9571-d94d60158676 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:31.901758 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37d3385-9ea4-4be2-9571-d94d60158676 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:31.902223 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37d3385-9ea4-4be2-9571-d94d60158676 None admin] PATH_INFO: `/v3/users/54c77b2049f04525ac7b6806a553b84c` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:31.904324 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37d3385-9ea4-4be2-9571-d94d60158676 None admin] RBAC: Authorizing `identity:get_user(user_id=54c77b2049f04525ac7b6806a553b84c)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:31.906056 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37d3385-9ea4-4be2-9571-d94d60158676 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:31.907852 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 18/32] 10.222.0.79 () {56 vars in 1177 bytes} [Tue Aug 30 00:58:31 2022] GET /identity/v3/users/54c77b2049f04525ac7b6806a553b84c => generated 247 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:58:31.908811 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37d3385-9ea4-4be2-9571-d94d60158676 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:31.920926 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:31.961431 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264022ac-25b0-4801-87eb-152ca177a371 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:32.027606 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4503df5c-08f8-4e2a-8be3-7f8ee2f3f51a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:32.028329 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4503df5c-08f8-4e2a-8be3-7f8ee2f3f51a None admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:32.028793 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4503df5c-08f8-4e2a-8be3-7f8ee2f3f51a None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:32.029093 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4503df5c-08f8-4e2a-8be3-7f8ee2f3f51a None admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:32.029787 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4503df5c-08f8-4e2a-8be3-7f8ee2f3f51a None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:32.031234 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4503df5c-08f8-4e2a-8be3-7f8ee2f3f51a None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:32.053050 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:32.078009 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37d3385-9ea4-4be2-9571-d94d60158676 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:32.115340 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3506fe-9d93-4fbd-9a93-b50dc1023e8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:32.115968 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3506fe-9d93-4fbd-9a93-b50dc1023e8b None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:32.116242 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3506fe-9d93-4fbd-9a93-b50dc1023e8b None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:32.116508 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3506fe-9d93-4fbd-9a93-b50dc1023e8b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:32.129067 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3506fe-9d93-4fbd-9a93-b50dc1023e8b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:32.131235 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3506fe-9d93-4fbd-9a93-b50dc1023e8b None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:32.154575 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application [None req-7c3506fe-9d93-4fbd-9a93-b50dc1023e8b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:58:32.154575 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:58:32.154575 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:58:32.154575 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:58:32.154575 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:58:32.154575 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:58:32.154575 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:58:32.154575 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:58:32.154575 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:58:32.154575 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:58:32.154575 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:58:32.154575 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:58:32.154575 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:58:32.154575 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:58:32.154575 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:58:32.154575 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:58:32.156448 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:58:32.156448 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:58:32.156448 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:58:32.156448 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:58:32.156448 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:58:32.156448 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:58:32.156448 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:58:32.156448 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application with Lock( Aug 30 00:58:32.156448 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:58:32.156448 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:58:32.156448 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:58:32.156448 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:58:32.156448 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:58:32.156448 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:58:32.156448 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:58:32.156448 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:58:32.156448 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:58:32.158300 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:58:32.158300 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:58:32.158300 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Aug 30 00:58:32.158300 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 19/33] 10.222.0.79 () {56 vars in 1108 bytes} [Tue Aug 30 00:58:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:58:32.162473 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3506fe-9d93-4fbd-9a93-b50dc1023e8b None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:32.207192 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 15/34] 10.222.0.79 () {60 vars in 1131 bytes} [Tue Aug 30 00:58:31 2022] POST /identity/v3/roles => generated 219 bytes in 441 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:58:32.208082 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4503df5c-08f8-4e2a-8be3-7f8ee2f3f51a None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:32.326944 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3506fe-9d93-4fbd-9a93-b50dc1023e8b None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:32.357985 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4503df5c-08f8-4e2a-8be3-7f8ee2f3f51a None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:32.367680 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5000958b-cb8c-41db-bafd-cf21506fe795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:32.368693 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5000958b-cb8c-41db-bafd-cf21506fe795 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:32.369201 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5000958b-cb8c-41db-bafd-cf21506fe795 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:32.369673 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5000958b-cb8c-41db-bafd-cf21506fe795 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:32.371186 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5000958b-cb8c-41db-bafd-cf21506fe795 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:32.373338 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5000958b-cb8c-41db-bafd-cf21506fe795 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:32.375871 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 20/35] 10.222.0.79 () {56 vars in 1108 bytes} [Tue Aug 30 00:58:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:58:32.377387 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9f3ae2-ca1f-4a05-9688-44bcf17b4b34 None None] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:32.377887 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9f3ae2-ca1f-4a05-9688-44bcf17b4b34 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:32.378537 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9f3ae2-ca1f-4a05-9688-44bcf17b4b34 None None] PATH_INFO: `/` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:32.385231 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 21/36] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 00:58:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:58:32.386421 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9f3ae2-ca1f-4a05-9688-44bcf17b4b34 None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:32.389651 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:32.414843 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881fe6e9-44ec-4dd1-ad3c-e94d7496bb35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:32.415902 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881fe6e9-44ec-4dd1-ad3c-e94d7496bb35 None admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:32.416387 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881fe6e9-44ec-4dd1-ad3c-e94d7496bb35 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:32.416859 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881fe6e9-44ec-4dd1-ad3c-e94d7496bb35 None admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:32.417754 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881fe6e9-44ec-4dd1-ad3c-e94d7496bb35 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:32.420628 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881fe6e9-44ec-4dd1-ad3c-e94d7496bb35 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:32.441387 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 16/37] 10.222.0.79 () {60 vars in 1131 bytes} [Tue Aug 30 00:58:32 2022] POST /identity/v3/roles => generated 225 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:58:32.442519 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881fe6e9-44ec-4dd1-ad3c-e94d7496bb35 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:32.457394 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:32.550338 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9f3ae2-ca1f-4a05-9688-44bcf17b4b34 None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:32.585273 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881fe6e9-44ec-4dd1-ad3c-e94d7496bb35 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:32.602089 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46df4a86-2897-4572-9d24-1700b4bb289e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:32.603157 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46df4a86-2897-4572-9d24-1700b4bb289e None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:32.603607 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46df4a86-2897-4572-9d24-1700b4bb289e None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:32.604336 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46df4a86-2897-4572-9d24-1700b4bb289e None admin] PATH_INFO: `/v3/domains` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:32.605730 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46df4a86-2897-4572-9d24-1700b4bb289e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:58:32.606261 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46df4a86-2897-4572-9d24-1700b4bb289e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:32.608279 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46df4a86-2897-4572-9d24-1700b4bb289e None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:32.628377 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 22/38] 10.222.0.79 () {56 vars in 1109 bytes} [Tue Aug 30 00:58:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:58:32.629937 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5b79a7-a7b1-46ce-9061-14b0e5716c41 None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:32.630441 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5b79a7-a7b1-46ce-9061-14b0e5716c41 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:32.630857 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5b79a7-a7b1-46ce-9061-14b0e5716c41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:32.632771 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7062b787-a73e-4a55-b29b-c2b8fd672340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:32.633543 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7062b787-a73e-4a55-b29b-c2b8fd672340 None admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:32.634065 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7062b787-a73e-4a55-b29b-c2b8fd672340 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:32.634370 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7062b787-a73e-4a55-b29b-c2b8fd672340 None admin] PATH_INFO: `/v3/domains/default/users/54c77b2049f04525ac7b6806a553b84c/roles/d14c3070c9184d76a7b23df69bd3db07` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:32.636603 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7062b787-a73e-4a55-b29b-c2b8fd672340 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=54c77b2049f04525ac7b6806a553b84c, role_id=d14c3070c9184d76a7b23df69bd3db07)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:32.638167 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7062b787-a73e-4a55-b29b-c2b8fd672340 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:32.652881 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-6a5b79a7-a7b1-46ce-9061-14b0e5716c41 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:58:32.654102 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-6a5b79a7-a7b1-46ce-9061-14b0e5716c41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:58:32.657091 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 17/39] 10.222.0.79 () {58 vars in 1361 bytes} [Tue Aug 30 00:58:32 2022] PUT /identity/v3/domains/default/users/54c77b2049f04525ac7b6806a553b84c/roles/d14c3070c9184d76a7b23df69bd3db07 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:58:32.663299 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7062b787-a73e-4a55-b29b-c2b8fd672340 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:32.727363 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:32.744362 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 23/40] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 00:58:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:58:32.746030 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc6a06c-321c-427e-99fa-61c2454a20c5 None None] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:32.746762 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc6a06c-321c-427e-99fa-61c2454a20c5 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:32.747268 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc6a06c-321c-427e-99fa-61c2454a20c5 None None] PATH_INFO: `/` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:32.749091 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 24/41] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 00:58:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:58:32.756600 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a44218b-2c1b-44d2-aea4-c6190d7b54cd None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:32.756973 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a44218b-2c1b-44d2-aea4-c6190d7b54cd None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:32.757313 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a44218b-2c1b-44d2-aea4-c6190d7b54cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:32.768994 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:32.786444 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-6a44218b-2c1b-44d2-aea4-c6190d7b54cd None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:58:32.787784 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-6a44218b-2c1b-44d2-aea4-c6190d7b54cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:58:32.812416 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7062b787-a73e-4a55-b29b-c2b8fd672340 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:32.866543 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8412f565-735a-4d25-9aca-a2d949623ea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:32.867653 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8412f565-735a-4d25-9aca-a2d949623ea8 None admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:32.868135 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8412f565-735a-4d25-9aca-a2d949623ea8 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:32.869213 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8412f565-735a-4d25-9aca-a2d949623ea8 None admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:32.870285 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8412f565-735a-4d25-9aca-a2d949623ea8 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:32.872169 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8412f565-735a-4d25-9aca-a2d949623ea8 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:32.887467 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 25/42] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 00:58:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 00:58:32.917477 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 18/43] 10.222.0.79 () {60 vars in 1141 bytes} [Tue Aug 30 00:58:32 2022] POST /identity/v3/projects => generated 301 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:58:33.045402 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a44218b-2c1b-44d2-aea4-c6190d7b54cd None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:33.169368 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a44218b-2c1b-44d2-aea4-c6190d7b54cd None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:33.170888 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8412f565-735a-4d25-9aca-a2d949623ea8 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:33.194930 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:33.208967 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f97709-56ef-4606-9d44-8336c3e98439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:33.209589 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f97709-56ef-4606-9d44-8336c3e98439 None admin] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:33.209868 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f97709-56ef-4606-9d44-8336c3e98439 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:33.210143 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f97709-56ef-4606-9d44-8336c3e98439 None admin] PATH_INFO: `/v3/roles` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:33.210815 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f97709-56ef-4606-9d44-8336c3e98439 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:33.212233 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f97709-56ef-4606-9d44-8336c3e98439 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:33.293332 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8412f565-735a-4d25-9aca-a2d949623ea8 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:33.323888 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:33.342248 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67daa9f-dbbe-44a2-9801-83c0fbf3856f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:33.342905 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67daa9f-dbbe-44a2-9801-83c0fbf3856f None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:33.343221 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67daa9f-dbbe-44a2-9801-83c0fbf3856f None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:33.343502 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67daa9f-dbbe-44a2-9801-83c0fbf3856f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:33.344766 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67daa9f-dbbe-44a2-9801-83c0fbf3856f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:33.346315 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67daa9f-dbbe-44a2-9801-83c0fbf3856f None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:33.348308 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 19/44] 10.222.0.79 () {56 vars in 1108 bytes} [Tue Aug 30 00:58:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:58:33.353824 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67daa9f-dbbe-44a2-9801-83c0fbf3856f None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:33.448446 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 26/45] 10.222.0.79 () {60 vars in 1131 bytes} [Tue Aug 30 00:58:33 2022] POST /identity/v3/roles => generated 223 bytes in 404 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:58:33.485639 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67daa9f-dbbe-44a2-9801-83c0fbf3856f None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:33.527077 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c03ee26-a224-4adf-9b83-01f9def2f492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:33.527741 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c03ee26-a224-4adf-9b83-01f9def2f492 None admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:33.528025 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c03ee26-a224-4adf-9b83-01f9def2f492 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:33.528578 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c03ee26-a224-4adf-9b83-01f9def2f492 None admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:33.529221 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c03ee26-a224-4adf-9b83-01f9def2f492 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:33.530811 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c03ee26-a224-4adf-9b83-01f9def2f492 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:33.567161 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 20/46] 10.222.0.79 () {60 vars in 1141 bytes} [Tue Aug 30 00:58:33 2022] POST /identity/v3/projects => generated 312 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 00:58:34.726091 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ced4929-683f-499f-94b4-e4c760b30706 None None] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:34.726593 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ced4929-683f-499f-94b4-e4c760b30706 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:34.726593 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ced4929-683f-499f-94b4-e4c760b30706 None None] PATH_INFO: `/` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:34.727933 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 27/47] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 00:58:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:58:34.733963 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be1c703-9b2c-41d0-9780-c3f040cc487e None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:34.734480 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be1c703-9b2c-41d0-9780-c3f040cc487e None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:34.734564 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be1c703-9b2c-41d0-9780-c3f040cc487e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:34.754087 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-4be1c703-9b2c-41d0-9780-c3f040cc487e None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:58:34.755730 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-4be1c703-9b2c-41d0-9780-c3f040cc487e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:58:34.792878 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:34.831041 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 21/48] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 00:58:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:58:35.096312 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ced4929-683f-499f-94b4-e4c760b30706 None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:35.198829 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ced4929-683f-499f-94b4-e4c760b30706 None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:35.243215 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d392ce3-2dda-463b-a21e-7d3a3c4d559e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:35.243875 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d392ce3-2dda-463b-a21e-7d3a3c4d559e None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:35.244154 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d392ce3-2dda-463b-a21e-7d3a3c4d559e None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:35.244578 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d392ce3-2dda-463b-a21e-7d3a3c4d559e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:35.255675 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d392ce3-2dda-463b-a21e-7d3a3c4d559e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:58:35.260487 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application [None req-2d392ce3-2dda-463b-a21e-7d3a3c4d559e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:58:35.260487 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:58:35.260487 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:58:35.260487 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:58:35.260487 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:58:35.260487 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:58:35.260487 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:58:35.260487 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:58:35.260487 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:58:35.260487 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:58:35.260487 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:58:35.260487 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:58:35.260487 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:58:35.260487 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:58:35.260487 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:58:35.260487 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:58:35.261309 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:58:35.261309 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:58:35.261309 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:58:35.261309 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:58:35.261309 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:58:35.261309 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:58:35.261309 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:58:35.261309 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:58:35.261309 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:58:35.261309 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:58:35.261309 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:58:35.261309 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application with Lock( Aug 30 00:58:35.261309 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:58:35.261309 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:58:35.261309 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:58:35.261309 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:58:35.262161 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:58:35.262161 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:58:35.262161 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:58:35.262161 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:58:35.262161 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:58:35.262161 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:58:35.262161 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:58:35.262161 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:58:35.262161 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:58:35.262161 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:58:35.262161 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:58:35.262161 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Aug 30 00:58:35.262161 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 28/49] 10.222.0.79 () {56 vars in 1096 bytes} [Tue Aug 30 00:58:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:58:35.275192 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be1c703-9b2c-41d0-9780-c3f040cc487e None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:35.393785 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be1c703-9b2c-41d0-9780-c3f040cc487e None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:35.433790 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be350a6-ad79-44d0-be0a-e636b05bac79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:35.434402 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be350a6-ad79-44d0-be0a-e636b05bac79 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:35.435365 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be350a6-ad79-44d0-be0a-e636b05bac79 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:35.435646 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be350a6-ad79-44d0-be0a-e636b05bac79 None admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:35.436327 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be350a6-ad79-44d0-be0a-e636b05bac79 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:58:35.436628 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be350a6-ad79-44d0-be0a-e636b05bac79 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:35.438009 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be350a6-ad79-44d0-be0a-e636b05bac79 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:35.446904 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 22/50] 10.222.0.79 () {56 vars in 1099 bytes} [Tue Aug 30 00:58:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:58:35.453867 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d392ce3-2dda-463b-a21e-7d3a3c4d559e None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:35.500167 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:35.537898 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d8c84f-ec4c-47d3-9339-2e37338cec31 None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:35.538187 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d8c84f-ec4c-47d3-9339-2e37338cec31 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:35.538456 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d8c84f-ec4c-47d3-9339-2e37338cec31 None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:35.539816 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 23/51] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 00:58:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 00:58:35.545401 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5468bc6e-6658-4613-9610-6fa9de74483b None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:35.545689 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5468bc6e-6658-4613-9610-6fa9de74483b None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:35.545963 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5468bc6e-6658-4613-9610-6fa9de74483b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:35.558798 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d392ce3-2dda-463b-a21e-7d3a3c4d559e None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:35.564967 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-5468bc6e-6658-4613-9610-6fa9de74483b None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:58:35.566169 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-5468bc6e-6658-4613-9610-6fa9de74483b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:58:35.592773 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:35.595031 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e6c7c2-c704-44cf-8269-41495fc1d14e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:35.595698 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e6c7c2-c704-44cf-8269-41495fc1d14e None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:35.595982 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e6c7c2-c704-44cf-8269-41495fc1d14e None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:35.596276 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e6c7c2-c704-44cf-8269-41495fc1d14e None admin] PATH_INFO: `/v3/users/54c77b2049f04525ac7b6806a553b84c` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:35.597647 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e6c7c2-c704-44cf-8269-41495fc1d14e None admin] RBAC: Authorizing `identity:get_user(user_id=54c77b2049f04525ac7b6806a553b84c)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:35.599550 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e6c7c2-c704-44cf-8269-41495fc1d14e None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:35.601159 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 29/52] 10.222.0.79 () {56 vars in 1177 bytes} [Tue Aug 30 00:58:35 2022] GET /identity/v3/users/54c77b2049f04525ac7b6806a553b84c => generated 247 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:58:35.607888 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e6c7c2-c704-44cf-8269-41495fc1d14e None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:35.636211 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 24/53] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 00:58:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 00:58:35.706759 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e6c7c2-c704-44cf-8269-41495fc1d14e None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:35.717606 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:35.740713 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71355b94-77ac-46bc-ad43-97bfbc5e3c4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:35.741337 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71355b94-77ac-46bc-ad43-97bfbc5e3c4c None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:35.741606 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71355b94-77ac-46bc-ad43-97bfbc5e3c4c None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:35.741875 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71355b94-77ac-46bc-ad43-97bfbc5e3c4c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:35.743061 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71355b94-77ac-46bc-ad43-97bfbc5e3c4c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:35.744989 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71355b94-77ac-46bc-ad43-97bfbc5e3c4c None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:35.746201 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 30/54] 10.222.0.79 () {56 vars in 1108 bytes} [Tue Aug 30 00:58:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:58:35.752128 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5468bc6e-6658-4613-9610-6fa9de74483b None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:35.939368 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71355b94-77ac-46bc-ad43-97bfbc5e3c4c None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:35.971301 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5468bc6e-6658-4613-9610-6fa9de74483b None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:36.007557 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044b4eab-27f0-4cba-bb16-3bfc1fe32e4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:36.008170 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044b4eab-27f0-4cba-bb16-3bfc1fe32e4d None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:36.008455 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044b4eab-27f0-4cba-bb16-3bfc1fe32e4d None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:36.008732 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044b4eab-27f0-4cba-bb16-3bfc1fe32e4d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:36.009466 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044b4eab-27f0-4cba-bb16-3bfc1fe32e4d None admin] RBAC: Adding query filter params (role.id=d14c3070c9184d76a7b23df69bd3db07, scope.domain.id=default, user.id=54c77b2049f04525ac7b6806a553b84c) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:58:36.009777 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044b4eab-27f0-4cba-bb16-3bfc1fe32e4d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:36.011298 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044b4eab-27f0-4cba-bb16-3bfc1fe32e4d None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:36.017865 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 25/55] 10.222.0.79 () {56 vars in 1322 bytes} [Tue Aug 30 00:58:35 2022] GET /identity/v3/role_assignments?user.id=54c77b2049f04525ac7b6806a553b84c&scope.domain.id=default&role.id=d14c3070c9184d76a7b23df69bd3db07 => generated 530 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:58:36.053869 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71355b94-77ac-46bc-ad43-97bfbc5e3c4c None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:36.098296 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70f815e-a124-4a43-a735-4d722dfb1549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:36.099384 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70f815e-a124-4a43-a735-4d722dfb1549 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:36.099878 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70f815e-a124-4a43-a735-4d722dfb1549 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:36.100368 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70f815e-a124-4a43-a735-4d722dfb1549 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:36.102305 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70f815e-a124-4a43-a735-4d722dfb1549 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:36.105065 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70f815e-a124-4a43-a735-4d722dfb1549 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:36.108194 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 31/56] 10.222.0.79 () {56 vars in 1108 bytes} [Tue Aug 30 00:58:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:58:36.113733 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044b4eab-27f0-4cba-bb16-3bfc1fe32e4d None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:36.146957 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:36.230466 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044b4eab-27f0-4cba-bb16-3bfc1fe32e4d None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:36.268701 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf63f8ed-b3ad-4f1f-88ab-e91ce8a1a234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:36.269314 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf63f8ed-b3ad-4f1f-88ab-e91ce8a1a234 None admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:36.269599 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf63f8ed-b3ad-4f1f-88ab-e91ce8a1a234 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:36.269876 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf63f8ed-b3ad-4f1f-88ab-e91ce8a1a234 None admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:36.270528 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf63f8ed-b3ad-4f1f-88ab-e91ce8a1a234 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:36.272004 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf63f8ed-b3ad-4f1f-88ab-e91ce8a1a234 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:36.300361 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 26/57] 10.222.0.79 () {60 vars in 1140 bytes} [Tue Aug 30 00:58:36 2022] POST /identity/v3/projects => generated 298 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:58:38.290638 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7715c9-a962-46e3-9dd7-f927e1235e21 None None] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:38.291161 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7715c9-a962-46e3-9dd7-f927e1235e21 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:38.291248 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7715c9-a962-46e3-9dd7-f927e1235e21 None None] PATH_INFO: `/` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:38.292531 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 32/58] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 00:58:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:58:38.298488 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea105b5c-26ad-4be8-b0b8-dd3b950e7fd3 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:38.298870 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea105b5c-26ad-4be8-b0b8-dd3b950e7fd3 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:38.299030 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea105b5c-26ad-4be8-b0b8-dd3b950e7fd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:38.317000 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-ea105b5c-26ad-4be8-b0b8-dd3b950e7fd3 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:58:38.318157 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-ea105b5c-26ad-4be8-b0b8-dd3b950e7fd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:58:38.383970 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 27/59] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 00:58:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:58:38.662773 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7715c9-a962-46e3-9dd7-f927e1235e21 None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:38.712059 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:38.769821 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7715c9-a962-46e3-9dd7-f927e1235e21 None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:38.806281 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6f4c10-5016-4c40-9b27-57f2d281e597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:38.806908 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6f4c10-5016-4c40-9b27-57f2d281e597 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:38.807207 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6f4c10-5016-4c40-9b27-57f2d281e597 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:38.807469 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6f4c10-5016-4c40-9b27-57f2d281e597 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:38.808588 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6f4c10-5016-4c40-9b27-57f2d281e597 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:38.810060 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6f4c10-5016-4c40-9b27-57f2d281e597 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:38.811867 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 33/60] 10.222.0.79 () {56 vars in 1108 bytes} [Tue Aug 30 00:58:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:58:38.817836 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea105b5c-26ad-4be8-b0b8-dd3b950e7fd3 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:38.829899 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:38.923455 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea105b5c-26ad-4be8-b0b8-dd3b950e7fd3 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:38.957701 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f3c004-c694-4a84-8aa0-be56756b590c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:38.958054 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f3c004-c694-4a84-8aa0-be56756b590c None admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:38.958331 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f3c004-c694-4a84-8aa0-be56756b590c None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:38.958601 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f3c004-c694-4a84-8aa0-be56756b590c None admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:38.959276 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f3c004-c694-4a84-8aa0-be56756b590c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:38.960712 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f3c004-c694-4a84-8aa0-be56756b590c None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:38.989993 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 28/61] 10.222.0.79 () {60 vars in 1132 bytes} [Tue Aug 30 00:58:38 2022] POST /identity/v3/users => generated 275 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:58:42.109192 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4caefe-e821-46f6-bb0d-c3de76b7ca6d None None] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:42.109709 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4caefe-e821-46f6-bb0d-c3de76b7ca6d None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:42.109709 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4caefe-e821-46f6-bb0d-c3de76b7ca6d None None] PATH_INFO: `/` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:42.111429 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 34/62] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 00:58:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:58:42.116531 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f90cad-fd5b-4df8-89ac-81d2f4c7f39c None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:42.117213 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f90cad-fd5b-4df8-89ac-81d2f4c7f39c None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:42.117213 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f90cad-fd5b-4df8-89ac-81d2f4c7f39c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:42.143475 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-c7f90cad-fd5b-4df8-89ac-81d2f4c7f39c None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:58:42.144683 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-c7f90cad-fd5b-4df8-89ac-81d2f4c7f39c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:58:42.254082 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:42.266003 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 29/63] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 00:58:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:58:42.426615 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2d3c19-b7a1-4091-8a18-f4f1c9a9b921 None None] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:42.426956 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2d3c19-b7a1-4091-8a18-f4f1c9a9b921 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:42.427147 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2d3c19-b7a1-4091-8a18-f4f1c9a9b921 None None] PATH_INFO: `/` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:42.428489 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 35/64] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 00:58:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:58:42.434088 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aa2cf7-ee41-4bd3-a607-4b5ff2606bfd None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:42.434373 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aa2cf7-ee41-4bd3-a607-4b5ff2606bfd None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:42.435318 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aa2cf7-ee41-4bd3-a607-4b5ff2606bfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:42.468688 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-74aa2cf7-ee41-4bd3-a607-4b5ff2606bfd None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:58:42.469890 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-74aa2cf7-ee41-4bd3-a607-4b5ff2606bfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:58:42.577104 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67734007-7012-4d19-9967-42d43e5e3be4 None None] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:42.577459 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67734007-7012-4d19-9967-42d43e5e3be4 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:42.577668 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67734007-7012-4d19-9967-42d43e5e3be4 None None] PATH_INFO: `/` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:42.579119 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 36/65] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 00:58:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:58:42.580028 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 30/66] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 00:58:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 00:58:42.591343 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a885da-e82c-43e4-b299-f02e82ea60e6 None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:42.591844 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a885da-e82c-43e4-b299-f02e82ea60e6 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:42.592297 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a885da-e82c-43e4-b299-f02e82ea60e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:42.640992 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-79a885da-e82c-43e4-b299-f02e82ea60e6 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:58:42.643746 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-79a885da-e82c-43e4-b299-f02e82ea60e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:58:42.666141 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aa2cf7-ee41-4bd3-a607-4b5ff2606bfd None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:42.733561 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 37/67] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 00:58:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:58:42.740188 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b3525d-1e66-4e3c-bc3f-90cbe9b25f6a None None] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:42.740673 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b3525d-1e66-4e3c-bc3f-90cbe9b25f6a None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:42.741090 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b3525d-1e66-4e3c-bc3f-90cbe9b25f6a None None] PATH_INFO: `/` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:42.742914 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 38/68] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 00:58:42 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:58:42.749617 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc9f5b0-a5b6-412b-88e9-61ef1b68ab9c None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:42.750084 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc9f5b0-a5b6-412b-88e9-61ef1b68ab9c None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:42.750558 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc9f5b0-a5b6-412b-88e9-61ef1b68ab9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:42.800150 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-6bc9f5b0-a5b6-412b-88e9-61ef1b68ab9c None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:58:42.801581 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-6bc9f5b0-a5b6-412b-88e9-61ef1b68ab9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:58:42.805131 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aa2cf7-ee41-4bd3-a607-4b5ff2606bfd None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:42.836859 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:42.850984 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdd8fb6-ff37-4873-9a3a-d7f0c81372d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:42.852779 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdd8fb6-ff37-4873-9a3a-d7f0c81372d4 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:42.853397 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdd8fb6-ff37-4873-9a3a-d7f0c81372d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:42.853871 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdd8fb6-ff37-4873-9a3a-d7f0c81372d4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:42.858796 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:42.869083 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdd8fb6-ff37-4873-9a3a-d7f0c81372d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:58:42.875106 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-2fdd8fb6-ff37-4873-9a3a-d7f0c81372d4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 00:58:42.875106 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:58:42.875106 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:58:42.875106 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:58:42.875106 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:58:42.875106 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:58:42.875106 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:58:42.875106 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:58:42.875106 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:58:42.875106 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:58:42.875106 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:58:42.875106 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:58:42.875106 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:58:42.875106 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:58:42.875106 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:58:42.875106 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:58:42.876193 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:58:42.876193 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:58:42.876193 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:58:42.876193 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:58:42.876193 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:58:42.876193 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:58:42.876193 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:58:42.876193 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:58:42.876193 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:58:42.876193 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:58:42.876193 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:58:42.876193 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Aug 30 00:58:42.876193 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:58:42.876193 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:58:42.876193 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:58:42.876193 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:58:42.877172 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:58:42.877172 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:58:42.877172 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:58:42.877172 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:58:42.877172 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:58:42.877172 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:58:42.877172 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:58:42.877172 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:58:42.877172 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:58:42.877172 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:58:42.877172 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 00:58:42.877172 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Aug 30 00:58:42.880168 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 31/69] 10.222.0.79 () {56 vars in 1099 bytes} [Tue Aug 30 00:58:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 00:58:42.885670 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e458f260-74bc-46ca-b830-66de5c44f733 None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:42.885670 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e458f260-74bc-46ca-b830-66de5c44f733 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:42.885670 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e458f260-74bc-46ca-b830-66de5c44f733 None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:42.888978 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 32/70] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 00:58:42 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:58:42.890171 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e458f260-74bc-46ca-b830-66de5c44f733 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:42.901318 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 39/71] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 00:58:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:58:42.902175 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc9f5b0-a5b6-412b-88e9-61ef1b68ab9c None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:42.999721 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e458f260-74bc-46ca-b830-66de5c44f733 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:43.016561 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc9f5b0-a5b6-412b-88e9-61ef1b68ab9c None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:43.036130 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd2310e-dbd4-4b7c-99e6-713f575fe1a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:43.036997 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd2310e-dbd4-4b7c-99e6-713f575fe1a7 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:43.037416 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd2310e-dbd4-4b7c-99e6-713f575fe1a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:43.037821 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd2310e-dbd4-4b7c-99e6-713f575fe1a7 None admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:43.038620 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd2310e-dbd4-4b7c-99e6-713f575fe1a7 None admin] RBAC: Adding query filter params (name=member) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:58:43.039055 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd2310e-dbd4-4b7c-99e6-713f575fe1a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:43.040592 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd2310e-dbd4-4b7c-99e6-713f575fe1a7 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:43.050146 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 33/72] 10.222.0.79 () {56 vars in 1101 bytes} [Tue Aug 30 00:58:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:58:43.051609 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ceb68c-4788-49f7-bf5b-92f1c81f2aeb None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:43.052030 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ceb68c-4788-49f7-bf5b-92f1c81f2aeb None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:43.052446 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ceb68c-4788-49f7-bf5b-92f1c81f2aeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:43.058744 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8db2bb8-7b06-43ae-bbda-1047e961fe16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:43.059688 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8db2bb8-7b06-43ae-bbda-1047e961fe16 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:43.060065 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8db2bb8-7b06-43ae-bbda-1047e961fe16 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:43.060431 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8db2bb8-7b06-43ae-bbda-1047e961fe16 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:43.073432 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-72ceb68c-4788-49f7-bf5b-92f1c81f2aeb None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:58:43.074522 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8db2bb8-7b06-43ae-bbda-1047e961fe16 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:58:43.075092 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-72ceb68c-4788-49f7-bf5b-92f1c81f2aeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:58:43.080983 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application [None req-c8db2bb8-7b06-43ae-bbda-1047e961fe16 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:58:43.080983 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:58:43.080983 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:58:43.080983 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:58:43.080983 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:58:43.080983 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:58:43.080983 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:58:43.080983 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:58:43.080983 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:58:43.080983 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:58:43.080983 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:58:43.080983 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:58:43.080983 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:58:43.080983 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:58:43.080983 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:58:43.080983 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:58:43.081968 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:58:43.081968 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:58:43.081968 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:58:43.081968 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:58:43.081968 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:58:43.081968 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:58:43.081968 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:58:43.081968 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:58:43.081968 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:58:43.081968 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:58:43.081968 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:58:43.081968 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application with Lock( Aug 30 00:58:43.081968 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:58:43.081968 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:58:43.081968 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:58:43.081968 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:58:43.082714 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:58:43.082714 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:58:43.082714 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:58:43.082714 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:58:43.082714 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:58:43.082714 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:58:43.082714 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:58:43.082714 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:58:43.082714 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:58:43.082714 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:58:43.082714 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:58:43.082714 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Aug 30 00:58:43.082714 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 40/73] 10.222.0.79 () {56 vars in 1096 bytes} [Tue Aug 30 00:58:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:58:43.083480 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8db2bb8-7b06-43ae-bbda-1047e961fe16 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:43.123503 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:43.134206 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:43.162311 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 34/74] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 00:58:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:58:43.163230 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ceb68c-4788-49f7-bf5b-92f1c81f2aeb None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:43.216479 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8db2bb8-7b06-43ae-bbda-1047e961fe16 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:43.259339 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab8fff2-42d7-4e9c-83ca-470c094cf02b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:43.259904 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab8fff2-42d7-4e9c-83ca-470c094cf02b None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:43.260181 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab8fff2-42d7-4e9c-83ca-470c094cf02b None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:43.260457 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab8fff2-42d7-4e9c-83ca-470c094cf02b None admin] PATH_INFO: `/v3/users/14554d790d74410f850ec973e736e600` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:43.277413 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab8fff2-42d7-4e9c-83ca-470c094cf02b None admin] RBAC: Authorizing `identity:get_user(user_id=14554d790d74410f850ec973e736e600)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:43.279684 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab8fff2-42d7-4e9c-83ca-470c094cf02b None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:43.281414 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 41/75] 10.222.0.79 () {56 vars in 1177 bytes} [Tue Aug 30 00:58:43 2022] GET /identity/v3/users/14554d790d74410f850ec973e736e600 => generated 275 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:58:43.283169 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab8fff2-42d7-4e9c-83ca-470c094cf02b None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:43.328273 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ceb68c-4788-49f7-bf5b-92f1c81f2aeb None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:43.366821 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd757fa-5b00-430f-a542-37571071542a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:43.367772 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd757fa-5b00-430f-a542-37571071542a None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:43.368146 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd757fa-5b00-430f-a542-37571071542a None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:43.368325 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd757fa-5b00-430f-a542-37571071542a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:43.379887 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd757fa-5b00-430f-a542-37571071542a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:58:43.384765 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-9fd757fa-5b00-430f-a542-37571071542a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 00:58:43.384765 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:58:43.384765 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:58:43.384765 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:58:43.384765 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:58:43.384765 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:58:43.384765 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:58:43.384765 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:58:43.384765 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:58:43.384765 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:58:43.384765 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:58:43.384765 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:58:43.384765 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:58:43.384765 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:58:43.384765 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:58:43.384765 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:58:43.385603 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:58:43.385603 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:58:43.385603 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:58:43.385603 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:58:43.385603 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:58:43.385603 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:58:43.385603 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:58:43.385603 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:58:43.385603 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:58:43.385603 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:58:43.385603 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:58:43.385603 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Aug 30 00:58:43.385603 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:58:43.385603 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:58:43.385603 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:58:43.385603 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:58:43.386376 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:58:43.386376 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:58:43.386376 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:58:43.386376 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:58:43.386376 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:58:43.386376 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:58:43.386376 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:58:43.386376 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:58:43.386376 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:58:43.386376 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:58:43.386376 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 00:58:43.386376 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Aug 30 00:58:43.386376 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 35/76] 10.222.0.79 () {56 vars in 1114 bytes} [Tue Aug 30 00:58:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:58:43.387035 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd757fa-5b00-430f-a542-37571071542a None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:43.395877 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:43.407166 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab8fff2-42d7-4e9c-83ca-470c094cf02b None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:43.430971 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:43.445937 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09821d1a-231e-4b2a-8149-8a04aa54575a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:43.446643 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09821d1a-231e-4b2a-8149-8a04aa54575a None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:43.446994 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09821d1a-231e-4b2a-8149-8a04aa54575a None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:43.447305 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09821d1a-231e-4b2a-8149-8a04aa54575a None admin] PATH_INFO: `/v3/roles` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:43.447979 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09821d1a-231e-4b2a-8149-8a04aa54575a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:58:43.448279 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09821d1a-231e-4b2a-8149-8a04aa54575a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:43.449656 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09821d1a-231e-4b2a-8149-8a04aa54575a None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:43.463033 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 42/77] 10.222.0.79 () {56 vars in 1099 bytes} [Tue Aug 30 00:58:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:58:43.463913 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09821d1a-231e-4b2a-8149-8a04aa54575a None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:43.502125 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd757fa-5b00-430f-a542-37571071542a None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:43.536911 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816e8f46-4780-491b-892b-d11e7445766f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:43.537459 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816e8f46-4780-491b-892b-d11e7445766f None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:43.537737 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816e8f46-4780-491b-892b-d11e7445766f None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:43.538010 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816e8f46-4780-491b-892b-d11e7445766f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:43.539150 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816e8f46-4780-491b-892b-d11e7445766f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:43.540629 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816e8f46-4780-491b-892b-d11e7445766f None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:43.542345 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 36/78] 10.222.0.79 () {56 vars in 1108 bytes} [Tue Aug 30 00:58:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:58:43.542941 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816e8f46-4780-491b-892b-d11e7445766f None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:43.572993 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09821d1a-231e-4b2a-8149-8a04aa54575a None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:43.608784 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b45ba7-af68-4604-a150-031c98aa3864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:43.609418 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b45ba7-af68-4604-a150-031c98aa3864 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:43.609698 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b45ba7-af68-4604-a150-031c98aa3864 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:43.609973 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b45ba7-af68-4604-a150-031c98aa3864 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:43.639548 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:43.647895 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816e8f46-4780-491b-892b-d11e7445766f None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:43.650249 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:43.682517 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272c88b1-ef04-477c-8b9c-51274a483ff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:43.683153 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272c88b1-ef04-477c-8b9c-51274a483ff3 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:43.683440 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272c88b1-ef04-477c-8b9c-51274a483ff3 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:43.683705 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272c88b1-ef04-477c-8b9c-51274a483ff3 None admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:43.684397 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272c88b1-ef04-477c-8b9c-51274a483ff3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:58:43.685234 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272c88b1-ef04-477c-8b9c-51274a483ff3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:43.686615 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272c88b1-ef04-477c-8b9c-51274a483ff3 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:43.686823 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b45ba7-af68-4604-a150-031c98aa3864 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:43.688329 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b45ba7-af68-4604-a150-031c98aa3864 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:43.695015 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 37/79] 10.222.0.79 () {56 vars in 1111 bytes} [Tue Aug 30 00:58:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:58:43.695015 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272c88b1-ef04-477c-8b9c-51274a483ff3 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:43.792295 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 43/80] 10.222.0.79 () {58 vars in 1282 bytes} [Tue Aug 30 00:58:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 00:58:43.793461 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b45ba7-af68-4604-a150-031c98aa3864 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:43.799043 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272c88b1-ef04-477c-8b9c-51274a483ff3 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:43.836933 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fe10a2-bef4-43d5-b854-b4c70fba2deb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:43.837559 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fe10a2-bef4-43d5-b854-b4c70fba2deb None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:43.837838 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fe10a2-bef4-43d5-b854-b4c70fba2deb None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:43.838113 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fe10a2-bef4-43d5-b854-b4c70fba2deb None admin] PATH_INFO: `/v3/roles/member` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:43.848641 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fe10a2-bef4-43d5-b854-b4c70fba2deb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:58:43.851131 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:43.853887 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-c9fe10a2-bef4-43d5-b854-b4c70fba2deb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 00:58:43.853887 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:58:43.853887 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:58:43.853887 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:58:43.853887 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:58:43.853887 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:58:43.853887 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:58:43.853887 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:58:43.853887 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:58:43.853887 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:58:43.853887 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:58:43.853887 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:58:43.853887 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:58:43.853887 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:58:43.853887 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:58:43.853887 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:58:43.854805 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:58:43.854805 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:58:43.854805 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:58:43.854805 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:58:43.854805 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:58:43.854805 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:58:43.854805 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:58:43.854805 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:58:43.854805 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:58:43.854805 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:58:43.854805 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:58:43.854805 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Aug 30 00:58:43.854805 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:58:43.854805 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:58:43.854805 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:58:43.854805 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:58:43.855598 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:58:43.855598 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:58:43.855598 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:58:43.855598 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:58:43.855598 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:58:43.855598 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:58:43.855598 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:58:43.855598 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:58:43.855598 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:58:43.855598 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:58:43.855598 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 00:58:43.855598 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Aug 30 00:58:43.855598 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 38/81] 10.222.0.79 () {56 vars in 1099 bytes} [Tue Aug 30 00:58:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:58:43.856218 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fe10a2-bef4-43d5-b854-b4c70fba2deb None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:43.886684 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:43.903115 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b45ba7-af68-4604-a150-031c98aa3864 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:43.941306 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e3fd46-b7d5-482c-b784-ecc94735f7d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:43.941949 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e3fd46-b7d5-482c-b784-ecc94735f7d3 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:43.942244 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e3fd46-b7d5-482c-b784-ecc94735f7d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:43.942503 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e3fd46-b7d5-482c-b784-ecc94735f7d3 None admin] PATH_INFO: `/v3/users/54c77b2049f04525ac7b6806a553b84c` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:43.943685 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e3fd46-b7d5-482c-b784-ecc94735f7d3 None admin] RBAC: Authorizing `identity:get_user(user_id=54c77b2049f04525ac7b6806a553b84c)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:43.945154 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e3fd46-b7d5-482c-b784-ecc94735f7d3 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:43.946769 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 44/82] 10.222.0.79 () {56 vars in 1177 bytes} [Tue Aug 30 00:58:43 2022] GET /identity/v3/users/54c77b2049f04525ac7b6806a553b84c => generated 247 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:58:43.947594 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e3fd46-b7d5-482c-b784-ecc94735f7d3 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:43.964313 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fe10a2-bef4-43d5-b854-b4c70fba2deb None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:44.000066 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c94b765-e0b0-433a-bf1f-07d32bdce71b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:44.000685 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c94b765-e0b0-433a-bf1f-07d32bdce71b None admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:44.000965 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c94b765-e0b0-433a-bf1f-07d32bdce71b None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:44.001234 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c94b765-e0b0-433a-bf1f-07d32bdce71b None admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:44.001892 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c94b765-e0b0-433a-bf1f-07d32bdce71b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:44.003365 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c94b765-e0b0-433a-bf1f-07d32bdce71b None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:44.025583 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 39/83] 10.222.0.79 () {60 vars in 1132 bytes} [Tue Aug 30 00:58:43 2022] POST /identity/v3/users => generated 289 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:58:44.025583 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c94b765-e0b0-433a-bf1f-07d32bdce71b None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:44.077384 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e3fd46-b7d5-482c-b784-ecc94735f7d3 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:44.107575 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:44.123962 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453f99b3-b4ac-4fe8-8f53-93583be33943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:44.124844 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:44.125340 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453f99b3-b4ac-4fe8-8f53-93583be33943 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:44.125692 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453f99b3-b4ac-4fe8-8f53-93583be33943 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:44.126097 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453f99b3-b4ac-4fe8-8f53-93583be33943 None admin] PATH_INFO: `/v3/users/14554d790d74410f850ec973e736e600` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:44.127501 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453f99b3-b4ac-4fe8-8f53-93583be33943 None admin] RBAC: Authorizing `identity:get_user(user_id=14554d790d74410f850ec973e736e600)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:44.129980 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453f99b3-b4ac-4fe8-8f53-93583be33943 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:44.131942 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 45/84] 10.222.0.79 () {56 vars in 1177 bytes} [Tue Aug 30 00:58:43 2022] GET /identity/v3/users/14554d790d74410f850ec973e736e600 => generated 275 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:58:44.138463 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453f99b3-b4ac-4fe8-8f53-93583be33943 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:44.149273 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c94b765-e0b0-433a-bf1f-07d32bdce71b None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:44.193069 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe7b235-db82-42f5-b5b6-300b4a672d57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:44.193745 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe7b235-db82-42f5-b5b6-300b4a672d57 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:44.194029 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe7b235-db82-42f5-b5b6-300b4a672d57 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:44.194306 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe7b235-db82-42f5-b5b6-300b4a672d57 None admin] PATH_INFO: `/v3/projects/4ec1a052ca044bdfa9052279c09cd55c` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:44.196537 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe7b235-db82-42f5-b5b6-300b4a672d57 None admin] RBAC: Authorizing `identity:get_project(project_id=4ec1a052ca044bdfa9052279c09cd55c)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:44.198135 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe7b235-db82-42f5-b5b6-300b4a672d57 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:44.200095 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 40/85] 10.222.0.79 () {56 vars in 1186 bytes} [Tue Aug 30 00:58:44 2022] GET /identity/v3/projects/4ec1a052ca044bdfa9052279c09cd55c => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:58:44.200875 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe7b235-db82-42f5-b5b6-300b4a672d57 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:44.266977 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453f99b3-b4ac-4fe8-8f53-93583be33943 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:44.315819 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48de2e8-c69f-4c6c-807b-8b4f4ab15b21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:44.316643 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48de2e8-c69f-4c6c-807b-8b4f4ab15b21 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:44.316927 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48de2e8-c69f-4c6c-807b-8b4f4ab15b21 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:44.317209 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48de2e8-c69f-4c6c-807b-8b4f4ab15b21 None admin] PATH_INFO: `/v3/roles` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:44.318334 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48de2e8-c69f-4c6c-807b-8b4f4ab15b21 None admin] RBAC: Adding query filter params (name=member) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:58:44.318646 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48de2e8-c69f-4c6c-807b-8b4f4ab15b21 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:44.320511 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48de2e8-c69f-4c6c-807b-8b4f4ab15b21 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:44.332041 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 46/86] 10.222.0.79 () {56 vars in 1101 bytes} [Tue Aug 30 00:58:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:58:44.332847 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48de2e8-c69f-4c6c-807b-8b4f4ab15b21 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:44.343431 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe7b235-db82-42f5-b5b6-300b4a672d57 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:44.391985 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4322375a-8647-4b83-bc4a-3a4114bab5c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:44.392618 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4322375a-8647-4b83-bc4a-3a4114bab5c4 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:44.393601 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4322375a-8647-4b83-bc4a-3a4114bab5c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:44.393601 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4322375a-8647-4b83-bc4a-3a4114bab5c4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:44.399876 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:44.416835 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:44.459202 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48de2e8-c69f-4c6c-807b-8b4f4ab15b21 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:44.470516 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4322375a-8647-4b83-bc4a-3a4114bab5c4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:44.472163 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4322375a-8647-4b83-bc4a-3a4114bab5c4 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:44.496467 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5667ea-9202-4fdb-8519-f2618660452e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:44.497836 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5667ea-9202-4fdb-8519-f2618660452e None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:44.498289 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5667ea-9202-4fdb-8519-f2618660452e None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:44.498797 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5667ea-9202-4fdb-8519-f2618660452e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:44.573484 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5667ea-9202-4fdb-8519-f2618660452e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:44.575011 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5667ea-9202-4fdb-8519-f2618660452e None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:44.581938 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 41/87] 10.222.0.79 () {58 vars in 1282 bytes} [Tue Aug 30 00:58:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 00:58:44.582865 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4322375a-8647-4b83-bc4a-3a4114bab5c4 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:44.632026 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:44.634794 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:44.686969 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 47/88] 10.222.0.79 () {58 vars in 1282 bytes} [Tue Aug 30 00:58:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 00:58:44.688293 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5667ea-9202-4fdb-8519-f2618660452e None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:44.693574 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4322375a-8647-4b83-bc4a-3a4114bab5c4 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:44.731188 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07f8759-92bf-4789-ac94-4218b8a548a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:44.732461 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07f8759-92bf-4789-ac94-4218b8a548a1 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:44.732802 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07f8759-92bf-4789-ac94-4218b8a548a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:44.733135 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07f8759-92bf-4789-ac94-4218b8a548a1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:44.733937 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07f8759-92bf-4789-ac94-4218b8a548a1 None admin] RBAC: Adding query filter params (role.id=c37945a17623465f899d4f217e7af593, scope.project.id=4ec1a052ca044bdfa9052279c09cd55c, user.id=14554d790d74410f850ec973e736e600) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:58:44.734308 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07f8759-92bf-4789-ac94-4218b8a548a1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:44.735869 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07f8759-92bf-4789-ac94-4218b8a548a1 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:44.741926 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 42/89] 10.222.0.79 () {56 vars in 1374 bytes} [Tue Aug 30 00:58:44 2022] GET /identity/v3/role_assignments?user.id=14554d790d74410f850ec973e736e600&scope.project.id=4ec1a052ca044bdfa9052279c09cd55c&role.id=c37945a17623465f899d4f217e7af593 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:58:44.751531 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07f8759-92bf-4789-ac94-4218b8a548a1 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:44.879230 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5667ea-9202-4fdb-8519-f2618660452e None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:44.914385 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb46188-0f37-4812-a030-5821eb7e2f5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:44.915035 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb46188-0f37-4812-a030-5821eb7e2f5b None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:44.915360 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb46188-0f37-4812-a030-5821eb7e2f5b None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:44.915641 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb46188-0f37-4812-a030-5821eb7e2f5b None admin] PATH_INFO: `/v3/users/14554d790d74410f850ec973e736e600` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:44.917295 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb46188-0f37-4812-a030-5821eb7e2f5b None admin] RBAC: Authorizing `identity:get_user(user_id=14554d790d74410f850ec973e736e600)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:44.919631 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb46188-0f37-4812-a030-5821eb7e2f5b None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:44.922553 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 48/90] 10.222.0.79 () {56 vars in 1177 bytes} [Tue Aug 30 00:58:44 2022] GET /identity/v3/users/14554d790d74410f850ec973e736e600 => generated 275 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:58:44.923639 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb46188-0f37-4812-a030-5821eb7e2f5b None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:44.933265 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07f8759-92bf-4789-ac94-4218b8a548a1 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:44.951554 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:44.967652 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:45.003754 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6e85e9-45a2-4440-8b08-a5c20caf88a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:45.004794 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6e85e9-45a2-4440-8b08-a5c20caf88a5 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:45.005312 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6e85e9-45a2-4440-8b08-a5c20caf88a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:45.005784 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6e85e9-45a2-4440-8b08-a5c20caf88a5 None admin] PATH_INFO: `/v3/projects/4ec1a052ca044bdfa9052279c09cd55c` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:45.007325 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6e85e9-45a2-4440-8b08-a5c20caf88a5 None admin] RBAC: Authorizing `identity:get_project(project_id=4ec1a052ca044bdfa9052279c09cd55c)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:45.008978 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6e85e9-45a2-4440-8b08-a5c20caf88a5 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:45.010852 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 43/91] 10.222.0.79 () {56 vars in 1186 bytes} [Tue Aug 30 00:58:44 2022] GET /identity/v3/projects/4ec1a052ca044bdfa9052279c09cd55c => generated 298 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:58:45.011850 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6e85e9-45a2-4440-8b08-a5c20caf88a5 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:45.155756 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6e85e9-45a2-4440-8b08-a5c20caf88a5 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:45.161033 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb46188-0f37-4812-a030-5821eb7e2f5b None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:45.196752 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc98209-4828-4bf3-9c92-57ecf5c9ecd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:45.197868 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc98209-4828-4bf3-9c92-57ecf5c9ecd4 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:45.198347 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc98209-4828-4bf3-9c92-57ecf5c9ecd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:45.198815 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc98209-4828-4bf3-9c92-57ecf5c9ecd4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:45.257832 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:45.279892 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e883230-b7ea-4b82-b728-60f50c6d3409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:45.280535 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e883230-b7ea-4b82-b728-60f50c6d3409 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:45.280811 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e883230-b7ea-4b82-b728-60f50c6d3409 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:45.281083 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e883230-b7ea-4b82-b728-60f50c6d3409 None admin] PATH_INFO: `/v3/projects/4ec1a052ca044bdfa9052279c09cd55c` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:45.282262 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e883230-b7ea-4b82-b728-60f50c6d3409 None admin] RBAC: Authorizing `identity:get_project(project_id=4ec1a052ca044bdfa9052279c09cd55c)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:45.282997 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc98209-4828-4bf3-9c92-57ecf5c9ecd4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:45.283736 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e883230-b7ea-4b82-b728-60f50c6d3409 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:45.284895 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc98209-4828-4bf3-9c92-57ecf5c9ecd4 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:45.285375 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 49/92] 10.222.0.79 () {56 vars in 1186 bytes} [Tue Aug 30 00:58:44 2022] GET /identity/v3/projects/4ec1a052ca044bdfa9052279c09cd55c => generated 298 bytes in 362 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:58:45.286150 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e883230-b7ea-4b82-b728-60f50c6d3409 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:45.417867 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 44/93] 10.222.0.79 () {58 vars in 1282 bytes} [Tue Aug 30 00:58:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 00:58:45.419102 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc98209-4828-4bf3-9c92-57ecf5c9ecd4 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:45.533117 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:45.554903 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc98209-4828-4bf3-9c92-57ecf5c9ecd4 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:45.595668 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624b17c7-9b42-42bc-bd83-f5fed362c723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:45.596655 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624b17c7-9b42-42bc-bd83-f5fed362c723 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:45.597539 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624b17c7-9b42-42bc-bd83-f5fed362c723 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:45.598017 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624b17c7-9b42-42bc-bd83-f5fed362c723 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:45.598960 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624b17c7-9b42-42bc-bd83-f5fed362c723 None admin] RBAC: Adding query filter params (role.id=0e24ae0a2cb9401e8f818402105e9fab, scope.project.id=4ec1a052ca044bdfa9052279c09cd55c, user.id=14554d790d74410f850ec973e736e600) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:58:45.599480 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624b17c7-9b42-42bc-bd83-f5fed362c723 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:45.601277 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624b17c7-9b42-42bc-bd83-f5fed362c723 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:45.607636 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 45/94] 10.222.0.79 () {56 vars in 1374 bytes} [Tue Aug 30 00:58:45 2022] GET /identity/v3/role_assignments?user.id=14554d790d74410f850ec973e736e600&scope.project.id=4ec1a052ca044bdfa9052279c09cd55c&role.id=0e24ae0a2cb9401e8f818402105e9fab => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:58:45.608947 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624b17c7-9b42-42bc-bd83-f5fed362c723 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:45.619356 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:45.666189 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e883230-b7ea-4b82-b728-60f50c6d3409 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:45.711273 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a5d7d7-6908-4321-a542-02a9e3a0636b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:45.711592 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a5d7d7-6908-4321-a542-02a9e3a0636b None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:45.711790 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a5d7d7-6908-4321-a542-02a9e3a0636b None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:45.712066 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a5d7d7-6908-4321-a542-02a9e3a0636b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:45.712841 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a5d7d7-6908-4321-a542-02a9e3a0636b None admin] RBAC: Adding query filter params (role.id=d14c3070c9184d76a7b23df69bd3db07, scope.project.id=4ec1a052ca044bdfa9052279c09cd55c, user.id=54c77b2049f04525ac7b6806a553b84c) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:58:45.713145 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a5d7d7-6908-4321-a542-02a9e3a0636b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:45.714574 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a5d7d7-6908-4321-a542-02a9e3a0636b None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:45.731276 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 50/95] 10.222.0.79 () {56 vars in 1374 bytes} [Tue Aug 30 00:58:45 2022] GET /identity/v3/role_assignments?user.id=54c77b2049f04525ac7b6806a553b84c&scope.project.id=4ec1a052ca044bdfa9052279c09cd55c&role.id=d14c3070c9184d76a7b23df69bd3db07 => generated 259 bytes in 445 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:58:45.742781 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624b17c7-9b42-42bc-bd83-f5fed362c723 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:45.793992 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0649635a-68ff-4dbe-81f5-595e630406d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:45.795047 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0649635a-68ff-4dbe-81f5-595e630406d7 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:45.795499 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0649635a-68ff-4dbe-81f5-595e630406d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:45.795915 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0649635a-68ff-4dbe-81f5-595e630406d7 None admin] PATH_INFO: `/v3/projects/40237530d738498cab3271426ae609fa` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:45.797227 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0649635a-68ff-4dbe-81f5-595e630406d7 None admin] RBAC: Authorizing `identity:get_project(project_id=40237530d738498cab3271426ae609fa)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:45.798838 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0649635a-68ff-4dbe-81f5-595e630406d7 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:45.800716 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 46/96] 10.222.0.79 () {56 vars in 1186 bytes} [Tue Aug 30 00:58:45 2022] GET /identity/v3/projects/40237530d738498cab3271426ae609fa => generated 312 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:58:45.806785 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a5d7d7-6908-4321-a542-02a9e3a0636b None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:45.957976 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a5d7d7-6908-4321-a542-02a9e3a0636b None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:46.004557 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b950b22c-e337-4cae-8b75-7528673c6837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:46.005180 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b950b22c-e337-4cae-8b75-7528673c6837 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:46.005458 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b950b22c-e337-4cae-8b75-7528673c6837 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:46.005731 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b950b22c-e337-4cae-8b75-7528673c6837 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:46.006471 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b950b22c-e337-4cae-8b75-7528673c6837 None admin] RBAC: Adding query filter params (role.id=c37945a17623465f899d4f217e7af593, scope.project.id=40237530d738498cab3271426ae609fa, user.id=14554d790d74410f850ec973e736e600) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:58:46.006841 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b950b22c-e337-4cae-8b75-7528673c6837 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:46.008318 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b950b22c-e337-4cae-8b75-7528673c6837 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:46.014698 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 51/97] 10.222.0.79 () {56 vars in 1374 bytes} [Tue Aug 30 00:58:45 2022] GET /identity/v3/role_assignments?user.id=14554d790d74410f850ec973e736e600&scope.project.id=40237530d738498cab3271426ae609fa&role.id=c37945a17623465f899d4f217e7af593 => generated 259 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:58:46.626772 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff028937-3b25-4f2e-b28e-8c57bbb227da None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:46.627321 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff028937-3b25-4f2e-b28e-8c57bbb227da None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:46.627321 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff028937-3b25-4f2e-b28e-8c57bbb227da None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:46.628703 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 47/98] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 00:58:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:58:46.634493 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf1f931-d479-4c7e-9eb9-4b239051359c None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:46.634981 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf1f931-d479-4c7e-9eb9-4b239051359c None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:46.635052 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf1f931-d479-4c7e-9eb9-4b239051359c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:46.664235 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-abf1f931-d479-4c7e-9eb9-4b239051359c None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:58:46.665461 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-abf1f931-d479-4c7e-9eb9-4b239051359c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:58:46.678111 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:46.757077 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 52/99] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 00:58:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:58:47.008463 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4a36d3-0168-43c7-8bff-041f0d4665be None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:47.008851 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4a36d3-0168-43c7-8bff-041f0d4665be None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:47.009034 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4a36d3-0168-43c7-8bff-041f0d4665be None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:47.010354 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 48/100] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 00:58:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:58:47.017001 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e27f85d-5672-4bfc-b935-fd39f38fc801 None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:47.017360 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e27f85d-5672-4bfc-b935-fd39f38fc801 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:47.017645 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e27f85d-5672-4bfc-b935-fd39f38fc801 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:47.044248 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-6e27f85d-5672-4bfc-b935-fd39f38fc801 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:58:47.045463 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-6e27f85d-5672-4bfc-b935-fd39f38fc801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:58:47.051788 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bd4f9f-a84f-4dfa-8a73-662f5d5cf250 None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:47.052070 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bd4f9f-a84f-4dfa-8a73-662f5d5cf250 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:47.052348 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bd4f9f-a84f-4dfa-8a73-662f5d5cf250 None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:47.053680 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 49/101] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 00:58:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 00:58:47.059111 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175a0889-6dfa-4527-975c-03e07dbfad23 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:47.059424 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175a0889-6dfa-4527-975c-03e07dbfad23 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:47.059886 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175a0889-6dfa-4527-975c-03e07dbfad23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:47.087430 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-175a0889-6dfa-4527-975c-03e07dbfad23 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:58:47.088797 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-175a0889-6dfa-4527-975c-03e07dbfad23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:58:47.114659 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:47.196472 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 53/102] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 00:58:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:58:47.206064 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e27f85d-5672-4bfc-b935-fd39f38fc801 None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:47.216546 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 50/103] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 00:58:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 00:58:47.296752 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:47.321674 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e27f85d-5672-4bfc-b935-fd39f38fc801 None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:47.363054 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbb04c5-2a62-4968-82ea-29d79a4b951e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:47.364008 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbb04c5-2a62-4968-82ea-29d79a4b951e None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:47.364516 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbb04c5-2a62-4968-82ea-29d79a4b951e None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:47.364960 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbb04c5-2a62-4968-82ea-29d79a4b951e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:47.366347 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbb04c5-2a62-4968-82ea-29d79a4b951e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:47.368023 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbb04c5-2a62-4968-82ea-29d79a4b951e None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:47.369806 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 54/104] 10.222.0.79 () {56 vars in 1108 bytes} [Tue Aug 30 00:58:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:58:47.376118 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175a0889-6dfa-4527-975c-03e07dbfad23 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:47.522304 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175a0889-6dfa-4527-975c-03e07dbfad23 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:47.559055 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ae450c-90b1-4756-8e88-0cb53eb14e5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:47.560566 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ae450c-90b1-4756-8e88-0cb53eb14e5c None admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:47.561046 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ae450c-90b1-4756-8e88-0cb53eb14e5c None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:47.561584 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ae450c-90b1-4756-8e88-0cb53eb14e5c None admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:47.562780 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbb04c5-2a62-4968-82ea-29d79a4b951e None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:47.564498 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ae450c-90b1-4756-8e88-0cb53eb14e5c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:47.566415 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ae450c-90b1-4756-8e88-0cb53eb14e5c None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:47.584007 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:47.597377 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 51/105] 10.222.0.79 () {60 vars in 1141 bytes} [Tue Aug 30 00:58:47 2022] POST /identity/v3/projects => generated 302 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:58:47.705932 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ae450c-90b1-4756-8e88-0cb53eb14e5c None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:47.729759 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbb04c5-2a62-4968-82ea-29d79a4b951e None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:47.818340 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49448191-aea3-4419-8eec-1eb658a82b89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:47.820965 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49448191-aea3-4419-8eec-1eb658a82b89 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:47.821270 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49448191-aea3-4419-8eec-1eb658a82b89 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:47.821556 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49448191-aea3-4419-8eec-1eb658a82b89 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:47.835017 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49448191-aea3-4419-8eec-1eb658a82b89 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:58:47.843012 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application [None req-49448191-aea3-4419-8eec-1eb658a82b89 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 00:58:47.843012 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:58:47.843012 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:58:47.843012 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:58:47.843012 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:58:47.843012 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:58:47.843012 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:58:47.843012 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:58:47.843012 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:58:47.843012 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:58:47.843012 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:58:47.843012 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:58:47.843012 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:58:47.843012 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:58:47.843012 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:58:47.843012 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:58:47.844098 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:58:47.844098 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:58:47.844098 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:58:47.844098 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:58:47.844098 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:58:47.844098 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:58:47.844098 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:58:47.844098 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:58:47.844098 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:58:47.844098 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:58:47.844098 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:58:47.844098 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application with Lock( Aug 30 00:58:47.844098 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:58:47.844098 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:58:47.844098 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:58:47.844098 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:58:47.845040 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:58:47.845040 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:58:47.845040 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:58:47.845040 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:58:47.845040 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:58:47.845040 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:58:47.845040 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:58:47.845040 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:58:47.845040 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:58:47.845040 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:58:47.845040 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 00:58:47.845040 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Aug 30 00:58:47.845040 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 55/106] 10.222.0.79 () {56 vars in 1099 bytes} [Tue Aug 30 00:58:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:58:47.852369 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49448191-aea3-4419-8eec-1eb658a82b89 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:47.859265 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:47.947613 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ae450c-90b1-4756-8e88-0cb53eb14e5c None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:48.020199 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937e9b23-fb11-4470-81c8-9363157c8781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:48.021049 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937e9b23-fb11-4470-81c8-9363157c8781 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:48.021351 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937e9b23-fb11-4470-81c8-9363157c8781 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:48.021635 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937e9b23-fb11-4470-81c8-9363157c8781 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:48.041595 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49448191-aea3-4419-8eec-1eb658a82b89 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:48.047568 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937e9b23-fb11-4470-81c8-9363157c8781 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:58:48.052972 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-937e9b23-fb11-4470-81c8-9363157c8781 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 00:58:48.052972 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:58:48.052972 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:58:48.052972 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:58:48.052972 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:58:48.052972 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:58:48.052972 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:58:48.052972 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:58:48.052972 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:58:48.052972 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:58:48.052972 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:58:48.052972 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:58:48.052972 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:58:48.052972 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:58:48.052972 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:58:48.052972 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:58:48.053805 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:58:48.053805 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:58:48.053805 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:58:48.053805 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:58:48.053805 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:58:48.053805 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:58:48.053805 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:58:48.053805 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:58:48.053805 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:58:48.053805 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:58:48.053805 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:58:48.053805 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Aug 30 00:58:48.053805 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:58:48.053805 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:58:48.053805 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:58:48.053805 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:58:48.054534 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:58:48.054534 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:58:48.054534 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:58:48.054534 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:58:48.054534 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:58:48.054534 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:58:48.054534 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:58:48.054534 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:58:48.054534 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:58:48.054534 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:58:48.054534 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 00:58:48.054534 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Aug 30 00:58:48.054534 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 52/107] 10.222.0.79 () {56 vars in 1099 bytes} [Tue Aug 30 00:58:47 2022] GET /identity/v3/roles/reader => generated 84 bytes in 349 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:58:48.066061 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937e9b23-fb11-4470-81c8-9363157c8781 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:48.107277 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac796b8b-b3f1-4a60-919a-f4e8f4d26d3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:48.108327 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac796b8b-b3f1-4a60-919a-f4e8f4d26d3d None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:48.108616 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac796b8b-b3f1-4a60-919a-f4e8f4d26d3d None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:48.108890 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac796b8b-b3f1-4a60-919a-f4e8f4d26d3d None admin] PATH_INFO: `/v3/roles` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:48.109577 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac796b8b-b3f1-4a60-919a-f4e8f4d26d3d None admin] RBAC: Adding query filter params (name=member) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:58:48.109881 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac796b8b-b3f1-4a60-919a-f4e8f4d26d3d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:48.111302 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac796b8b-b3f1-4a60-919a-f4e8f4d26d3d None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:48.121778 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 56/108] 10.222.0.79 () {56 vars in 1101 bytes} [Tue Aug 30 00:58:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:58:48.127715 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac796b8b-b3f1-4a60-919a-f4e8f4d26d3d None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:48.199240 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:48.263876 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937e9b23-fb11-4470-81c8-9363157c8781 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:48.269103 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:48.305823 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6731507-d037-497f-947d-eafb56ba6d6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:48.306833 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6731507-d037-497f-947d-eafb56ba6d6c None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:48.307367 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6731507-d037-497f-947d-eafb56ba6d6c None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:48.307843 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6731507-d037-497f-947d-eafb56ba6d6c None admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:48.308836 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6731507-d037-497f-947d-eafb56ba6d6c None admin] RBAC: Adding query filter params (name=reader) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:58:48.309440 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6731507-d037-497f-947d-eafb56ba6d6c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:48.311548 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6731507-d037-497f-947d-eafb56ba6d6c None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:48.321210 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 53/109] 10.222.0.79 () {56 vars in 1101 bytes} [Tue Aug 30 00:58:48 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:58:48.327740 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6731507-d037-497f-947d-eafb56ba6d6c None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:48.335211 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac796b8b-b3f1-4a60-919a-f4e8f4d26d3d None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:48.402706 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd233069-4b5c-43d4-b712-79c4eb38b45e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:48.403325 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd233069-4b5c-43d4-b712-79c4eb38b45e None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:48.403602 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd233069-4b5c-43d4-b712-79c4eb38b45e None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:48.403879 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd233069-4b5c-43d4-b712-79c4eb38b45e None admin] PATH_INFO: `/v3/users/14554d790d74410f850ec973e736e600` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:48.407903 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd233069-4b5c-43d4-b712-79c4eb38b45e None admin] RBAC: Authorizing `identity:get_user(user_id=14554d790d74410f850ec973e736e600)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:48.409398 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd233069-4b5c-43d4-b712-79c4eb38b45e None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:48.411442 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 57/110] 10.222.0.79 () {56 vars in 1177 bytes} [Tue Aug 30 00:58:48 2022] GET /identity/v3/users/14554d790d74410f850ec973e736e600 => generated 275 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:58:48.416860 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd233069-4b5c-43d4-b712-79c4eb38b45e None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:48.456749 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6731507-d037-497f-947d-eafb56ba6d6c None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:48.483534 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:48.499857 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d6e9da-6327-4d67-bb7f-de0f1631d708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:48.500901 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d6e9da-6327-4d67-bb7f-de0f1631d708 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:48.501406 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d6e9da-6327-4d67-bb7f-de0f1631d708 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:48.501901 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d6e9da-6327-4d67-bb7f-de0f1631d708 None admin] PATH_INFO: `/v3/users/5d9aab6ca22e434a9c0a93bd60bca46a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:48.518987 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d6e9da-6327-4d67-bb7f-de0f1631d708 None admin] RBAC: Authorizing `identity:get_user(user_id=5d9aab6ca22e434a9c0a93bd60bca46a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:48.521131 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d6e9da-6327-4d67-bb7f-de0f1631d708 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:48.523119 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 54/111] 10.222.0.79 () {56 vars in 1177 bytes} [Tue Aug 30 00:58:48 2022] GET /identity/v3/users/5d9aab6ca22e434a9c0a93bd60bca46a => generated 289 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:58:48.536725 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d6e9da-6327-4d67-bb7f-de0f1631d708 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:48.601934 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd233069-4b5c-43d4-b712-79c4eb38b45e None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:48.656938 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d6e9da-6327-4d67-bb7f-de0f1631d708 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:48.672529 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ca419a-4ecc-454e-9c23-cd31a883df1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:48.673192 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ca419a-4ecc-454e-9c23-cd31a883df1b None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:48.673474 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ca419a-4ecc-454e-9c23-cd31a883df1b None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:48.673751 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ca419a-4ecc-454e-9c23-cd31a883df1b None admin] PATH_INFO: `/v3/projects/4ec1a052ca044bdfa9052279c09cd55c` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:48.680111 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ca419a-4ecc-454e-9c23-cd31a883df1b None admin] RBAC: Authorizing `identity:get_project(project_id=4ec1a052ca044bdfa9052279c09cd55c)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:48.681611 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ca419a-4ecc-454e-9c23-cd31a883df1b None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:48.683527 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 58/112] 10.222.0.79 () {56 vars in 1186 bytes} [Tue Aug 30 00:58:48 2022] GET /identity/v3/projects/4ec1a052ca044bdfa9052279c09cd55c => generated 298 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:58:48.689726 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ca419a-4ecc-454e-9c23-cd31a883df1b None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:48.693503 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:48.703341 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede28dcb-c1ad-4e36-a0a5-cf657ea6f58b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:48.704349 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede28dcb-c1ad-4e36-a0a5-cf657ea6f58b None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:48.704876 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede28dcb-c1ad-4e36-a0a5-cf657ea6f58b None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:48.705405 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede28dcb-c1ad-4e36-a0a5-cf657ea6f58b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:48.760823 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:48.788076 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede28dcb-c1ad-4e36-a0a5-cf657ea6f58b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:48.789957 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede28dcb-c1ad-4e36-a0a5-cf657ea6f58b None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:48.895696 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ca419a-4ecc-454e-9c23-cd31a883df1b None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:48.898104 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 55/113] 10.222.0.79 () {58 vars in 1282 bytes} [Tue Aug 30 00:58:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 00:58:48.899648 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14af3f38-e661-4483-bb9f-d937fb58c78c None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:48.900152 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14af3f38-e661-4483-bb9f-d937fb58c78c None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:48.900623 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14af3f38-e661-4483-bb9f-d937fb58c78c None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:48.902090 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 56/114] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 00:58:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:58:48.903881 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d30ad35-432e-4a43-bb71-be9a63a61197 None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:48.904384 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d30ad35-432e-4a43-bb71-be9a63a61197 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:48.905026 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d30ad35-432e-4a43-bb71-be9a63a61197 None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:48.906450 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 57/115] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 00:58:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:58:48.912529 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4fa53e-e9cd-4b23-9165-236aebda4843 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:48.912678 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4fa53e-e9cd-4b23-9165-236aebda4843 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:48.912870 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4fa53e-e9cd-4b23-9165-236aebda4843 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:48.931836 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-ce4fa53e-e9cd-4b23-9165-236aebda4843 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:58:48.933012 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-ce4fa53e-e9cd-4b23-9165-236aebda4843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:58:48.942175 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b50d2d5-d13f-442f-85e2-3f6da654e497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:48.942848 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b50d2d5-d13f-442f-85e2-3f6da654e497 None admin] REQUEST_METHOD: `PUT` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:48.943137 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b50d2d5-d13f-442f-85e2-3f6da654e497 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:48.943527 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b50d2d5-d13f-442f-85e2-3f6da654e497 None admin] PATH_INFO: `/v3/projects/4ec1a052ca044bdfa9052279c09cd55c/users/14554d790d74410f850ec973e736e600/roles/c37945a17623465f899d4f217e7af593` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:48.945609 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b50d2d5-d13f-442f-85e2-3f6da654e497 None admin] RBAC: Authorizing `identity:create_grant(project_id=4ec1a052ca044bdfa9052279c09cd55c, user_id=14554d790d74410f850ec973e736e600, role_id=c37945a17623465f899d4f217e7af593)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:48.947144 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b50d2d5-d13f-442f-85e2-3f6da654e497 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:48.963067 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 59/116] 10.222.0.79 () {58 vars in 1439 bytes} [Tue Aug 30 00:58:48 2022] PUT /identity/v3/projects/4ec1a052ca044bdfa9052279c09cd55c/users/14554d790d74410f850ec973e736e600/roles/c37945a17623465f899d4f217e7af593 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:58:48.964570 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc23dd39-fffe-42b3-a8b4-953e09ddab2d None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:48.965031 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc23dd39-fffe-42b3-a8b4-953e09ddab2d None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:48.965476 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc23dd39-fffe-42b3-a8b4-953e09ddab2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:48.986703 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-cc23dd39-fffe-42b3-a8b4-953e09ddab2d None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:58:48.987969 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-cc23dd39-fffe-42b3-a8b4-953e09ddab2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:58:49.027262 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 58/117] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 00:58:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:58:49.028244 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4fa53e-e9cd-4b23-9165-236aebda4843 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:49.043574 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:49.120441 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:49.150391 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 60/118] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 00:58:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:58:49.151407 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4fa53e-e9cd-4b23-9165-236aebda4843 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:49.152910 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e25401-8f14-4d3c-953f-786459bea826 None None] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:49.154113 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e25401-8f14-4d3c-953f-786459bea826 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:49.154493 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e25401-8f14-4d3c-953f-786459bea826 None None] PATH_INFO: `/` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:49.164560 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 61/119] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 00:58:49 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:58:49.166445 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ba55ae-2582-499c-bd08-dc9d269a9910 None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:49.171163 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ba55ae-2582-499c-bd08-dc9d269a9910 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:49.171163 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ba55ae-2582-499c-bd08-dc9d269a9910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:49.191048 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-33ba55ae-2582-499c-bd08-dc9d269a9910 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:58:49.192722 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-33ba55ae-2582-499c-bd08-dc9d269a9910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:58:49.220205 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e2cf22-8777-4e3f-b8a4-a4018639e048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:49.221222 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e2cf22-8777-4e3f-b8a4-a4018639e048 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:49.221645 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e2cf22-8777-4e3f-b8a4-a4018639e048 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:49.222056 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e2cf22-8777-4e3f-b8a4-a4018639e048 None admin] PATH_INFO: `/v3/projects/4ec1a052ca044bdfa9052279c09cd55c` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:49.228245 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e2cf22-8777-4e3f-b8a4-a4018639e048 None admin] RBAC: Authorizing `identity:get_project(project_id=4ec1a052ca044bdfa9052279c09cd55c)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:49.230253 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e2cf22-8777-4e3f-b8a4-a4018639e048 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:49.234149 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 59/120] 10.222.0.79 () {56 vars in 1186 bytes} [Tue Aug 30 00:58:49 2022] GET /identity/v3/projects/4ec1a052ca044bdfa9052279c09cd55c => generated 298 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:58:49.243764 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e2cf22-8777-4e3f-b8a4-a4018639e048 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:49.330975 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 62/121] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 00:58:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:58:49.331988 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ba55ae-2582-499c-bd08-dc9d269a9910 None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:49.405801 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:49.470176 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e2cf22-8777-4e3f-b8a4-a4018639e048 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:49.532405 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ba55ae-2582-499c-bd08-dc9d269a9910 None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:49.549562 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f394215f-6b5d-43e1-8255-fc8eb914a5dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:49.550243 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f394215f-6b5d-43e1-8255-fc8eb914a5dc None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:49.550525 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f394215f-6b5d-43e1-8255-fc8eb914a5dc None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:49.550797 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f394215f-6b5d-43e1-8255-fc8eb914a5dc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:49.551554 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f394215f-6b5d-43e1-8255-fc8eb914a5dc None admin] RBAC: Adding query filter params (role.id=3e9116b044314295b1dabd1b6dbcd141, scope.project.id=4ec1a052ca044bdfa9052279c09cd55c, user.id=5d9aab6ca22e434a9c0a93bd60bca46a) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:58:49.551860 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f394215f-6b5d-43e1-8255-fc8eb914a5dc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:49.553309 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f394215f-6b5d-43e1-8255-fc8eb914a5dc None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:49.570311 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 60/122] 10.222.0.79 () {56 vars in 1374 bytes} [Tue Aug 30 00:58:49 2022] GET /identity/v3/role_assignments?user.id=5d9aab6ca22e434a9c0a93bd60bca46a&scope.project.id=4ec1a052ca044bdfa9052279c09cd55c&role.id=3e9116b044314295b1dabd1b6dbcd141 => generated 259 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:58:49.571196 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f394215f-6b5d-43e1-8255-fc8eb914a5dc None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:49.582135 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:49.619093 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6839dc2-6a43-40c9-8032-0bce50201ee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:49.619907 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6839dc2-6a43-40c9-8032-0bce50201ee6 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:49.620188 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6839dc2-6a43-40c9-8032-0bce50201ee6 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:49.620459 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6839dc2-6a43-40c9-8032-0bce50201ee6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:49.643653 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6839dc2-6a43-40c9-8032-0bce50201ee6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:58:49.649079 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application [None req-e6839dc2-6a43-40c9-8032-0bce50201ee6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 00:58:49.649079 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:58:49.649079 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:58:49.649079 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:58:49.649079 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:58:49.649079 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:58:49.649079 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:58:49.649079 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:58:49.649079 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:58:49.649079 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:58:49.649079 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:58:49.649079 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:58:49.649079 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:58:49.649079 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:58:49.649079 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:58:49.649079 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:58:49.650062 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:58:49.650062 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:58:49.650062 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:58:49.650062 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:58:49.650062 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:58:49.650062 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:58:49.650062 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:58:49.650062 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:58:49.650062 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:58:49.650062 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:58:49.650062 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:58:49.650062 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application with Lock( Aug 30 00:58:49.650062 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:58:49.650062 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:58:49.650062 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:58:49.650062 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:58:49.650838 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:58:49.650838 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:58:49.650838 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:58:49.650838 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:58:49.650838 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:58:49.650838 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:58:49.650838 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:58:49.650838 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:58:49.650838 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:58:49.650838 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:58:49.650838 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 00:58:49.650838 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Aug 30 00:58:49.650838 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 63/123] 10.222.0.79 () {56 vars in 1114 bytes} [Tue Aug 30 00:58:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:58:49.652043 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6839dc2-6a43-40c9-8032-0bce50201ee6 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:49.760995 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f394215f-6b5d-43e1-8255-fc8eb914a5dc None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:49.811382 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e7dd1d-228c-4916-8de4-09c4634ece96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:49.812631 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e7dd1d-228c-4916-8de4-09c4634ece96 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:49.813589 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e7dd1d-228c-4916-8de4-09c4634ece96 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:49.814343 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e7dd1d-228c-4916-8de4-09c4634ece96 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:49.824567 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:49.830826 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e7dd1d-228c-4916-8de4-09c4634ece96 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:58:49.837649 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-94e7dd1d-228c-4916-8de4-09c4634ece96 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:58:49.837649 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:58:49.837649 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:58:49.837649 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:58:49.837649 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:58:49.837649 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:58:49.837649 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:58:49.837649 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:58:49.837649 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:58:49.837649 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:58:49.837649 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:58:49.837649 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:58:49.837649 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:58:49.837649 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:58:49.837649 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:58:49.837649 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:58:49.838620 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:58:49.838620 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:58:49.838620 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:58:49.838620 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:58:49.838620 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:58:49.838620 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:58:49.838620 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:58:49.838620 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:58:49.838620 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:58:49.838620 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:58:49.838620 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:58:49.838620 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Aug 30 00:58:49.838620 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:58:49.838620 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:58:49.838620 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:58:49.838620 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:58:49.840203 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:58:49.840203 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:58:49.840203 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:58:49.840203 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:58:49.840203 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:58:49.840203 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:58:49.840203 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:58:49.840203 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:58:49.840203 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:58:49.840203 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:58:49.840203 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:58:49.840203 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Aug 30 00:58:49.844589 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 61/124] 10.222.0.79 () {56 vars in 1096 bytes} [Tue Aug 30 00:58:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:58:49.848645 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e7dd1d-228c-4916-8de4-09c4634ece96 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:49.865127 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6839dc2-6a43-40c9-8032-0bce50201ee6 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:49.955926 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8971def5-9d30-4f18-8875-cf41d036c889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:49.956581 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8971def5-9d30-4f18-8875-cf41d036c889 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:49.956818 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8971def5-9d30-4f18-8875-cf41d036c889 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:49.957117 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8971def5-9d30-4f18-8875-cf41d036c889 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:49.979922 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e7dd1d-228c-4916-8de4-09c4634ece96 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:49.992100 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8971def5-9d30-4f18-8875-cf41d036c889 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:58:49.997419 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application [None req-8971def5-9d30-4f18-8875-cf41d036c889 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 00:58:49.997419 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:58:49.997419 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:58:49.997419 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:58:49.997419 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:58:49.997419 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:58:49.997419 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:58:49.997419 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:58:49.997419 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:58:49.997419 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:58:49.997419 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:58:49.997419 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:58:49.997419 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:58:49.997419 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:58:49.997419 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:58:49.997419 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:58:49.998486 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:58:49.998486 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:58:49.998486 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:58:49.998486 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:58:49.998486 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:58:49.998486 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:58:49.998486 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:58:49.998486 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:58:49.998486 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:58:49.998486 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:58:49.998486 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:58:49.998486 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application with Lock( Aug 30 00:58:49.998486 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:58:49.998486 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:58:49.998486 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:58:49.998486 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:58:49.999351 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:58:49.999351 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:58:49.999351 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:58:49.999351 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:58:49.999351 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:58:49.999351 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:58:49.999351 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:58:49.999351 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:58:49.999351 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:58:49.999351 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:58:49.999351 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 00:58:49.999351 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Aug 30 00:58:49.999351 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 64/125] 10.222.0.79 () {56 vars in 1099 bytes} [Tue Aug 30 00:58:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 347 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:58:50.005566 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8971def5-9d30-4f18-8875-cf41d036c889 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:50.034588 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b5bd07-ca7a-418b-819c-f25f09f7d0d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:50.036241 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b5bd07-ca7a-418b-819c-f25f09f7d0d7 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:50.036522 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b5bd07-ca7a-418b-819c-f25f09f7d0d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:50.036794 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b5bd07-ca7a-418b-819c-f25f09f7d0d7 None admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:50.037473 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b5bd07-ca7a-418b-819c-f25f09f7d0d7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:58:50.037779 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b5bd07-ca7a-418b-819c-f25f09f7d0d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:50.042606 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b5bd07-ca7a-418b-819c-f25f09f7d0d7 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:50.061625 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 62/126] 10.222.0.79 () {56 vars in 1111 bytes} [Tue Aug 30 00:58:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:58:50.063431 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b5bd07-ca7a-418b-819c-f25f09f7d0d7 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:50.102543 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:50.152266 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:50.225979 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8971def5-9d30-4f18-8875-cf41d036c889 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:50.227801 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b5bd07-ca7a-418b-819c-f25f09f7d0d7 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:50.265729 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853abedc-d85f-4a87-a2aa-e27576bab6a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:50.266449 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853abedc-d85f-4a87-a2aa-e27576bab6a0 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:50.266686 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853abedc-d85f-4a87-a2aa-e27576bab6a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:50.266958 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853abedc-d85f-4a87-a2aa-e27576bab6a0 None admin] PATH_INFO: `/v3/roles` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:50.267702 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853abedc-d85f-4a87-a2aa-e27576bab6a0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:58:50.268055 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853abedc-d85f-4a87-a2aa-e27576bab6a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:50.269472 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853abedc-d85f-4a87-a2aa-e27576bab6a0 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:50.282451 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 65/127] 10.222.0.79 () {56 vars in 1099 bytes} [Tue Aug 30 00:58:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:58:50.282451 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853abedc-d85f-4a87-a2aa-e27576bab6a0 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:50.299779 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf3ad9a-26c9-4f8a-a033-1e84247747b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:50.300720 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf3ad9a-26c9-4f8a-a033-1e84247747b3 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:50.301220 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf3ad9a-26c9-4f8a-a033-1e84247747b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:50.301714 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf3ad9a-26c9-4f8a-a033-1e84247747b3 None admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:50.304208 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf3ad9a-26c9-4f8a-a033-1e84247747b3 None admin] RBAC: Adding query filter params (name=member) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:58:50.304742 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf3ad9a-26c9-4f8a-a033-1e84247747b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:50.307182 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf3ad9a-26c9-4f8a-a033-1e84247747b3 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:50.329920 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 63/128] 10.222.0.79 () {56 vars in 1101 bytes} [Tue Aug 30 00:58:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:58:50.331388 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf3ad9a-26c9-4f8a-a033-1e84247747b3 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:50.443671 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf3ad9a-26c9-4f8a-a033-1e84247747b3 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:50.475941 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:50.495452 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcd98ee-b797-40f1-8c58-6f3a672e00e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:50.496723 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcd98ee-b797-40f1-8c58-6f3a672e00e0 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:50.497941 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcd98ee-b797-40f1-8c58-6f3a672e00e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:50.498636 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcd98ee-b797-40f1-8c58-6f3a672e00e0 None admin] PATH_INFO: `/v3/users/54c77b2049f04525ac7b6806a553b84c` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:50.500921 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcd98ee-b797-40f1-8c58-6f3a672e00e0 None admin] RBAC: Authorizing `identity:get_user(user_id=54c77b2049f04525ac7b6806a553b84c)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:50.502560 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcd98ee-b797-40f1-8c58-6f3a672e00e0 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:50.504443 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 64/129] 10.222.0.79 () {56 vars in 1177 bytes} [Tue Aug 30 00:58:50 2022] GET /identity/v3/users/54c77b2049f04525ac7b6806a553b84c => generated 247 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:58:50.505258 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcd98ee-b797-40f1-8c58-6f3a672e00e0 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:50.527981 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853abedc-d85f-4a87-a2aa-e27576bab6a0 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:50.533843 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:50.582313 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bacbd9-e728-45f0-b709-6626802af5f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:50.582873 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bacbd9-e728-45f0-b709-6626802af5f1 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:50.583176 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bacbd9-e728-45f0-b709-6626802af5f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:50.583461 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bacbd9-e728-45f0-b709-6626802af5f1 None admin] PATH_INFO: `/v3/users/14554d790d74410f850ec973e736e600` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:50.584627 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bacbd9-e728-45f0-b709-6626802af5f1 None admin] RBAC: Authorizing `identity:get_user(user_id=14554d790d74410f850ec973e736e600)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:50.586095 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bacbd9-e728-45f0-b709-6626802af5f1 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:50.587715 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 66/130] 10.222.0.79 () {56 vars in 1177 bytes} [Tue Aug 30 00:58:50 2022] GET /identity/v3/users/14554d790d74410f850ec973e736e600 => generated 275 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:58:50.588489 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bacbd9-e728-45f0-b709-6626802af5f1 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:50.625377 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcd98ee-b797-40f1-8c58-6f3a672e00e0 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:50.663679 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1caed6a-9e70-41f4-995c-8e54190aefcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:50.664315 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1caed6a-9e70-41f4-995c-8e54190aefcd None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:50.664599 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1caed6a-9e70-41f4-995c-8e54190aefcd None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:50.664874 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1caed6a-9e70-41f4-995c-8e54190aefcd None admin] PATH_INFO: `/v3/users/14554d790d74410f850ec973e736e600` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:50.666036 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1caed6a-9e70-41f4-995c-8e54190aefcd None admin] RBAC: Authorizing `identity:get_user(user_id=14554d790d74410f850ec973e736e600)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:50.667501 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1caed6a-9e70-41f4-995c-8e54190aefcd None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:50.669235 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 65/131] 10.222.0.79 () {56 vars in 1177 bytes} [Tue Aug 30 00:58:50 2022] GET /identity/v3/users/14554d790d74410f850ec973e736e600 => generated 275 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:58:50.670400 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3851fdf6-fc99-4e59-bf1f-c95cd8a2a8e7 None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:50.670686 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3851fdf6-fc99-4e59-bf1f-c95cd8a2a8e7 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:50.670962 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3851fdf6-fc99-4e59-bf1f-c95cd8a2a8e7 None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:50.672204 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 66/132] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 00:58:50 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:58:50.672963 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3851fdf6-fc99-4e59-bf1f-c95cd8a2a8e7 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:50.704568 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bacbd9-e728-45f0-b709-6626802af5f1 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:50.740887 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1722f47d-64e4-46ec-9654-bfc515bd10f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:50.741221 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:50.741532 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1722f47d-64e4-46ec-9654-bfc515bd10f3 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:50.742093 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1722f47d-64e4-46ec-9654-bfc515bd10f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:50.742093 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1722f47d-64e4-46ec-9654-bfc515bd10f3 None admin] PATH_INFO: `/v3/projects/4ec1a052ca044bdfa9052279c09cd55c` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:50.743668 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1722f47d-64e4-46ec-9654-bfc515bd10f3 None admin] RBAC: Authorizing `identity:get_project(project_id=4ec1a052ca044bdfa9052279c09cd55c)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:50.745086 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1722f47d-64e4-46ec-9654-bfc515bd10f3 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:50.751172 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 67/133] 10.222.0.79 () {56 vars in 1186 bytes} [Tue Aug 30 00:58:50 2022] GET /identity/v3/projects/4ec1a052ca044bdfa9052279c09cd55c => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:58:50.751172 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1722f47d-64e4-46ec-9654-bfc515bd10f3 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:50.792577 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:50.801353 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3851fdf6-fc99-4e59-bf1f-c95cd8a2a8e7 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:50.841678 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8ea772-5924-42a3-898d-d15dd90defaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:50.842540 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8ea772-5924-42a3-898d-d15dd90defaa None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:50.842968 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8ea772-5924-42a3-898d-d15dd90defaa None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:50.843434 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8ea772-5924-42a3-898d-d15dd90defaa None admin] PATH_INFO: `/v3/projects/4ec1a052ca044bdfa9052279c09cd55c` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:50.844898 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8ea772-5924-42a3-898d-d15dd90defaa None admin] RBAC: Authorizing `identity:get_project(project_id=4ec1a052ca044bdfa9052279c09cd55c)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:50.846668 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8ea772-5924-42a3-898d-d15dd90defaa None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:50.848753 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 67/134] 10.222.0.79 () {56 vars in 1186 bytes} [Tue Aug 30 00:58:50 2022] GET /identity/v3/projects/4ec1a052ca044bdfa9052279c09cd55c => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:58:50.850200 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b61e757-0cc5-4f92-b5c1-70d9ce63bf24 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:50.850792 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b61e757-0cc5-4f92-b5c1-70d9ce63bf24 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:50.851494 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b61e757-0cc5-4f92-b5c1-70d9ce63bf24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:50.858707 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1722f47d-64e4-46ec-9654-bfc515bd10f3 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:50.871895 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-0b61e757-0cc5-4f92-b5c1-70d9ce63bf24 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:58:50.873877 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-0b61e757-0cc5-4f92-b5c1-70d9ce63bf24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:58:50.896830 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfc0f15-6890-4550-b347-54883c0f942b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:50.897476 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfc0f15-6890-4550-b347-54883c0f942b None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:50.897763 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfc0f15-6890-4550-b347-54883c0f942b None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:50.898043 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfc0f15-6890-4550-b347-54883c0f942b None admin] PATH_INFO: `/v3/projects/40237530d738498cab3271426ae609fa` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:50.899239 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfc0f15-6890-4550-b347-54883c0f942b None admin] RBAC: Authorizing `identity:get_project(project_id=40237530d738498cab3271426ae609fa)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:50.900706 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfc0f15-6890-4550-b347-54883c0f942b None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:50.902680 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 68/135] 10.222.0.79 () {56 vars in 1186 bytes} [Tue Aug 30 00:58:50 2022] GET /identity/v3/projects/40237530d738498cab3271426ae609fa => generated 312 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:58:50.908211 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfc0f15-6890-4550-b347-54883c0f942b None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:50.968116 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 68/136] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 00:58:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:58:50.972098 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b61e757-0cc5-4f92-b5c1-70d9ce63bf24 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:51.042152 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfc0f15-6890-4550-b347-54883c0f942b None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:51.052767 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:51.061624 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:51.079737 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f7a70b-debc-4d84-8821-3f07b91b041e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:51.080416 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f7a70b-debc-4d84-8821-3f07b91b041e None admin] REQUEST_METHOD: `PUT` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:51.080698 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f7a70b-debc-4d84-8821-3f07b91b041e None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:51.080987 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f7a70b-debc-4d84-8821-3f07b91b041e None admin] PATH_INFO: `/v3/projects/4ec1a052ca044bdfa9052279c09cd55c/users/54c77b2049f04525ac7b6806a553b84c/roles/d14c3070c9184d76a7b23df69bd3db07` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:51.085341 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f7a70b-debc-4d84-8821-3f07b91b041e None admin] RBAC: Authorizing `identity:create_grant(project_id=4ec1a052ca044bdfa9052279c09cd55c, user_id=54c77b2049f04525ac7b6806a553b84c, role_id=d14c3070c9184d76a7b23df69bd3db07)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:51.085341 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f7a70b-debc-4d84-8821-3f07b91b041e None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:51.126039 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 69/137] 10.222.0.79 () {58 vars in 1439 bytes} [Tue Aug 30 00:58:50 2022] PUT /identity/v3/projects/4ec1a052ca044bdfa9052279c09cd55c/users/54c77b2049f04525ac7b6806a553b84c/roles/d14c3070c9184d76a7b23df69bd3db07 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:58:51.126777 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f7a70b-debc-4d84-8821-3f07b91b041e None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:51.130481 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b61e757-0cc5-4f92-b5c1-70d9ce63bf24 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:51.178714 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e993c8c7-d0d0-4305-b3e3-7ed1498c43de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:51.179856 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e993c8c7-d0d0-4305-b3e3-7ed1498c43de None admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:51.181407 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e993c8c7-d0d0-4305-b3e3-7ed1498c43de None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:51.182104 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e993c8c7-d0d0-4305-b3e3-7ed1498c43de None admin] PATH_INFO: `/v3/projects/4ec1a052ca044bdfa9052279c09cd55c/users/14554d790d74410f850ec973e736e600/roles/0e24ae0a2cb9401e8f818402105e9fab` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:51.187564 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e993c8c7-d0d0-4305-b3e3-7ed1498c43de None admin] RBAC: Authorizing `identity:create_grant(project_id=4ec1a052ca044bdfa9052279c09cd55c, user_id=14554d790d74410f850ec973e736e600, role_id=0e24ae0a2cb9401e8f818402105e9fab)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:51.190672 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e993c8c7-d0d0-4305-b3e3-7ed1498c43de None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:51.217286 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 69/138] 10.222.0.79 () {58 vars in 1439 bytes} [Tue Aug 30 00:58:50 2022] PUT /identity/v3/projects/4ec1a052ca044bdfa9052279c09cd55c/users/14554d790d74410f850ec973e736e600/roles/0e24ae0a2cb9401e8f818402105e9fab => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:58:51.323484 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f7a70b-debc-4d84-8821-3f07b91b041e None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:51.358923 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e993c8c7-d0d0-4305-b3e3-7ed1498c43de None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:51.392074 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4676e685-5f1d-41e2-a977-ec69cdd089a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:51.392696 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4676e685-5f1d-41e2-a977-ec69cdd089a0 None admin] REQUEST_METHOD: `PUT` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:51.392973 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4676e685-5f1d-41e2-a977-ec69cdd089a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:51.393252 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4676e685-5f1d-41e2-a977-ec69cdd089a0 None admin] PATH_INFO: `/v3/projects/40237530d738498cab3271426ae609fa/users/14554d790d74410f850ec973e736e600/roles/c37945a17623465f899d4f217e7af593` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:51.398460 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4676e685-5f1d-41e2-a977-ec69cdd089a0 None admin] RBAC: Authorizing `identity:create_grant(project_id=40237530d738498cab3271426ae609fa, user_id=14554d790d74410f850ec973e736e600, role_id=c37945a17623465f899d4f217e7af593)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:51.400948 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4676e685-5f1d-41e2-a977-ec69cdd089a0 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:51.426883 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 70/139] 10.222.0.79 () {58 vars in 1439 bytes} [Tue Aug 30 00:58:51 2022] PUT /identity/v3/projects/40237530d738498cab3271426ae609fa/users/14554d790d74410f850ec973e736e600/roles/c37945a17623465f899d4f217e7af593 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:58:51.506576 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7261dd1-6e8d-4910-9304-b31f91e5f292 None None] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:51.506889 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7261dd1-6e8d-4910-9304-b31f91e5f292 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:51.507168 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7261dd1-6e8d-4910-9304-b31f91e5f292 None None] PATH_INFO: `/` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:51.508573 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 71/140] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 00:58:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 00:58:51.513598 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e993c8c7-d0d0-4305-b3e3-7ed1498c43de None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:51.526517 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2729a913-21a6-450b-9cb3-1474fb441bf0 None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:51.526826 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2729a913-21a6-450b-9cb3-1474fb441bf0 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:51.527192 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2729a913-21a6-450b-9cb3-1474fb441bf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:51.558298 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:51.567287 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-2729a913-21a6-450b-9cb3-1474fb441bf0 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:58:51.568549 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-2729a913-21a6-450b-9cb3-1474fb441bf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:58:51.602344 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bbbd9e-7910-4ff3-859c-71f172d2f3e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:51.604495 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bbbd9e-7910-4ff3-859c-71f172d2f3e3 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:51.604778 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bbbd9e-7910-4ff3-859c-71f172d2f3e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:51.605060 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bbbd9e-7910-4ff3-859c-71f172d2f3e3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:51.608574 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bbbd9e-7910-4ff3-859c-71f172d2f3e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:51.610101 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bbbd9e-7910-4ff3-859c-71f172d2f3e3 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:51.617174 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 70/141] 10.222.0.79 () {56 vars in 1108 bytes} [Tue Aug 30 00:58:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:58:51.622943 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bbbd9e-7910-4ff3-859c-71f172d2f3e3 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:51.624582 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:51.693886 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 72/142] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 00:58:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:58:51.795970 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bbbd9e-7910-4ff3-859c-71f172d2f3e3 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:51.844889 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69fe02a-b6f0-4771-85a4-a09fd2e765a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:51.845542 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69fe02a-b6f0-4771-85a4-a09fd2e765a9 None admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:51.845788 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69fe02a-b6f0-4771-85a4-a09fd2e765a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:51.846064 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69fe02a-b6f0-4771-85a4-a09fd2e765a9 None admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:51.846732 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69fe02a-b6f0-4771-85a4-a09fd2e765a9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:51.848380 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69fe02a-b6f0-4771-85a4-a09fd2e765a9 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:51.877919 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 71/143] 10.222.0.79 () {60 vars in 1132 bytes} [Tue Aug 30 00:58:51 2022] POST /identity/v3/users => generated 283 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 00:58:51.991079 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2729a913-21a6-450b-9cb3-1474fb441bf0 None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:52.118958 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2729a913-21a6-450b-9cb3-1474fb441bf0 None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:52.160438 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bfe95c-755e-4c18-beb3-6426c9270e09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:52.161089 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bfe95c-755e-4c18-beb3-6426c9270e09 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:52.161403 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bfe95c-755e-4c18-beb3-6426c9270e09 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:52.161740 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bfe95c-755e-4c18-beb3-6426c9270e09 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:52.174407 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bfe95c-755e-4c18-beb3-6426c9270e09 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:58:52.179460 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application [None req-b2bfe95c-755e-4c18-beb3-6426c9270e09 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 00:58:52.179460 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:58:52.179460 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:58:52.179460 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:58:52.179460 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:58:52.179460 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:58:52.179460 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:58:52.179460 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:58:52.179460 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:58:52.179460 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:58:52.179460 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:58:52.179460 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:58:52.179460 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:58:52.179460 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:58:52.179460 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:58:52.179460 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:58:52.180339 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:58:52.180339 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:58:52.180339 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:58:52.180339 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:58:52.180339 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:58:52.180339 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:58:52.180339 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:58:52.180339 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:58:52.180339 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:58:52.180339 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:58:52.180339 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:58:52.180339 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application with Lock( Aug 30 00:58:52.180339 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:58:52.180339 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:58:52.180339 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:58:52.180339 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:58:52.181512 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:58:52.181512 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:58:52.181512 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:58:52.181512 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:58:52.181512 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:58:52.181512 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:58:52.181512 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:58:52.181512 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:58:52.181512 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:58:52.181512 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:58:52.181512 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 00:58:52.181512 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Aug 30 00:58:52.181512 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 73/144] 10.222.0.79 () {56 vars in 1099 bytes} [Tue Aug 30 00:58:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:58:52.188285 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69fe02a-b6f0-4771-85a4-a09fd2e765a9 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:52.201535 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b652de6-13d2-4c2d-8934-c2f981aa807e None None] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:52.201823 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b652de6-13d2-4c2d-8934-c2f981aa807e None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:52.202080 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b652de6-13d2-4c2d-8934-c2f981aa807e None None] PATH_INFO: `/` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:52.204452 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 74/145] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 00:58:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:58:52.211078 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc868fd-93e2-45a8-8649-7b9b038b8d1b None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:52.211380 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc868fd-93e2-45a8-8649-7b9b038b8d1b None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:52.211647 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc868fd-93e2-45a8-8649-7b9b038b8d1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:52.234295 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-6bc868fd-93e2-45a8-8649-7b9b038b8d1b None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:58:52.235556 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-6bc868fd-93e2-45a8-8649-7b9b038b8d1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:58:52.252494 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:52.300880 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:52.351872 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 75/146] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 00:58:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 00:58:52.390221 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69fe02a-b6f0-4771-85a4-a09fd2e765a9 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:52.427406 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201bdb1c-9deb-41ec-b0ee-4bcd069e4aad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:52.428029 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201bdb1c-9deb-41ec-b0ee-4bcd069e4aad None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:52.428310 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201bdb1c-9deb-41ec-b0ee-4bcd069e4aad None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:52.428582 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201bdb1c-9deb-41ec-b0ee-4bcd069e4aad None admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:52.429263 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201bdb1c-9deb-41ec-b0ee-4bcd069e4aad None admin] RBAC: Adding query filter params (name=member) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:58:52.429565 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201bdb1c-9deb-41ec-b0ee-4bcd069e4aad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:52.430954 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201bdb1c-9deb-41ec-b0ee-4bcd069e4aad None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:52.441328 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 72/147] 10.222.0.79 () {56 vars in 1101 bytes} [Tue Aug 30 00:58:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:58:52.446938 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc868fd-93e2-45a8-8649-7b9b038b8d1b None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:52.580424 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc868fd-93e2-45a8-8649-7b9b038b8d1b None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:52.629348 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2b4e90-b918-4ea2-b2bb-9908e3d0326c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:52.630000 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2b4e90-b918-4ea2-b2bb-9908e3d0326c None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:52.630278 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2b4e90-b918-4ea2-b2bb-9908e3d0326c None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:52.630548 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2b4e90-b918-4ea2-b2bb-9908e3d0326c None admin] PATH_INFO: `/v3/users/14554d790d74410f850ec973e736e600` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:52.635883 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2b4e90-b918-4ea2-b2bb-9908e3d0326c None admin] RBAC: Authorizing `identity:get_user(user_id=14554d790d74410f850ec973e736e600)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:52.637379 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2b4e90-b918-4ea2-b2bb-9908e3d0326c None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:52.639402 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 76/148] 10.222.0.79 () {56 vars in 1177 bytes} [Tue Aug 30 00:58:52 2022] GET /identity/v3/users/14554d790d74410f850ec973e736e600 => generated 275 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:58:52.644802 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201bdb1c-9deb-41ec-b0ee-4bcd069e4aad None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:52.777549 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2b4e90-b918-4ea2-b2bb-9908e3d0326c None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:52.802759 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201bdb1c-9deb-41ec-b0ee-4bcd069e4aad None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:52.805791 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:52.818110 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:52.855480 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402706dc-0872-4b2d-8c28-cbddef4ca016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:52.856215 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402706dc-0872-4b2d-8c28-cbddef4ca016 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:52.856592 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402706dc-0872-4b2d-8c28-cbddef4ca016 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:52.857040 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402706dc-0872-4b2d-8c28-cbddef4ca016 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:52.959277 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402706dc-0872-4b2d-8c28-cbddef4ca016 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:52.968639 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402706dc-0872-4b2d-8c28-cbddef4ca016 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:53.033497 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2b4e90-b918-4ea2-b2bb-9908e3d0326c None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:53.126764 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfafd8bc-b446-4b40-a7cb-ca91980e94a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:53.127388 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfafd8bc-b446-4b40-a7cb-ca91980e94a2 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:53.127655 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfafd8bc-b446-4b40-a7cb-ca91980e94a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:53.127929 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfafd8bc-b446-4b40-a7cb-ca91980e94a2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:53.152807 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfafd8bc-b446-4b40-a7cb-ca91980e94a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:58:53.158753 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application [None req-bfafd8bc-b446-4b40-a7cb-ca91980e94a2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 00:58:53.158753 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:58:53.158753 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:58:53.158753 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:58:53.158753 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:58:53.158753 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:58:53.158753 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:58:53.158753 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:58:53.158753 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:58:53.158753 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:58:53.158753 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:58:53.158753 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:58:53.158753 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:58:53.158753 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:58:53.158753 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:58:53.158753 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:58:53.159753 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:58:53.159753 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:58:53.159753 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:58:53.159753 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:58:53.159753 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:58:53.159753 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:58:53.159753 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:58:53.159753 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:58:53.159753 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:58:53.159753 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:58:53.159753 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:58:53.159753 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application with Lock( Aug 30 00:58:53.159753 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:58:53.159753 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:58:53.159753 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:58:53.159753 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:58:53.160515 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:58:53.160515 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:58:53.160515 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:58:53.160515 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:58:53.160515 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:58:53.160515 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:58:53.160515 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:58:53.160515 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:58:53.160515 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:58:53.160515 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:58:53.160515 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 00:58:53.160515 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Aug 30 00:58:53.168436 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 77/149] 10.222.0.79 () {56 vars in 1099 bytes} [Tue Aug 30 00:58:52 2022] GET /identity/v3/roles/reader => generated 84 bytes in 391 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 00:58:53.178664 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfafd8bc-b446-4b40-a7cb-ca91980e94a2 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:53.242651 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 73/150] 10.222.0.79 () {58 vars in 1282 bytes} [Tue Aug 30 00:58:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 598 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 00:58:53.249152 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402706dc-0872-4b2d-8c28-cbddef4ca016 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:53.253670 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:53.360704 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:53.411234 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfafd8bc-b446-4b40-a7cb-ca91980e94a2 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:53.465460 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402706dc-0872-4b2d-8c28-cbddef4ca016 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:53.524002 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f4be16-3664-4909-8f3e-1081f93d2af2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:53.525034 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f4be16-3664-4909-8f3e-1081f93d2af2 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:53.525507 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f4be16-3664-4909-8f3e-1081f93d2af2 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:53.525988 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f4be16-3664-4909-8f3e-1081f93d2af2 None admin] PATH_INFO: `/v3/roles` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:53.526871 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f4be16-3664-4909-8f3e-1081f93d2af2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:58:53.527397 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f4be16-3664-4909-8f3e-1081f93d2af2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:53.529312 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f4be16-3664-4909-8f3e-1081f93d2af2 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:53.543465 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 78/151] 10.222.0.79 () {56 vars in 1101 bytes} [Tue Aug 30 00:58:53 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 365 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:58:53.549433 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93e703f-ed4f-42e0-a79a-c33fd836318f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:53.550105 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93e703f-ed4f-42e0-a79a-c33fd836318f None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:53.550382 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93e703f-ed4f-42e0-a79a-c33fd836318f None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:53.550652 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93e703f-ed4f-42e0-a79a-c33fd836318f None admin] PATH_INFO: `/v3/projects/4ec1a052ca044bdfa9052279c09cd55c` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:53.553642 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93e703f-ed4f-42e0-a79a-c33fd836318f None admin] RBAC: Authorizing `identity:get_project(project_id=4ec1a052ca044bdfa9052279c09cd55c)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:53.554380 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f4be16-3664-4909-8f3e-1081f93d2af2 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:53.555510 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93e703f-ed4f-42e0-a79a-c33fd836318f None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:53.557694 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 74/152] 10.222.0.79 () {56 vars in 1186 bytes} [Tue Aug 30 00:58:53 2022] GET /identity/v3/projects/4ec1a052ca044bdfa9052279c09cd55c => generated 298 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:58:53.564733 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93e703f-ed4f-42e0-a79a-c33fd836318f None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:53.683653 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:53.688916 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f4be16-3664-4909-8f3e-1081f93d2af2 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:53.722198 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93e703f-ed4f-42e0-a79a-c33fd836318f None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:53.776434 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd75a9ac-cf62-476f-9a07-ed41d46dc477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:53.777289 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd75a9ac-cf62-476f-9a07-ed41d46dc477 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:53.777705 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd75a9ac-cf62-476f-9a07-ed41d46dc477 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:53.778138 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd75a9ac-cf62-476f-9a07-ed41d46dc477 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:53.779055 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd75a9ac-cf62-476f-9a07-ed41d46dc477 None admin] RBAC: Adding query filter params (role.id=c37945a17623465f899d4f217e7af593, scope.project.id=4ec1a052ca044bdfa9052279c09cd55c, user.id=14554d790d74410f850ec973e736e600) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:58:53.779519 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd75a9ac-cf62-476f-9a07-ed41d46dc477 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:53.781008 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3cc812-89d2-4e60-ae16-38534b573858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:53.781283 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd75a9ac-cf62-476f-9a07-ed41d46dc477 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:53.781665 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3cc812-89d2-4e60-ae16-38534b573858 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:53.781945 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3cc812-89d2-4e60-ae16-38534b573858 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:53.782219 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3cc812-89d2-4e60-ae16-38534b573858 None admin] PATH_INFO: `/v3/users/5d9aab6ca22e434a9c0a93bd60bca46a` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:53.783433 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3cc812-89d2-4e60-ae16-38534b573858 None admin] RBAC: Authorizing `identity:get_user(user_id=5d9aab6ca22e434a9c0a93bd60bca46a)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:53.786710 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3cc812-89d2-4e60-ae16-38534b573858 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:53.786710 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 79/153] 10.222.0.79 () {56 vars in 1177 bytes} [Tue Aug 30 00:58:53 2022] GET /identity/v3/users/5d9aab6ca22e434a9c0a93bd60bca46a => generated 289 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:58:53.791953 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 75/154] 10.222.0.79 () {56 vars in 1374 bytes} [Tue Aug 30 00:58:53 2022] GET /identity/v3/role_assignments?user.id=14554d790d74410f850ec973e736e600&scope.project.id=4ec1a052ca044bdfa9052279c09cd55c&role.id=c37945a17623465f899d4f217e7af593 => generated 608 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:58:53.792715 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3cc812-89d2-4e60-ae16-38534b573858 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:53.815604 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:53.964923 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3cc812-89d2-4e60-ae16-38534b573858 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:54.011049 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ae0264-3fa0-4f23-b804-64765a3fb5d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:54.011737 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ae0264-3fa0-4f23-b804-64765a3fb5d9 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:54.012012 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ae0264-3fa0-4f23-b804-64765a3fb5d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:54.012283 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ae0264-3fa0-4f23-b804-64765a3fb5d9 None admin] PATH_INFO: `/v3/projects/4ec1a052ca044bdfa9052279c09cd55c` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:54.013957 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ae0264-3fa0-4f23-b804-64765a3fb5d9 None admin] RBAC: Authorizing `identity:get_project(project_id=4ec1a052ca044bdfa9052279c09cd55c)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:54.015499 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ae0264-3fa0-4f23-b804-64765a3fb5d9 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:54.017254 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 80/155] 10.222.0.79 () {56 vars in 1186 bytes} [Tue Aug 30 00:58:53 2022] GET /identity/v3/projects/4ec1a052ca044bdfa9052279c09cd55c => generated 298 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:58:54.023505 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd75a9ac-cf62-476f-9a07-ed41d46dc477 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:54.171974 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd75a9ac-cf62-476f-9a07-ed41d46dc477 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:54.215223 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4791e808-4dd6-4e88-b20d-c76a78f3c830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:54.216356 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4791e808-4dd6-4e88-b20d-c76a78f3c830 None admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:54.216639 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4791e808-4dd6-4e88-b20d-c76a78f3c830 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:54.217161 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4791e808-4dd6-4e88-b20d-c76a78f3c830 None admin] PATH_INFO: `/v3/projects/4ec1a052ca044bdfa9052279c09cd55c/users/5d9aab6ca22e434a9c0a93bd60bca46a/roles/3e9116b044314295b1dabd1b6dbcd141` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:54.221318 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4791e808-4dd6-4e88-b20d-c76a78f3c830 None admin] RBAC: Authorizing `identity:create_grant(project_id=4ec1a052ca044bdfa9052279c09cd55c, user_id=5d9aab6ca22e434a9c0a93bd60bca46a, role_id=3e9116b044314295b1dabd1b6dbcd141)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:54.222816 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4791e808-4dd6-4e88-b20d-c76a78f3c830 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:54.225354 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:54.240759 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 76/156] 10.222.0.79 () {58 vars in 1439 bytes} [Tue Aug 30 00:58:54 2022] PUT /identity/v3/projects/4ec1a052ca044bdfa9052279c09cd55c/users/5d9aab6ca22e434a9c0a93bd60bca46a/roles/3e9116b044314295b1dabd1b6dbcd141 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:58:54.755437 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8f71c8-af54-4cf9-b74b-cd2cc7b7e701 None None] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:54.755937 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8f71c8-af54-4cf9-b74b-cd2cc7b7e701 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:54.756011 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8f71c8-af54-4cf9-b74b-cd2cc7b7e701 None None] PATH_INFO: `/` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:54.757384 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 81/157] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 00:58:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:58:54.777222 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78d58b5-aa50-463f-a854-7dfa6a9a0f1b None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:54.777847 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78d58b5-aa50-463f-a854-7dfa6a9a0f1b None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:54.778351 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78d58b5-aa50-463f-a854-7dfa6a9a0f1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:54.808887 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-d78d58b5-aa50-463f-a854-7dfa6a9a0f1b None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:58:54.811376 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-d78d58b5-aa50-463f-a854-7dfa6a9a0f1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:58:54.900504 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 77/158] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 00:58:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:58:55.451435 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8f71c8-af54-4cf9-b74b-cd2cc7b7e701 None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:55.507901 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37773f6c-da53-4264-bff5-2edc4dce8baf None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:55.508853 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37773f6c-da53-4264-bff5-2edc4dce8baf None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:55.509406 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37773f6c-da53-4264-bff5-2edc4dce8baf None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:55.511053 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 78/159] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 00:58:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:58:55.516307 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3136d9f2-ed21-4e60-b118-ff79266437f9 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:55.516870 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3136d9f2-ed21-4e60-b118-ff79266437f9 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:55.517361 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3136d9f2-ed21-4e60-b118-ff79266437f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:55.551553 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-3136d9f2-ed21-4e60-b118-ff79266437f9 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:58:55.553348 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-3136d9f2-ed21-4e60-b118-ff79266437f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:58:55.591818 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:55.648955 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8f71c8-af54-4cf9-b74b-cd2cc7b7e701 None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:55.676724 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 79/160] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 00:58:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 00:58:55.678261 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3189466-8699-4d8e-b419-b68acfe8b381 None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:55.678694 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3189466-8699-4d8e-b419-b68acfe8b381 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:55.679277 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3189466-8699-4d8e-b419-b68acfe8b381 None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:55.680748 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 80/161] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 00:58:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:58:55.693478 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceccaa7e-9406-4953-b0f7-e3fac5b37757 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:55.694062 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceccaa7e-9406-4953-b0f7-e3fac5b37757 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:55.694542 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceccaa7e-9406-4953-b0f7-e3fac5b37757 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:55.715298 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82511bc1-e937-4e95-8d6e-49d43a98e64e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:55.716796 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82511bc1-e937-4e95-8d6e-49d43a98e64e None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:55.717211 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82511bc1-e937-4e95-8d6e-49d43a98e64e None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:55.717624 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82511bc1-e937-4e95-8d6e-49d43a98e64e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:55.724385 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-ceccaa7e-9406-4953-b0f7-e3fac5b37757 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:58:55.725700 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-ceccaa7e-9406-4953-b0f7-e3fac5b37757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:58:55.756047 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82511bc1-e937-4e95-8d6e-49d43a98e64e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:58:55.762084 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application [None req-82511bc1-e937-4e95-8d6e-49d43a98e64e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:58:55.762084 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:58:55.762084 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:58:55.762084 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:58:55.762084 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:58:55.762084 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:58:55.762084 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:58:55.762084 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:58:55.762084 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:58:55.762084 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:58:55.762084 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:58:55.762084 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:58:55.762084 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:58:55.762084 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:58:55.762084 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:58:55.762084 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:58:55.763235 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:58:55.763235 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:58:55.763235 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:58:55.763235 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:58:55.763235 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:58:55.763235 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:58:55.763235 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:58:55.763235 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:58:55.763235 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:58:55.763235 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:58:55.763235 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:58:55.763235 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application with Lock( Aug 30 00:58:55.763235 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:58:55.763235 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:58:55.763235 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:58:55.763235 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:58:55.764057 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:58:55.764057 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:58:55.764057 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:58:55.764057 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:58:55.764057 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:58:55.764057 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:58:55.764057 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:58:55.764057 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:58:55.764057 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:58:55.764057 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:58:55.764057 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:58:55.764057 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Aug 30 00:58:55.766578 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 82/162] 10.222.0.79 () {56 vars in 1096 bytes} [Tue Aug 30 00:58:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:58:55.776153 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82511bc1-e937-4e95-8d6e-49d43a98e64e None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:55.802300 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:55.822861 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 81/163] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 00:58:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 00:58:55.957963 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82511bc1-e937-4e95-8d6e-49d43a98e64e None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:55.960913 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e1b3e8-c6f9-42cd-9bb5-6fa0df5fc3dc None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:55.961440 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e1b3e8-c6f9-42cd-9bb5-6fa0df5fc3dc None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:55.961917 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e1b3e8-c6f9-42cd-9bb5-6fa0df5fc3dc None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:55.967594 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 82/164] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 00:58:55 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 00:58:55.974154 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff0d108-f979-48e3-9ef8-e418ee774e57 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:55.974704 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff0d108-f979-48e3-9ef8-e418ee774e57 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:55.975206 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff0d108-f979-48e3-9ef8-e418ee774e57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:56.001982 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0980323-2ca4-4c0b-bcc9-6e835a1012a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:56.004257 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0980323-2ca4-4c0b-bcc9-6e835a1012a6 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:56.004536 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0980323-2ca4-4c0b-bcc9-6e835a1012a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:56.004803 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0980323-2ca4-4c0b-bcc9-6e835a1012a6 None admin] PATH_INFO: `/v3/roles` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:56.005575 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0980323-2ca4-4c0b-bcc9-6e835a1012a6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:58:56.005882 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0980323-2ca4-4c0b-bcc9-6e835a1012a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:56.011153 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0980323-2ca4-4c0b-bcc9-6e835a1012a6 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:56.011153 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:56.015422 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-fff0d108-f979-48e3-9ef8-e418ee774e57 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:58:56.016870 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-fff0d108-f979-48e3-9ef8-e418ee774e57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:58:56.025244 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 83/165] 10.222.0.79 () {56 vars in 1099 bytes} [Tue Aug 30 00:58:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:58:56.028558 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0980323-2ca4-4c0b-bcc9-6e835a1012a6 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:56.123003 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 83/166] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 00:58:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:58:56.210845 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0980323-2ca4-4c0b-bcc9-6e835a1012a6 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:56.261268 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0f5ae5-dd43-4d7e-843c-0f59dfdf6f78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:56.261913 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0f5ae5-dd43-4d7e-843c-0f59dfdf6f78 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:56.262190 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0f5ae5-dd43-4d7e-843c-0f59dfdf6f78 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:56.262455 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0f5ae5-dd43-4d7e-843c-0f59dfdf6f78 None admin] PATH_INFO: `/v3/users/54c77b2049f04525ac7b6806a553b84c` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:56.263727 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0f5ae5-dd43-4d7e-843c-0f59dfdf6f78 None admin] RBAC: Authorizing `identity:get_user(user_id=54c77b2049f04525ac7b6806a553b84c)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:56.265186 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0f5ae5-dd43-4d7e-843c-0f59dfdf6f78 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:56.266822 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 84/167] 10.222.0.79 () {56 vars in 1177 bytes} [Tue Aug 30 00:58:56 2022] GET /identity/v3/users/54c77b2049f04525ac7b6806a553b84c => generated 247 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:58:56.272712 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff0d108-f979-48e3-9ef8-e418ee774e57 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:56.389814 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff0d108-f979-48e3-9ef8-e418ee774e57 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:56.406229 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:56.411725 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0f5ae5-dd43-4d7e-843c-0f59dfdf6f78 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:56.441492 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c015ddec-b2fb-456f-b25a-ab30cd198b45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:56.442116 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c015ddec-b2fb-456f-b25a-ab30cd198b45 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:56.442394 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c015ddec-b2fb-456f-b25a-ab30cd198b45 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:56.442666 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c015ddec-b2fb-456f-b25a-ab30cd198b45 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:56.542522 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:56.602597 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0f5ae5-dd43-4d7e-843c-0f59dfdf6f78 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:56.620236 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c015ddec-b2fb-456f-b25a-ab30cd198b45 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:56.621909 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c015ddec-b2fb-456f-b25a-ab30cd198b45 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:56.648074 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079703da-351a-458e-86fc-5de584c67f51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:56.650225 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079703da-351a-458e-86fc-5de584c67f51 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:56.650800 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079703da-351a-458e-86fc-5de584c67f51 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:56.652542 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079703da-351a-458e-86fc-5de584c67f51 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:56.672377 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079703da-351a-458e-86fc-5de584c67f51 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:58:56.679104 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application [None req-079703da-351a-458e-86fc-5de584c67f51 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 00:58:56.679104 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:58:56.679104 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:58:56.679104 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:58:56.679104 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:58:56.679104 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:58:56.679104 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:58:56.679104 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:58:56.679104 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:58:56.679104 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:58:56.679104 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:58:56.679104 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:58:56.679104 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:58:56.679104 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:58:56.679104 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:58:56.679104 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:58:56.680251 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:58:56.680251 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:58:56.680251 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:58:56.680251 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:58:56.680251 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:58:56.680251 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:58:56.680251 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:58:56.680251 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:58:56.680251 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:58:56.680251 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:58:56.680251 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:58:56.680251 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application with Lock( Aug 30 00:58:56.680251 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:58:56.680251 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:58:56.680251 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:58:56.680251 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:58:56.681605 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:58:56.681605 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:58:56.681605 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:58:56.681605 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:58:56.681605 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:58:56.681605 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:58:56.681605 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:58:56.681605 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:58:56.681605 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:58:56.681605 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:58:56.681605 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 00:58:56.681605 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Aug 30 00:58:56.681605 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 85/168] 10.222.0.79 () {56 vars in 1099 bytes} [Tue Aug 30 00:58:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:58:56.681605 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079703da-351a-458e-86fc-5de584c67f51 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:56.779693 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 84/169] 10.222.0.79 () {58 vars in 1282 bytes} [Tue Aug 30 00:58:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 508 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 00:58:56.780679 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c015ddec-b2fb-456f-b25a-ab30cd198b45 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:56.795703 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079703da-351a-458e-86fc-5de584c67f51 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:56.803311 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:56.827353 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:56.840540 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db582df-2222-4246-bb68-b9f1ce96d01d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:56.841801 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db582df-2222-4246-bb68-b9f1ce96d01d None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:56.842171 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db582df-2222-4246-bb68-b9f1ce96d01d None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:56.842426 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db582df-2222-4246-bb68-b9f1ce96d01d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:56.853379 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db582df-2222-4246-bb68-b9f1ce96d01d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:58:56.858525 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application [None req-2db582df-2222-4246-bb68-b9f1ce96d01d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 00:58:56.858525 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:58:56.858525 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:58:56.858525 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:58:56.858525 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:58:56.858525 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:58:56.858525 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:58:56.858525 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:58:56.858525 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:58:56.858525 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:58:56.858525 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:58:56.858525 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:58:56.858525 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:58:56.858525 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:58:56.858525 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:58:56.858525 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:58:56.859489 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:58:56.859489 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:58:56.859489 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:58:56.859489 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:58:56.859489 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:58:56.859489 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:58:56.859489 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:58:56.859489 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:58:56.859489 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:58:56.859489 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:58:56.859489 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:58:56.859489 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application with Lock( Aug 30 00:58:56.859489 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:58:56.859489 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:58:56.859489 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:58:56.859489 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:58:56.860269 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:58:56.860269 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:58:56.860269 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:58:56.860269 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:58:56.860269 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:58:56.860269 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:58:56.860269 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:58:56.860269 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:58:56.860269 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:58:56.860269 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:58:56.860269 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 00:58:56.860269 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Aug 30 00:58:56.860269 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 86/170] 10.222.0.79 () {56 vars in 1114 bytes} [Tue Aug 30 00:58:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:58:56.865803 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456c643e-04d5-4492-b145-8cfbe5b18487 None None] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:56.866085 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456c643e-04d5-4492-b145-8cfbe5b18487 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:56.866353 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456c643e-04d5-4492-b145-8cfbe5b18487 None None] PATH_INFO: `/` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:56.868434 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 87/171] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 00:58:56 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:58:56.868919 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456c643e-04d5-4492-b145-8cfbe5b18487 None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:56.908556 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c015ddec-b2fb-456f-b25a-ab30cd198b45 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:56.944588 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51082f2-8586-4512-8f37-4713e24a8dd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:56.945229 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51082f2-8586-4512-8f37-4713e24a8dd1 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:56.945505 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51082f2-8586-4512-8f37-4713e24a8dd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:56.945774 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51082f2-8586-4512-8f37-4713e24a8dd1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:56.957991 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51082f2-8586-4512-8f37-4713e24a8dd1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:58:56.962911 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-e51082f2-8586-4512-8f37-4713e24a8dd1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:58:56.962911 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:58:56.962911 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:58:56.962911 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:58:56.962911 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:58:56.962911 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:58:56.962911 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:58:56.962911 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:58:56.962911 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:58:56.962911 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:58:56.962911 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:58:56.962911 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:58:56.962911 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:58:56.962911 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:58:56.962911 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:58:56.962911 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:58:56.963832 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:58:56.963832 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:58:56.963832 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:58:56.963832 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:58:56.963832 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:58:56.963832 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:58:56.963832 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:58:56.963832 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:58:56.963832 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:58:56.963832 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:58:56.963832 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:58:56.963832 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Aug 30 00:58:56.963832 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:58:56.963832 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:58:56.963832 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:58:56.963832 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:58:56.968081 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:58:56.968081 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:58:56.968081 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:58:56.968081 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:58:56.968081 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:58:56.968081 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:58:56.968081 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:58:56.968081 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:58:56.968081 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:58:56.968081 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:58:56.968081 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:58:56.968081 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Aug 30 00:58:56.968081 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 85/172] 10.222.0.79 () {56 vars in 1096 bytes} [Tue Aug 30 00:58:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:58:56.968081 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51082f2-8586-4512-8f37-4713e24a8dd1 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:56.993925 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456c643e-04d5-4492-b145-8cfbe5b18487 None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:57.033636 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd1594a-a30c-4a1a-aa21-35acfab0cd7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:57.034261 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd1594a-a30c-4a1a-aa21-35acfab0cd7f None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:57.034537 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd1594a-a30c-4a1a-aa21-35acfab0cd7f None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:57.034802 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd1594a-a30c-4a1a-aa21-35acfab0cd7f None admin] PATH_INFO: `/v3/roles` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:57.035497 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd1594a-a30c-4a1a-aa21-35acfab0cd7f None admin] RBAC: Adding query filter params (name=member) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:58:57.035794 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd1594a-a30c-4a1a-aa21-35acfab0cd7f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:57.037169 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd1594a-a30c-4a1a-aa21-35acfab0cd7f None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:57.046609 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 88/173] 10.222.0.79 () {56 vars in 1101 bytes} [Tue Aug 30 00:58:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:58:57.047840 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cd744b-66ee-4df2-87d9-428c256de799 None None] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:57.048134 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cd744b-66ee-4df2-87d9-428c256de799 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:57.048405 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cd744b-66ee-4df2-87d9-428c256de799 None None] PATH_INFO: `/` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:57.049936 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 89/174] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 00:58:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:58:57.050997 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cd744b-66ee-4df2-87d9-428c256de799 None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:57.055193 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:57.087216 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51082f2-8586-4512-8f37-4713e24a8dd1 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:57.104728 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:57.125565 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9982b92-6761-41de-a36b-3f2747b65681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:57.126311 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9982b92-6761-41de-a36b-3f2747b65681 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:57.126875 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9982b92-6761-41de-a36b-3f2747b65681 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:57.127251 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9982b92-6761-41de-a36b-3f2747b65681 None admin] PATH_INFO: `/v3/projects/4ec1a052ca044bdfa9052279c09cd55c` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:57.128923 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9982b92-6761-41de-a36b-3f2747b65681 None admin] RBAC: Authorizing `identity:get_project(project_id=4ec1a052ca044bdfa9052279c09cd55c)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:57.130525 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9982b92-6761-41de-a36b-3f2747b65681 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:57.132342 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 86/175] 10.222.0.79 () {56 vars in 1186 bytes} [Tue Aug 30 00:58:56 2022] GET /identity/v3/projects/4ec1a052ca044bdfa9052279c09cd55c => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:58:57.138109 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833ec787-01fe-4a29-830d-c40641847662 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:57.138385 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833ec787-01fe-4a29-830d-c40641847662 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:57.138651 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833ec787-01fe-4a29-830d-c40641847662 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:57.156774 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-833ec787-01fe-4a29-830d-c40641847662 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:58:57.157967 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-833ec787-01fe-4a29-830d-c40641847662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:58:57.164556 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cd744b-66ee-4df2-87d9-428c256de799 None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:57.205203 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d53817-ac6a-4741-8779-9ea3d5f49dd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:57.206159 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d53817-ac6a-4741-8779-9ea3d5f49dd3 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:57.206596 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d53817-ac6a-4741-8779-9ea3d5f49dd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:57.206987 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d53817-ac6a-4741-8779-9ea3d5f49dd3 None admin] PATH_INFO: `/v3/roles` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:57.207701 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d53817-ac6a-4741-8779-9ea3d5f49dd3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:58:57.207998 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d53817-ac6a-4741-8779-9ea3d5f49dd3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:57.209944 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d53817-ac6a-4741-8779-9ea3d5f49dd3 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:57.219994 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 90/176] 10.222.0.79 () {56 vars in 1111 bytes} [Tue Aug 30 00:58:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:58:57.220994 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d53817-ac6a-4741-8779-9ea3d5f49dd3 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:57.243185 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 87/177] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 00:58:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:58:57.243963 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833ec787-01fe-4a29-830d-c40641847662 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:57.319785 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:57.354374 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833ec787-01fe-4a29-830d-c40641847662 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:57.378767 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d53817-ac6a-4741-8779-9ea3d5f49dd3 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:57.389131 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:57.395776 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbec7ba1-d157-47fb-bc83-541b8143e712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:57.396424 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbec7ba1-d157-47fb-bc83-541b8143e712 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:57.396693 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbec7ba1-d157-47fb-bc83-541b8143e712 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:57.396962 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbec7ba1-d157-47fb-bc83-541b8143e712 None admin] PATH_INFO: `/v3/users/14554d790d74410f850ec973e736e600` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:57.398202 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbec7ba1-d157-47fb-bc83-541b8143e712 None admin] RBAC: Authorizing `identity:get_user(user_id=14554d790d74410f850ec973e736e600)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:57.399985 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbec7ba1-d157-47fb-bc83-541b8143e712 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:57.407375 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 88/178] 10.222.0.79 () {56 vars in 1177 bytes} [Tue Aug 30 00:58:57 2022] GET /identity/v3/users/14554d790d74410f850ec973e736e600 => generated 275 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:58:57.407375 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53f87e3-9c21-4af9-8341-076a676ba7d0 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:57.407375 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53f87e3-9c21-4af9-8341-076a676ba7d0 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:57.407375 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53f87e3-9c21-4af9-8341-076a676ba7d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:57.416537 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ff7979-d04c-46c1-824b-49c72cfe84b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:57.417143 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ff7979-d04c-46c1-824b-49c72cfe84b0 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:57.417415 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ff7979-d04c-46c1-824b-49c72cfe84b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:57.417680 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ff7979-d04c-46c1-824b-49c72cfe84b0 None admin] PATH_INFO: `/v3/roles` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:57.418368 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ff7979-d04c-46c1-824b-49c72cfe84b0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:58:57.418664 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ff7979-d04c-46c1-824b-49c72cfe84b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:57.420494 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ff7979-d04c-46c1-824b-49c72cfe84b0 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:57.424817 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-a53f87e3-9c21-4af9-8341-076a676ba7d0 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:58:57.426004 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-a53f87e3-9c21-4af9-8341-076a676ba7d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:58:57.429187 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 91/179] 10.222.0.79 () {56 vars in 1099 bytes} [Tue Aug 30 00:58:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:58:57.430160 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ff7979-d04c-46c1-824b-49c72cfe84b0 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:57.511141 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 89/180] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 00:58:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:58:57.512017 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53f87e3-9c21-4af9-8341-076a676ba7d0 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:57.535815 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ff7979-d04c-46c1-824b-49c72cfe84b0 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:57.573575 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b02b99-a64a-4e7d-97be-7cc6f028cfc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:57.574599 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b02b99-a64a-4e7d-97be-7cc6f028cfc3 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:57.574879 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b02b99-a64a-4e7d-97be-7cc6f028cfc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:57.575169 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b02b99-a64a-4e7d-97be-7cc6f028cfc3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:57.576953 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b02b99-a64a-4e7d-97be-7cc6f028cfc3 None admin] RBAC: Adding query filter params (role.id=d14c3070c9184d76a7b23df69bd3db07, scope.project.id=4ec1a052ca044bdfa9052279c09cd55c, user.id=54c77b2049f04525ac7b6806a553b84c) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:58:57.577369 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b02b99-a64a-4e7d-97be-7cc6f028cfc3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:57.578930 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b02b99-a64a-4e7d-97be-7cc6f028cfc3 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:57.584967 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:57.586034 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 92/181] 10.222.0.79 () {56 vars in 1374 bytes} [Tue Aug 30 00:58:57 2022] GET /identity/v3/role_assignments?user.id=54c77b2049f04525ac7b6806a553b84c&scope.project.id=4ec1a052ca044bdfa9052279c09cd55c&role.id=d14c3070c9184d76a7b23df69bd3db07 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:58:57.587358 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b88554-707e-47a3-99e0-308d58c96a7b None None] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:57.587621 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b88554-707e-47a3-99e0-308d58c96a7b None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:57.587893 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b88554-707e-47a3-99e0-308d58c96a7b None None] PATH_INFO: `/` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:57.589179 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 93/182] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 00:58:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:58:57.589889 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b88554-707e-47a3-99e0-308d58c96a7b None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:57.631938 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53f87e3-9c21-4af9-8341-076a676ba7d0 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:57.646886 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:57.687345 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46179715-50cf-4f1e-a16c-db5f548b1398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:57.688661 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46179715-50cf-4f1e-a16c-db5f548b1398 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:57.689169 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46179715-50cf-4f1e-a16c-db5f548b1398 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:57.689902 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46179715-50cf-4f1e-a16c-db5f548b1398 None admin] PATH_INFO: `/v3/users/14554d790d74410f850ec973e736e600` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:57.692404 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46179715-50cf-4f1e-a16c-db5f548b1398 None admin] RBAC: Authorizing `identity:get_user(user_id=14554d790d74410f850ec973e736e600)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:57.693942 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46179715-50cf-4f1e-a16c-db5f548b1398 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:57.695731 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 90/183] 10.222.0.79 () {56 vars in 1177 bytes} [Tue Aug 30 00:58:57 2022] GET /identity/v3/users/14554d790d74410f850ec973e736e600 => generated 275 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:58:57.700631 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46179715-50cf-4f1e-a16c-db5f548b1398 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:57.741521 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b88554-707e-47a3-99e0-308d58c96a7b None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:57.784289 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e64c5f-8cf8-4d86-9d07-0460a40a50ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:57.785287 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e64c5f-8cf8-4d86-9d07-0460a40a50ac None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:57.785287 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e64c5f-8cf8-4d86-9d07-0460a40a50ac None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:57.785496 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e64c5f-8cf8-4d86-9d07-0460a40a50ac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:57.824016 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46179715-50cf-4f1e-a16c-db5f548b1398 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:57.861332 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc110b0-45b2-4683-ad70-8b2acd5439f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:57.861976 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc110b0-45b2-4683-ad70-8b2acd5439f1 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:57.862255 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc110b0-45b2-4683-ad70-8b2acd5439f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:57.862528 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc110b0-45b2-4683-ad70-8b2acd5439f1 None admin] PATH_INFO: `/v3/users/3119586a8051437eae97516465a2f958` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:57.869185 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e64c5f-8cf8-4d86-9d07-0460a40a50ac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:57.870486 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:57.870661 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e64c5f-8cf8-4d86-9d07-0460a40a50ac None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:57.877521 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc110b0-45b2-4683-ad70-8b2acd5439f1 None admin] RBAC: Authorizing `identity:get_user(user_id=3119586a8051437eae97516465a2f958)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:57.878958 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc110b0-45b2-4683-ad70-8b2acd5439f1 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:57.880641 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 91/184] 10.222.0.79 () {56 vars in 1177 bytes} [Tue Aug 30 00:58:57 2022] GET /identity/v3/users/3119586a8051437eae97516465a2f958 => generated 283 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:58:57.881490 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc110b0-45b2-4683-ad70-8b2acd5439f1 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:57.907331 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:57.973923 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 94/185] 10.222.0.79 () {58 vars in 1282 bytes} [Tue Aug 30 00:58:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 00:58:57.975195 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fe5cb8-7c4f-4fb1-a4d8-17b0d7b645f8 None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:57.975477 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fe5cb8-7c4f-4fb1-a4d8-17b0d7b645f8 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:57.975745 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fe5cb8-7c4f-4fb1-a4d8-17b0d7b645f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:57.988644 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc110b0-45b2-4683-ad70-8b2acd5439f1 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:57.993435 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-e0fe5cb8-7c4f-4fb1-a4d8-17b0d7b645f8 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:58:57.994620 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-e0fe5cb8-7c4f-4fb1-a4d8-17b0d7b645f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:58:58.023433 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066ab7cc-2c3b-4e8b-a5db-2280d68ee079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:58.024061 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066ab7cc-2c3b-4e8b-a5db-2280d68ee079 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:58.024333 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066ab7cc-2c3b-4e8b-a5db-2280d68ee079 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:58.024597 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066ab7cc-2c3b-4e8b-a5db-2280d68ee079 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:58.034873 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066ab7cc-2c3b-4e8b-a5db-2280d68ee079 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:58:58.039820 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-066ab7cc-2c3b-4e8b-a5db-2280d68ee079 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 00:58:58.039820 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:58:58.039820 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:58:58.039820 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:58:58.039820 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:58:58.039820 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:58:58.039820 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:58:58.039820 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:58:58.039820 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:58:58.039820 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:58:58.039820 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:58:58.039820 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:58:58.039820 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:58:58.039820 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:58:58.039820 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:58:58.039820 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:58:58.040669 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:58:58.040669 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:58:58.040669 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:58:58.040669 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:58:58.040669 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:58:58.040669 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:58:58.040669 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:58:58.040669 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:58:58.040669 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:58:58.040669 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:58:58.040669 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:58:58.040669 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Aug 30 00:58:58.040669 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:58:58.040669 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:58:58.040669 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:58:58.040669 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:58:58.041458 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:58:58.041458 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:58:58.041458 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:58:58.041458 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:58:58.041458 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:58:58.041458 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:58:58.041458 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:58:58.041458 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:58:58.041458 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:58:58.041458 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:58:58.041458 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 00:58:58.041458 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Aug 30 00:58:58.041458 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 92/186] 10.222.0.79 () {56 vars in 1114 bytes} [Tue Aug 30 00:58:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:58:58.044575 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066ab7cc-2c3b-4e8b-a5db-2280d68ee079 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:58.064322 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 95/187] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 00:58:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:58:58.067780 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fe5cb8-7c4f-4fb1-a4d8-17b0d7b645f8 None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:58.104916 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:58.134566 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:58.150973 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066ab7cc-2c3b-4e8b-a5db-2280d68ee079 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:58.175355 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fe5cb8-7c4f-4fb1-a4d8-17b0d7b645f8 None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:58.188992 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f260aa9-c2aa-49a2-8575-3b2e364ea532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:58.189602 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f260aa9-c2aa-49a2-8575-3b2e364ea532 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:58.189872 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f260aa9-c2aa-49a2-8575-3b2e364ea532 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:58.190246 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f260aa9-c2aa-49a2-8575-3b2e364ea532 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:58.214129 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b655e600-c10d-44ba-ab72-501fb41c5a51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:58.214761 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b655e600-c10d-44ba-ab72-501fb41c5a51 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:58.215036 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b655e600-c10d-44ba-ab72-501fb41c5a51 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:58.215332 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b655e600-c10d-44ba-ab72-501fb41c5a51 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:58.216512 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b655e600-c10d-44ba-ab72-501fb41c5a51 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:58.217989 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b655e600-c10d-44ba-ab72-501fb41c5a51 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:58.219807 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 96/188] 10.222.0.79 () {56 vars in 1108 bytes} [Tue Aug 30 00:58:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:58:58.220398 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b655e600-c10d-44ba-ab72-501fb41c5a51 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:58.276872 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f260aa9-c2aa-49a2-8575-3b2e364ea532 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:58.278462 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f260aa9-c2aa-49a2-8575-3b2e364ea532 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:58.331017 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b655e600-c10d-44ba-ab72-501fb41c5a51 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:58.337492 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:58.362546 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:58.367960 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4caf090-73a9-4cbc-8995-be3b83d7b2f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:58.368564 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4caf090-73a9-4cbc-8995-be3b83d7b2f5 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:58.368840 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4caf090-73a9-4cbc-8995-be3b83d7b2f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:58.369099 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4caf090-73a9-4cbc-8995-be3b83d7b2f5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:58.386111 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 93/189] 10.222.0.79 () {58 vars in 1282 bytes} [Tue Aug 30 00:58:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 00:58:58.386952 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f260aa9-c2aa-49a2-8575-3b2e364ea532 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:58.441094 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4caf090-73a9-4cbc-8995-be3b83d7b2f5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:58.442553 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4caf090-73a9-4cbc-8995-be3b83d7b2f5 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:58.488936 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f260aa9-c2aa-49a2-8575-3b2e364ea532 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:58.522556 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dd9150-0743-4c5d-90fd-d22108c2eb72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:58.523209 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dd9150-0743-4c5d-90fd-d22108c2eb72 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:58.523489 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dd9150-0743-4c5d-90fd-d22108c2eb72 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:58.523755 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dd9150-0743-4c5d-90fd-d22108c2eb72 None admin] PATH_INFO: `/v3/projects/40237530d738498cab3271426ae609fa` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:58.524886 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dd9150-0743-4c5d-90fd-d22108c2eb72 None admin] RBAC: Authorizing `identity:get_project(project_id=40237530d738498cab3271426ae609fa)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:58.526362 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dd9150-0743-4c5d-90fd-d22108c2eb72 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:58.528024 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 94/190] 10.222.0.79 () {56 vars in 1186 bytes} [Tue Aug 30 00:58:58 2022] GET /identity/v3/projects/40237530d738498cab3271426ae609fa => generated 312 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:58:58.534188 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dd9150-0743-4c5d-90fd-d22108c2eb72 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:58.550370 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 97/191] 10.222.0.79 () {58 vars in 1282 bytes} [Tue Aug 30 00:58:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 00:58:58.551244 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4caf090-73a9-4cbc-8995-be3b83d7b2f5 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:58.554667 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:58.583612 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:58.631929 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dd9150-0743-4c5d-90fd-d22108c2eb72 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:58.654849 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4caf090-73a9-4cbc-8995-be3b83d7b2f5 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:58.665498 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9fc1ec-4556-40b1-9936-a5e7acc06b76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:58.666102 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9fc1ec-4556-40b1-9936-a5e7acc06b76 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:58.666379 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9fc1ec-4556-40b1-9936-a5e7acc06b76 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:58.666653 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9fc1ec-4556-40b1-9936-a5e7acc06b76 None admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:58.667348 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9fc1ec-4556-40b1-9936-a5e7acc06b76 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:58:58.667719 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9fc1ec-4556-40b1-9936-a5e7acc06b76 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:58.669818 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9fc1ec-4556-40b1-9936-a5e7acc06b76 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:58.677899 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 95/192] 10.222.0.79 () {56 vars in 1111 bytes} [Tue Aug 30 00:58:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:58:58.677899 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9fc1ec-4556-40b1-9936-a5e7acc06b76 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:58.689003 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd9018b-d38b-4a52-873b-75378a3fc254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:58.689614 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd9018b-d38b-4a52-873b-75378a3fc254 None admin] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:58.689898 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd9018b-d38b-4a52-873b-75378a3fc254 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:58.690169 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd9018b-d38b-4a52-873b-75378a3fc254 None admin] PATH_INFO: `/v3/users` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:58.691079 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd9018b-d38b-4a52-873b-75378a3fc254 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:58.692539 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd9018b-d38b-4a52-873b-75378a3fc254 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:58.721106 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 98/193] 10.222.0.79 () {60 vars in 1132 bytes} [Tue Aug 30 00:58:58 2022] POST /identity/v3/users => generated 297 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:58:58.721937 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd9018b-d38b-4a52-873b-75378a3fc254 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:58.776966 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:58.796025 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9fc1ec-4556-40b1-9936-a5e7acc06b76 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:58.822870 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:58.834635 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e270d2b-21da-4589-9bd6-2891a0b3cfab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:58.835324 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e270d2b-21da-4589-9bd6-2891a0b3cfab None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:58.835603 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e270d2b-21da-4589-9bd6-2891a0b3cfab None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:58.835876 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e270d2b-21da-4589-9bd6-2891a0b3cfab None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:58.841908 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd9018b-d38b-4a52-873b-75378a3fc254 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:58.849880 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e270d2b-21da-4589-9bd6-2891a0b3cfab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:58:58.855425 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-0e270d2b-21da-4589-9bd6-2891a0b3cfab None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 00:58:58.855425 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:58:58.855425 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:58:58.855425 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:58:58.855425 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:58:58.855425 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:58:58.855425 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:58:58.855425 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:58:58.855425 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:58:58.855425 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:58:58.855425 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:58:58.855425 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:58:58.855425 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:58:58.855425 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:58:58.855425 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:58:58.855425 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:58:58.856376 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:58:58.856376 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:58:58.856376 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:58:58.856376 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:58:58.856376 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:58:58.856376 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:58:58.856376 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:58:58.856376 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:58:58.856376 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:58:58.856376 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:58:58.856376 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:58:58.856376 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Aug 30 00:58:58.856376 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:58:58.856376 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:58:58.856376 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:58:58.856376 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:58:58.862738 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:58:58.862738 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:58:58.862738 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:58:58.862738 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:58:58.862738 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:58:58.862738 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:58:58.862738 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:58:58.862738 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:58:58.862738 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:58:58.862738 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:58:58.862738 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 00:58:58.862738 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Aug 30 00:58:58.862738 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 96/194] 10.222.0.79 () {56 vars in 1099 bytes} [Tue Aug 30 00:58:58 2022] GET /identity/v3/roles/reader => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:58:58.862738 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e270d2b-21da-4589-9bd6-2891a0b3cfab None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:58.898112 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1480d1-0465-4b0a-8494-ffc8052a8f6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:58.898851 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1480d1-0465-4b0a-8494-ffc8052a8f6e None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:58.899468 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1480d1-0465-4b0a-8494-ffc8052a8f6e None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:58.899752 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1480d1-0465-4b0a-8494-ffc8052a8f6e None admin] PATH_INFO: `/v3/projects/4ec1a052ca044bdfa9052279c09cd55c` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:58.901180 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1480d1-0465-4b0a-8494-ffc8052a8f6e None admin] RBAC: Authorizing `identity:get_project(project_id=4ec1a052ca044bdfa9052279c09cd55c)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:58.903965 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1480d1-0465-4b0a-8494-ffc8052a8f6e None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:58.906945 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 99/195] 10.222.0.79 () {56 vars in 1186 bytes} [Tue Aug 30 00:58:58 2022] GET /identity/v3/projects/4ec1a052ca044bdfa9052279c09cd55c => generated 298 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:58:58.906945 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1480d1-0465-4b0a-8494-ffc8052a8f6e None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:58.988323 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e270d2b-21da-4589-9bd6-2891a0b3cfab None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:59.034416 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b975117-795d-49bf-832b-3d61f2d5ca6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:59.035193 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b975117-795d-49bf-832b-3d61f2d5ca6a None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:59.035585 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b975117-795d-49bf-832b-3d61f2d5ca6a None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:59.035857 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b975117-795d-49bf-832b-3d61f2d5ca6a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:59.036618 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b975117-795d-49bf-832b-3d61f2d5ca6a None admin] RBAC: Adding query filter params (role.id=c37945a17623465f899d4f217e7af593, scope.project.id=40237530d738498cab3271426ae609fa, user.id=14554d790d74410f850ec973e736e600) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:58:59.036923 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b975117-795d-49bf-832b-3d61f2d5ca6a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:59.038517 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b975117-795d-49bf-832b-3d61f2d5ca6a None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:59.045632 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 97/196] 10.222.0.79 () {56 vars in 1374 bytes} [Tue Aug 30 00:58:58 2022] GET /identity/v3/role_assignments?user.id=14554d790d74410f850ec973e736e600&scope.project.id=40237530d738498cab3271426ae609fa&role.id=c37945a17623465f899d4f217e7af593 => generated 608 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:58:59.046471 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b975117-795d-49bf-832b-3d61f2d5ca6a None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:59.046871 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1480d1-0465-4b0a-8494-ffc8052a8f6e None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:59.062363 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:59.092120 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a735fa4-380c-49b4-8406-d996cce7cf7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:59.092828 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a735fa4-380c-49b4-8406-d996cce7cf7b None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:59.093068 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a735fa4-380c-49b4-8406-d996cce7cf7b None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:59.093443 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a735fa4-380c-49b4-8406-d996cce7cf7b None admin] PATH_INFO: `/v3/projects/3350ee60742e414d945ce547675b0abd` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:59.094769 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a735fa4-380c-49b4-8406-d996cce7cf7b None admin] RBAC: Authorizing `identity:get_project(project_id=3350ee60742e414d945ce547675b0abd)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:59.096297 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a735fa4-380c-49b4-8406-d996cce7cf7b None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:59.098588 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 100/197] 10.222.0.79 () {56 vars in 1186 bytes} [Tue Aug 30 00:58:58 2022] GET /identity/v3/projects/3350ee60742e414d945ce547675b0abd => generated 302 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:58:59.099526 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a735fa4-380c-49b4-8406-d996cce7cf7b None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:59.141264 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:59.189331 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b975117-795d-49bf-832b-3d61f2d5ca6a None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:59.242282 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23183cb5-40cc-465d-844a-2115e35e90e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:59.242928 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23183cb5-40cc-465d-844a-2115e35e90e4 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:59.243287 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23183cb5-40cc-465d-844a-2115e35e90e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:59.243887 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23183cb5-40cc-465d-844a-2115e35e90e4 None admin] PATH_INFO: `/v3/users/3119586a8051437eae97516465a2f958` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:59.245660 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23183cb5-40cc-465d-844a-2115e35e90e4 None admin] RBAC: Authorizing `identity:get_user(user_id=3119586a8051437eae97516465a2f958)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:59.247863 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23183cb5-40cc-465d-844a-2115e35e90e4 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:59.250094 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 98/198] 10.222.0.79 () {56 vars in 1177 bytes} [Tue Aug 30 00:58:59 2022] GET /identity/v3/users/3119586a8051437eae97516465a2f958 => generated 283 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:58:59.250911 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23183cb5-40cc-465d-844a-2115e35e90e4 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:59.274379 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a735fa4-380c-49b4-8406-d996cce7cf7b None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:59.318695 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93a7f4f-0321-40d9-8586-fa9357c21168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:59.319358 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93a7f4f-0321-40d9-8586-fa9357c21168 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:59.319643 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93a7f4f-0321-40d9-8586-fa9357c21168 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:59.319910 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93a7f4f-0321-40d9-8586-fa9357c21168 None admin] PATH_INFO: `/v3/roles` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:59.320583 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93a7f4f-0321-40d9-8586-fa9357c21168 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:58:59.320943 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93a7f4f-0321-40d9-8586-fa9357c21168 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:59.322381 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93a7f4f-0321-40d9-8586-fa9357c21168 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:59.333479 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 101/199] 10.222.0.79 () {56 vars in 1101 bytes} [Tue Aug 30 00:58:59 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:58:59.334347 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93a7f4f-0321-40d9-8586-fa9357c21168 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:59.358194 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:59.389639 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23183cb5-40cc-465d-844a-2115e35e90e4 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:59.428528 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f7fc3b-d7b5-42fa-a7ba-a9d0bffb8ef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:59.429411 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f7fc3b-d7b5-42fa-a7ba-a9d0bffb8ef1 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:59.429827 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f7fc3b-d7b5-42fa-a7ba-a9d0bffb8ef1 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:59.430350 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f7fc3b-d7b5-42fa-a7ba-a9d0bffb8ef1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:59.431083 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f7fc3b-d7b5-42fa-a7ba-a9d0bffb8ef1 None admin] RBAC: Adding query filter params (role.id=0e24ae0a2cb9401e8f818402105e9fab, scope.project.id=4ec1a052ca044bdfa9052279c09cd55c, user.id=14554d790d74410f850ec973e736e600) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:58:59.431522 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f7fc3b-d7b5-42fa-a7ba-a9d0bffb8ef1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:59.432965 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f7fc3b-d7b5-42fa-a7ba-a9d0bffb8ef1 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:59.442314 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 99/200] 10.222.0.79 () {56 vars in 1374 bytes} [Tue Aug 30 00:58:59 2022] GET /identity/v3/role_assignments?user.id=14554d790d74410f850ec973e736e600&scope.project.id=4ec1a052ca044bdfa9052279c09cd55c&role.id=0e24ae0a2cb9401e8f818402105e9fab => generated 608 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:58:59.442907 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f7fc3b-d7b5-42fa-a7ba-a9d0bffb8ef1 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:59.466167 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:59.487624 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93a7f4f-0321-40d9-8586-fa9357c21168 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:59.535531 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4d4058-d53c-4156-9fc4-1c8dfa093bc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:59.536995 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4d4058-d53c-4156-9fc4-1c8dfa093bc9 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:59.537549 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4d4058-d53c-4156-9fc4-1c8dfa093bc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:59.538302 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4d4058-d53c-4156-9fc4-1c8dfa093bc9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:59.539324 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4d4058-d53c-4156-9fc4-1c8dfa093bc9 None admin] RBAC: Adding query filter params (role.id=d14c3070c9184d76a7b23df69bd3db07, scope.project.id=3350ee60742e414d945ce547675b0abd, user.id=3119586a8051437eae97516465a2f958) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:58:59.539908 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4d4058-d53c-4156-9fc4-1c8dfa093bc9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:59.541717 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4d4058-d53c-4156-9fc4-1c8dfa093bc9 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:59.550445 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 102/201] 10.222.0.79 () {56 vars in 1374 bytes} [Tue Aug 30 00:58:59 2022] GET /identity/v3/role_assignments?user.id=3119586a8051437eae97516465a2f958&scope.project.id=3350ee60742e414d945ce547675b0abd&role.id=d14c3070c9184d76a7b23df69bd3db07 => generated 259 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:58:59.551736 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4d4058-d53c-4156-9fc4-1c8dfa093bc9 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:59.670134 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f7fc3b-d7b5-42fa-a7ba-a9d0bffb8ef1 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:59.713706 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcedb1c-eb84-485e-8cd5-3e30e9233469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:59.714691 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcedb1c-eb84-485e-8cd5-3e30e9233469 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:59.715191 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcedb1c-eb84-485e-8cd5-3e30e9233469 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:59.715653 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcedb1c-eb84-485e-8cd5-3e30e9233469 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:59.733166 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:59.801056 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcedb1c-eb84-485e-8cd5-3e30e9233469 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:59.802864 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcedb1c-eb84-485e-8cd5-3e30e9233469 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:59.841215 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4d4058-d53c-4156-9fc4-1c8dfa093bc9 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:59.919913 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 100/202] 10.222.0.79 () {58 vars in 1282 bytes} [Tue Aug 30 00:58:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 475 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 00:58:59.927203 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcedb1c-eb84-485e-8cd5-3e30e9233469 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:59.937553 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9d36a6-ecee-4602-af05-98a65b273f03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:59.938215 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9d36a6-ecee-4602-af05-98a65b273f03 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:59.938484 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9d36a6-ecee-4602-af05-98a65b273f03 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:59.938758 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9d36a6-ecee-4602-af05-98a65b273f03 None admin] PATH_INFO: `/v3/users/5d9aab6ca22e434a9c0a93bd60bca46a` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:59.943924 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9d36a6-ecee-4602-af05-98a65b273f03 None admin] RBAC: Authorizing `identity:get_user(user_id=5d9aab6ca22e434a9c0a93bd60bca46a)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:59.945399 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9d36a6-ecee-4602-af05-98a65b273f03 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:59.951150 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 103/203] 10.222.0.79 () {56 vars in 1177 bytes} [Tue Aug 30 00:58:59 2022] GET /identity/v3/users/5d9aab6ca22e434a9c0a93bd60bca46a => generated 289 bytes in 396 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:58:59.964265 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9d36a6-ecee-4602-af05-98a65b273f03 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:00.000023 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:00.024572 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:00.054022 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcedb1c-eb84-485e-8cd5-3e30e9233469 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:00.110794 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964f972b-0f16-4898-8805-59ac431eb368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:00.111798 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964f972b-0f16-4898-8805-59ac431eb368 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:00.113087 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964f972b-0f16-4898-8805-59ac431eb368 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:00.113604 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964f972b-0f16-4898-8805-59ac431eb368 None admin] PATH_INFO: `/v3/projects/3350ee60742e414d945ce547675b0abd` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:00.116328 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964f972b-0f16-4898-8805-59ac431eb368 None admin] RBAC: Authorizing `identity:get_project(project_id=3350ee60742e414d945ce547675b0abd)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:00.118967 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964f972b-0f16-4898-8805-59ac431eb368 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:00.123569 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 101/204] 10.222.0.79 () {56 vars in 1186 bytes} [Tue Aug 30 00:58:59 2022] GET /identity/v3/projects/3350ee60742e414d945ce547675b0abd => generated 302 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:59:00.129834 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964f972b-0f16-4898-8805-59ac431eb368 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:00.193695 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9d36a6-ecee-4602-af05-98a65b273f03 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:00.243814 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1204d2-0ea4-41d5-afc1-46802096531e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:00.244850 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1204d2-0ea4-41d5-afc1-46802096531e None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:00.245661 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1204d2-0ea4-41d5-afc1-46802096531e None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:00.246136 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1204d2-0ea4-41d5-afc1-46802096531e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:00.337413 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964f972b-0f16-4898-8805-59ac431eb368 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:00.350071 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:00.383907 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f31665c-e62a-46b7-aabf-d6df3e1c6921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:00.384519 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f31665c-e62a-46b7-aabf-d6df3e1c6921 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:00.384793 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f31665c-e62a-46b7-aabf-d6df3e1c6921 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:00.385062 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f31665c-e62a-46b7-aabf-d6df3e1c6921 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:00.385793 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f31665c-e62a-46b7-aabf-d6df3e1c6921 None admin] RBAC: Adding query filter params (role.id=0e24ae0a2cb9401e8f818402105e9fab, scope.project.id=3350ee60742e414d945ce547675b0abd, user.id=3119586a8051437eae97516465a2f958) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:59:00.386094 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f31665c-e62a-46b7-aabf-d6df3e1c6921 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:00.387577 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f31665c-e62a-46b7-aabf-d6df3e1c6921 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:00.401377 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 102/205] 10.222.0.79 () {56 vars in 1374 bytes} [Tue Aug 30 00:59:00 2022] GET /identity/v3/role_assignments?user.id=3119586a8051437eae97516465a2f958&scope.project.id=3350ee60742e414d945ce547675b0abd&role.id=0e24ae0a2cb9401e8f818402105e9fab => generated 259 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:59:00.431484 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1204d2-0ea4-41d5-afc1-46802096531e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:00.433074 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1204d2-0ea4-41d5-afc1-46802096531e None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:00.455834 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:00.584820 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 104/206] 10.222.0.79 () {58 vars in 1282 bytes} [Tue Aug 30 00:58:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 625 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 30 00:59:00.590371 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f31665c-e62a-46b7-aabf-d6df3e1c6921 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:00.708063 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f31665c-e62a-46b7-aabf-d6df3e1c6921 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:00.746920 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a95234-c719-43dc-b4dd-d3ad7c25cf14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:00.748359 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a95234-c719-43dc-b4dd-d3ad7c25cf14 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:00.748741 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a95234-c719-43dc-b4dd-d3ad7c25cf14 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:00.749070 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a95234-c719-43dc-b4dd-d3ad7c25cf14 None admin] PATH_INFO: `/v3/projects/4ec1a052ca044bdfa9052279c09cd55c` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:00.750258 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a95234-c719-43dc-b4dd-d3ad7c25cf14 None admin] RBAC: Authorizing `identity:get_project(project_id=4ec1a052ca044bdfa9052279c09cd55c)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:00.751814 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a95234-c719-43dc-b4dd-d3ad7c25cf14 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:00.753447 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 103/207] 10.222.0.79 () {56 vars in 1186 bytes} [Tue Aug 30 00:59:00 2022] GET /identity/v3/projects/4ec1a052ca044bdfa9052279c09cd55c => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:59:00.759337 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1204d2-0ea4-41d5-afc1-46802096531e None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:00.897596 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1204d2-0ea4-41d5-afc1-46802096531e None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:00.922311 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:00.948815 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b15ab0-07f0-4717-8cfd-21f55d5b50a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:00.949477 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b15ab0-07f0-4717-8cfd-21f55d5b50a3 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:00.949701 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b15ab0-07f0-4717-8cfd-21f55d5b50a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:00.949962 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b15ab0-07f0-4717-8cfd-21f55d5b50a3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:00.950767 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b15ab0-07f0-4717-8cfd-21f55d5b50a3 None admin] RBAC: Adding query filter params (role.id=3e9116b044314295b1dabd1b6dbcd141, scope.project.id=4ec1a052ca044bdfa9052279c09cd55c, user.id=5d9aab6ca22e434a9c0a93bd60bca46a) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:59:00.951066 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b15ab0-07f0-4717-8cfd-21f55d5b50a3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:00.952549 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b15ab0-07f0-4717-8cfd-21f55d5b50a3 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:00.962412 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 105/208] 10.222.0.79 () {56 vars in 1374 bytes} [Tue Aug 30 00:59:00 2022] GET /identity/v3/role_assignments?user.id=5d9aab6ca22e434a9c0a93bd60bca46a&scope.project.id=4ec1a052ca044bdfa9052279c09cd55c&role.id=3e9116b044314295b1dabd1b6dbcd141 => generated 608 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:59:01.382064 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ced5b38-09ad-4673-b153-0800ef6fab77 None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:01.382426 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ced5b38-09ad-4673-b153-0800ef6fab77 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:01.382626 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ced5b38-09ad-4673-b153-0800ef6fab77 None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:01.384261 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 104/209] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 00:59:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:59:01.393047 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66b433b-f0aa-486d-99f3-0134ab65d6dc None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:01.393325 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66b433b-f0aa-486d-99f3-0134ab65d6dc None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:01.393602 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66b433b-f0aa-486d-99f3-0134ab65d6dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:01.416233 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-a66b433b-f0aa-486d-99f3-0134ab65d6dc None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:59:01.417433 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-a66b433b-f0aa-486d-99f3-0134ab65d6dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:59:01.524504 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 106/210] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 00:59:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:59:01.575104 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d2a988-40ec-4d03-b9f4-a9c3c481d202 None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:01.575690 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d2a988-40ec-4d03-b9f4-a9c3c481d202 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:01.576060 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d2a988-40ec-4d03-b9f4-a9c3c481d202 None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:01.577578 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 105/211] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 00:59:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:59:01.583722 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ad0e90-391a-46aa-a020-0eac1c359497 None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:01.584008 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ad0e90-391a-46aa-a020-0eac1c359497 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:01.584282 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ad0e90-391a-46aa-a020-0eac1c359497 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:01.603616 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-e9ad0e90-391a-46aa-a020-0eac1c359497 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:59:01.604820 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-e9ad0e90-391a-46aa-a020-0eac1c359497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:59:01.678842 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 107/212] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 00:59:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:59:01.758663 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245ddf5e-b853-492f-863c-518ebdff819a None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:01.759200 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245ddf5e-b853-492f-863c-518ebdff819a None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:01.759279 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245ddf5e-b853-492f-863c-518ebdff819a None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:01.760854 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 106/213] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 00:59:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:59:01.766241 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26ff952-83df-44e3-9706-689c0da22fcf None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:01.766691 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26ff952-83df-44e3-9706-689c0da22fcf None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:01.767107 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26ff952-83df-44e3-9706-689c0da22fcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:01.789882 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-a26ff952-83df-44e3-9706-689c0da22fcf None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:59:01.790986 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-a26ff952-83df-44e3-9706-689c0da22fcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:59:01.805958 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245ddf5e-b853-492f-863c-518ebdff819a None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:01.830397 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:01.861078 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:01.873510 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 108/214] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 00:59:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:59:01.923513 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245ddf5e-b853-492f-863c-518ebdff819a None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:01.957896 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26ff952-83df-44e3-9706-689c0da22fcf None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:01.962465 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57a3768-98d4-474f-a38d-f529459dd5ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:01.962958 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57a3768-98d4-474f-a38d-f529459dd5ef None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:01.963247 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57a3768-98d4-474f-a38d-f529459dd5ef None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:01.963519 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57a3768-98d4-474f-a38d-f529459dd5ef None admin] PATH_INFO: `/v3/roles/member` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:01.975016 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57a3768-98d4-474f-a38d-f529459dd5ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:59:01.980202 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-f57a3768-98d4-474f-a38d-f529459dd5ef None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 00:59:01.980202 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:59:01.980202 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:59:01.980202 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:59:01.980202 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:59:01.980202 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:59:01.980202 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:59:01.980202 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:59:01.980202 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:59:01.980202 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:59:01.980202 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:59:01.980202 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:59:01.980202 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:59:01.980202 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:59:01.980202 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:59:01.980202 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:59:01.981075 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:59:01.981075 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:59:01.981075 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:59:01.981075 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:59:01.981075 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:59:01.981075 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:59:01.981075 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:59:01.981075 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:59:01.981075 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:59:01.981075 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:59:01.981075 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:59:01.981075 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Aug 30 00:59:01.981075 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:59:01.981075 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:59:01.981075 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:59:01.981075 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:59:01.982423 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:59:01.982423 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:59:01.982423 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:59:01.982423 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:59:01.982423 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:59:01.982423 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:59:01.982423 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:59:01.982423 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:59:01.982423 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:59:01.982423 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:59:01.982423 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 00:59:01.982423 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Aug 30 00:59:01.982423 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 107/215] 10.222.0.79 () {56 vars in 1099 bytes} [Tue Aug 30 00:59:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 00:59:01.990505 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57a3768-98d4-474f-a38d-f529459dd5ef None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:02.080075 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26ff952-83df-44e3-9706-689c0da22fcf None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:02.111529 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57a3768-98d4-474f-a38d-f529459dd5ef None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:02.113024 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:02.126958 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce05c2c-81a3-4e9c-9399-0722a4be4f5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:02.128437 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce05c2c-81a3-4e9c-9399-0722a4be4f5f None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:02.129030 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce05c2c-81a3-4e9c-9399-0722a4be4f5f None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:02.129475 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce05c2c-81a3-4e9c-9399-0722a4be4f5f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:02.131215 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce05c2c-81a3-4e9c-9399-0722a4be4f5f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:02.132689 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce05c2c-81a3-4e9c-9399-0722a4be4f5f None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:02.139204 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 109/216] 10.222.0.79 () {56 vars in 1108 bytes} [Tue Aug 30 00:59:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:59:02.141809 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce05c2c-81a3-4e9c-9399-0722a4be4f5f None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:02.163174 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d5420b-1926-4414-bf2f-de2ba99ac282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:02.164140 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d5420b-1926-4414-bf2f-de2ba99ac282 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:02.164613 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d5420b-1926-4414-bf2f-de2ba99ac282 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:02.165079 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d5420b-1926-4414-bf2f-de2ba99ac282 None admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:02.166533 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d5420b-1926-4414-bf2f-de2ba99ac282 None admin] RBAC: Adding query filter params (name=member) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:59:02.167312 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d5420b-1926-4414-bf2f-de2ba99ac282 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:02.170354 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d5420b-1926-4414-bf2f-de2ba99ac282 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:02.182708 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 108/217] 10.222.0.79 () {56 vars in 1101 bytes} [Tue Aug 30 00:59:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:59:02.183430 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d5420b-1926-4414-bf2f-de2ba99ac282 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:02.190277 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:02.262864 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce05c2c-81a3-4e9c-9399-0722a4be4f5f None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:02.290177 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d5420b-1926-4414-bf2f-de2ba99ac282 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:02.303625 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e22d53b-83f3-445c-8768-9836ba861504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:02.304231 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e22d53b-83f3-445c-8768-9836ba861504 None admin] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:02.304504 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e22d53b-83f3-445c-8768-9836ba861504 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:02.304796 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e22d53b-83f3-445c-8768-9836ba861504 None admin] PATH_INFO: `/v3/users` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:02.305413 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e22d53b-83f3-445c-8768-9836ba861504 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:02.306848 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e22d53b-83f3-445c-8768-9836ba861504 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:02.328154 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcfe38b-88dc-467b-b0ec-83d101cfe004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:02.328876 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcfe38b-88dc-467b-b0ec-83d101cfe004 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:02.329180 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcfe38b-88dc-467b-b0ec-83d101cfe004 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:02.329440 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcfe38b-88dc-467b-b0ec-83d101cfe004 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:02.339527 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 110/218] 10.222.0.79 () {60 vars in 1132 bytes} [Tue Aug 30 00:59:02 2022] POST /identity/v3/users => generated 297 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:59:02.339527 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e22d53b-83f3-445c-8768-9836ba861504 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:02.347148 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcfe38b-88dc-467b-b0ec-83d101cfe004 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:59:02.353323 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-9bcfe38b-88dc-467b-b0ec-83d101cfe004 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:59:02.353323 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:59:02.353323 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:59:02.353323 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:59:02.353323 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:59:02.353323 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:59:02.353323 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:59:02.353323 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:59:02.353323 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:59:02.353323 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:59:02.353323 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:59:02.353323 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:59:02.353323 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:59:02.353323 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:59:02.353323 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:59:02.353323 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:59:02.354272 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:59:02.354272 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:59:02.354272 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:59:02.354272 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:59:02.354272 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:59:02.354272 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:59:02.354272 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:59:02.354272 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:59:02.354272 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:59:02.354272 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:59:02.354272 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:59:02.354272 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Aug 30 00:59:02.354272 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:59:02.354272 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:59:02.354272 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:59:02.354272 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:59:02.355174 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:59:02.355174 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:59:02.355174 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:59:02.355174 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:59:02.355174 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:59:02.355174 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:59:02.355174 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:59:02.355174 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:59:02.355174 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:59:02.355174 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:59:02.355174 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:59:02.355174 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Aug 30 00:59:02.355174 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 109/219] 10.222.0.79 () {56 vars in 1096 bytes} [Tue Aug 30 00:59:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:59:02.360477 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcfe38b-88dc-467b-b0ec-83d101cfe004 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:02.409115 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:02.475553 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:02.484018 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e22d53b-83f3-445c-8768-9836ba861504 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:02.531866 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6ea282-50eb-4a2e-a400-877d7bda61de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:02.532071 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcfe38b-88dc-467b-b0ec-83d101cfe004 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:02.532915 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6ea282-50eb-4a2e-a400-877d7bda61de None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:02.533396 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6ea282-50eb-4a2e-a400-877d7bda61de None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:02.533992 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6ea282-50eb-4a2e-a400-877d7bda61de None admin] PATH_INFO: `/v3/users/d717effe6885459c87c824e721bd6cbf` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:02.556465 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6ea282-50eb-4a2e-a400-877d7bda61de None admin] RBAC: Authorizing `identity:get_user(user_id=d717effe6885459c87c824e721bd6cbf)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:02.558586 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6ea282-50eb-4a2e-a400-877d7bda61de None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:02.561068 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 111/220] 10.222.0.79 () {56 vars in 1177 bytes} [Tue Aug 30 00:59:02 2022] GET /identity/v3/users/d717effe6885459c87c824e721bd6cbf => generated 297 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:59:02.567568 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6ea282-50eb-4a2e-a400-877d7bda61de None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:02.580420 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75eff086-ce33-499e-9405-4225cc1d6fd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:02.581037 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eff086-ce33-499e-9405-4225cc1d6fd0 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:02.581315 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eff086-ce33-499e-9405-4225cc1d6fd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:02.581582 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eff086-ce33-499e-9405-4225cc1d6fd0 None admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:02.582247 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75eff086-ce33-499e-9405-4225cc1d6fd0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:59:02.582612 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75eff086-ce33-499e-9405-4225cc1d6fd0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:02.584082 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75eff086-ce33-499e-9405-4225cc1d6fd0 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:02.594427 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 110/221] 10.222.0.79 () {56 vars in 1099 bytes} [Tue Aug 30 00:59:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:59:02.595641 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b86b28-5d9f-4543-84a8-1a0887be2a30 None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:02.595926 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b86b28-5d9f-4543-84a8-1a0887be2a30 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:02.596199 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b86b28-5d9f-4543-84a8-1a0887be2a30 None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:02.597474 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 111/222] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 00:59:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:59:02.603058 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b86b28-5d9f-4543-84a8-1a0887be2a30 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:02.697063 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6ea282-50eb-4a2e-a400-877d7bda61de None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:02.719566 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:02.735268 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b86b28-5d9f-4543-84a8-1a0887be2a30 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:02.739116 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51457c31-19ea-4dd4-ad41-3765c3030906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:02.740073 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51457c31-19ea-4dd4-ad41-3765c3030906 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:02.740357 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51457c31-19ea-4dd4-ad41-3765c3030906 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:02.740628 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51457c31-19ea-4dd4-ad41-3765c3030906 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:02.775457 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7ad9e9-b924-400a-b88b-39ef1e350de4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:02.776535 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:02.778523 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7ad9e9-b924-400a-b88b-39ef1e350de4 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:02.779008 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7ad9e9-b924-400a-b88b-39ef1e350de4 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:02.779492 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7ad9e9-b924-400a-b88b-39ef1e350de4 None admin] PATH_INFO: `/v3/users/3119586a8051437eae97516465a2f958` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:02.781966 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7ad9e9-b924-400a-b88b-39ef1e350de4 None admin] RBAC: Authorizing `identity:get_user(user_id=3119586a8051437eae97516465a2f958)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:02.785045 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7ad9e9-b924-400a-b88b-39ef1e350de4 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:02.787892 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 112/223] 10.222.0.79 () {56 vars in 1177 bytes} [Tue Aug 30 00:59:02 2022] GET /identity/v3/users/3119586a8051437eae97516465a2f958 => generated 283 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:59:02.794703 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed66662-b86a-4fca-93ea-d8fbf75229dd None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:02.794703 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed66662-b86a-4fca-93ea-d8fbf75229dd None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:02.794703 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed66662-b86a-4fca-93ea-d8fbf75229dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:02.818730 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-8ed66662-b86a-4fca-93ea-d8fbf75229dd None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:59:02.819902 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-8ed66662-b86a-4fca-93ea-d8fbf75229dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:59:02.845230 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51457c31-19ea-4dd4-ad41-3765c3030906 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:02.847882 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51457c31-19ea-4dd4-ad41-3765c3030906 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:02.894425 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 113/224] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 00:59:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:59:02.896116 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed66662-b86a-4fca-93ea-d8fbf75229dd None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:02.982248 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 112/225] 10.222.0.79 () {58 vars in 1282 bytes} [Tue Aug 30 00:59:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 00:59:02.989291 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51457c31-19ea-4dd4-ad41-3765c3030906 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:02.990384 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:03.010612 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed66662-b86a-4fca-93ea-d8fbf75229dd None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:03.067241 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:03.076748 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb81cc8a-b3b7-4421-b623-2d3677f60970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:03.077589 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb81cc8a-b3b7-4421-b623-2d3677f60970 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:03.077976 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb81cc8a-b3b7-4421-b623-2d3677f60970 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:03.078351 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb81cc8a-b3b7-4421-b623-2d3677f60970 None admin] PATH_INFO: `/v3/projects/3350ee60742e414d945ce547675b0abd` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:03.079715 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb81cc8a-b3b7-4421-b623-2d3677f60970 None admin] RBAC: Authorizing `identity:get_project(project_id=3350ee60742e414d945ce547675b0abd)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:03.081267 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb81cc8a-b3b7-4421-b623-2d3677f60970 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:03.083032 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 114/226] 10.222.0.79 () {56 vars in 1186 bytes} [Tue Aug 30 00:59:02 2022] GET /identity/v3/projects/3350ee60742e414d945ce547675b0abd => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:59:03.092184 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb81cc8a-b3b7-4421-b623-2d3677f60970 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:03.126988 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51457c31-19ea-4dd4-ad41-3765c3030906 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:03.172823 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d37a9c-7fde-45b5-9ffe-d4667a729ca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:03.176313 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d37a9c-7fde-45b5-9ffe-d4667a729ca6 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:03.176813 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d37a9c-7fde-45b5-9ffe-d4667a729ca6 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:03.177223 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d37a9c-7fde-45b5-9ffe-d4667a729ca6 None admin] PATH_INFO: `/v3/projects/3350ee60742e414d945ce547675b0abd` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:03.179339 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d37a9c-7fde-45b5-9ffe-d4667a729ca6 None admin] RBAC: Authorizing `identity:get_project(project_id=3350ee60742e414d945ce547675b0abd)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:03.180930 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d37a9c-7fde-45b5-9ffe-d4667a729ca6 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:03.187828 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 113/227] 10.222.0.79 () {56 vars in 1186 bytes} [Tue Aug 30 00:59:02 2022] GET /identity/v3/projects/3350ee60742e414d945ce547675b0abd => generated 302 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:59:03.205128 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d37a9c-7fde-45b5-9ffe-d4667a729ca6 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:03.287980 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb81cc8a-b3b7-4421-b623-2d3677f60970 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:03.325043 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc976fc-e616-4a86-8bb6-9e58a37c376b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:03.325993 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc976fc-e616-4a86-8bb6-9e58a37c376b None admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:03.326437 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc976fc-e616-4a86-8bb6-9e58a37c376b None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:03.326846 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc976fc-e616-4a86-8bb6-9e58a37c376b None admin] PATH_INFO: `/v3/projects/3350ee60742e414d945ce547675b0abd/users/3119586a8051437eae97516465a2f958/roles/d14c3070c9184d76a7b23df69bd3db07` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:03.329197 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc976fc-e616-4a86-8bb6-9e58a37c376b None admin] RBAC: Authorizing `identity:create_grant(project_id=3350ee60742e414d945ce547675b0abd, user_id=3119586a8051437eae97516465a2f958, role_id=d14c3070c9184d76a7b23df69bd3db07)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:03.330774 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc976fc-e616-4a86-8bb6-9e58a37c376b None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:03.346003 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d37a9c-7fde-45b5-9ffe-d4667a729ca6 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:03.352916 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 115/228] 10.222.0.79 () {58 vars in 1439 bytes} [Tue Aug 30 00:59:03 2022] PUT /identity/v3/projects/3350ee60742e414d945ce547675b0abd/users/3119586a8051437eae97516465a2f958/roles/d14c3070c9184d76a7b23df69bd3db07 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:59:03.352916 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc976fc-e616-4a86-8bb6-9e58a37c376b None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:03.385666 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:03.403032 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:03.422863 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab85bb10-9b59-4c3b-9a80-be8106286db3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:03.423616 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab85bb10-9b59-4c3b-9a80-be8106286db3 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:03.423886 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab85bb10-9b59-4c3b-9a80-be8106286db3 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:03.424201 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab85bb10-9b59-4c3b-9a80-be8106286db3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:03.424986 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab85bb10-9b59-4c3b-9a80-be8106286db3 None admin] RBAC: Adding query filter params (role.id=c37945a17623465f899d4f217e7af593, scope.project.id=3350ee60742e414d945ce547675b0abd, user.id=d717effe6885459c87c824e721bd6cbf) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:59:03.425286 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab85bb10-9b59-4c3b-9a80-be8106286db3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:03.427080 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab85bb10-9b59-4c3b-9a80-be8106286db3 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:03.443166 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 114/229] 10.222.0.79 () {56 vars in 1374 bytes} [Tue Aug 30 00:59:03 2022] GET /identity/v3/role_assignments?user.id=d717effe6885459c87c824e721bd6cbf&scope.project.id=3350ee60742e414d945ce547675b0abd&role.id=c37945a17623465f899d4f217e7af593 => generated 259 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:59:03.540719 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc976fc-e616-4a86-8bb6-9e58a37c376b None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:03.593941 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f079001-e250-4f94-9014-3fb558e38797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:03.594687 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f079001-e250-4f94-9014-3fb558e38797 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:03.594963 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f079001-e250-4f94-9014-3fb558e38797 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:03.595253 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f079001-e250-4f94-9014-3fb558e38797 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:03.609127 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f079001-e250-4f94-9014-3fb558e38797 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:59:03.614689 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-1f079001-e250-4f94-9014-3fb558e38797 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 00:59:03.614689 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:59:03.614689 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:59:03.614689 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:59:03.614689 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:59:03.614689 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:59:03.614689 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:59:03.614689 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:59:03.614689 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:59:03.614689 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:59:03.614689 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:59:03.614689 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:59:03.614689 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:59:03.614689 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:59:03.614689 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:59:03.614689 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:59:03.615657 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:59:03.615657 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:59:03.615657 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:59:03.615657 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:59:03.615657 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:59:03.615657 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:59:03.615657 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:59:03.615657 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:59:03.615657 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:59:03.615657 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:59:03.615657 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:59:03.615657 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Aug 30 00:59:03.615657 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:59:03.615657 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:59:03.615657 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:59:03.615657 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:59:03.617131 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:59:03.617131 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:59:03.617131 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:59:03.617131 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:59:03.617131 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:59:03.617131 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:59:03.617131 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:59:03.617131 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:59:03.617131 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:59:03.617131 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:59:03.617131 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 00:59:03.617131 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Aug 30 00:59:03.617131 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 116/230] 10.222.0.79 () {56 vars in 1114 bytes} [Tue Aug 30 00:59:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:59:03.621906 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab85bb10-9b59-4c3b-9a80-be8106286db3 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:03.735817 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab85bb10-9b59-4c3b-9a80-be8106286db3 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:03.774577 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b21d241-a122-4616-9277-45fe50e7199d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:03.775231 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b21d241-a122-4616-9277-45fe50e7199d None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:03.775509 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b21d241-a122-4616-9277-45fe50e7199d None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:03.775774 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b21d241-a122-4616-9277-45fe50e7199d None admin] PATH_INFO: `/v3/roles` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:03.776435 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b21d241-a122-4616-9277-45fe50e7199d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:59:03.776728 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b21d241-a122-4616-9277-45fe50e7199d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:03.778093 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b21d241-a122-4616-9277-45fe50e7199d None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:03.787645 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 115/231] 10.222.0.79 () {56 vars in 1111 bytes} [Tue Aug 30 00:59:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:59:03.793130 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f079001-e250-4f94-9014-3fb558e38797 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:03.892121 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:03.929602 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f079001-e250-4f94-9014-3fb558e38797 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:03.971348 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0afc34-703e-481c-afea-a9c6be558c13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:03.971986 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0afc34-703e-481c-afea-a9c6be558c13 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:03.972260 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0afc34-703e-481c-afea-a9c6be558c13 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:03.972527 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0afc34-703e-481c-afea-a9c6be558c13 None admin] PATH_INFO: `/v3/users/3119586a8051437eae97516465a2f958` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:03.973666 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0afc34-703e-481c-afea-a9c6be558c13 None admin] RBAC: Authorizing `identity:get_user(user_id=3119586a8051437eae97516465a2f958)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:03.975106 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0afc34-703e-481c-afea-a9c6be558c13 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:03.977068 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 117/232] 10.222.0.79 () {56 vars in 1177 bytes} [Tue Aug 30 00:59:03 2022] GET /identity/v3/users/3119586a8051437eae97516465a2f958 => generated 283 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:59:03.982912 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b21d241-a122-4616-9277-45fe50e7199d None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:04.054995 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:04.127917 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b21d241-a122-4616-9277-45fe50e7199d None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:04.184841 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbf669d-c849-4f87-9268-afc644bc7ab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:04.185488 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbf669d-c849-4f87-9268-afc644bc7ab8 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:04.185767 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbf669d-c849-4f87-9268-afc644bc7ab8 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:04.186033 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbf669d-c849-4f87-9268-afc644bc7ab8 None admin] PATH_INFO: `/v3/projects/3350ee60742e414d945ce547675b0abd` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:04.187226 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbf669d-c849-4f87-9268-afc644bc7ab8 None admin] RBAC: Authorizing `identity:get_project(project_id=3350ee60742e414d945ce547675b0abd)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:04.188676 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbf669d-c849-4f87-9268-afc644bc7ab8 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:04.190833 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 116/233] 10.222.0.79 () {56 vars in 1186 bytes} [Tue Aug 30 00:59:03 2022] GET /identity/v3/projects/3350ee60742e414d945ce547675b0abd => generated 302 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:59:04.196464 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0afc34-703e-481c-afea-a9c6be558c13 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:04.339903 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0afc34-703e-481c-afea-a9c6be558c13 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:04.379351 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0a6d52-a150-4c1e-aa9e-8b2389610cca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:04.380075 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0a6d52-a150-4c1e-aa9e-8b2389610cca None admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:04.380363 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0a6d52-a150-4c1e-aa9e-8b2389610cca None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:04.380635 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0a6d52-a150-4c1e-aa9e-8b2389610cca None admin] PATH_INFO: `/v3/projects/3350ee60742e414d945ce547675b0abd/users/3119586a8051437eae97516465a2f958/roles/0e24ae0a2cb9401e8f818402105e9fab` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:04.382813 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0a6d52-a150-4c1e-aa9e-8b2389610cca None admin] RBAC: Authorizing `identity:create_grant(project_id=3350ee60742e414d945ce547675b0abd, user_id=3119586a8051437eae97516465a2f958, role_id=0e24ae0a2cb9401e8f818402105e9fab)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:04.386482 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0a6d52-a150-4c1e-aa9e-8b2389610cca None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:04.399785 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:04.404668 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 118/234] 10.222.0.79 () {58 vars in 1439 bytes} [Tue Aug 30 00:59:04 2022] PUT /identity/v3/projects/3350ee60742e414d945ce547675b0abd/users/3119586a8051437eae97516465a2f958/roles/0e24ae0a2cb9401e8f818402105e9fab => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:59:04.573488 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b9e413-9191-465f-8bb0-9a6874a306c1 None None] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:04.573851 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b9e413-9191-465f-8bb0-9a6874a306c1 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:04.574045 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b9e413-9191-465f-8bb0-9a6874a306c1 None None] PATH_INFO: `/` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:04.575930 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 117/235] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 00:59:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:59:04.581792 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5c7426-80e4-4dca-b339-dbf779953648 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:04.582072 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5c7426-80e4-4dca-b339-dbf779953648 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:04.582339 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5c7426-80e4-4dca-b339-dbf779953648 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:04.607524 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-9b5c7426-80e4-4dca-b339-dbf779953648 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:59:04.608926 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-9b5c7426-80e4-4dca-b339-dbf779953648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:59:04.710877 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 119/236] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 00:59:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:59:04.811664 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9c9ba5-ead0-43a5-8780-bdf699610cfc None None] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:04.811983 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9c9ba5-ead0-43a5-8780-bdf699610cfc None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:04.812216 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9c9ba5-ead0-43a5-8780-bdf699610cfc None None] PATH_INFO: `/` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:04.813845 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 118/237] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 00:59:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:59:04.820795 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2a97d5-34c3-4514-979b-5412a00008d4 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:04.821699 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2a97d5-34c3-4514-979b-5412a00008d4 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:04.822171 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2a97d5-34c3-4514-979b-5412a00008d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:04.844788 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-fa2a97d5-34c3-4514-979b-5412a00008d4 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:59:04.846301 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-fa2a97d5-34c3-4514-979b-5412a00008d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:59:04.933411 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 120/238] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 00:59:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:59:05.019535 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9c9ba5-ead0-43a5-8780-bdf699610cfc None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:05.160792 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9c9ba5-ead0-43a5-8780-bdf699610cfc None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:05.178036 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:05.198232 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e0d42a-4a6c-4dc1-8773-deaf6070a889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:05.198781 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e0d42a-4a6c-4dc1-8773-deaf6070a889 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:05.199052 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e0d42a-4a6c-4dc1-8773-deaf6070a889 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:05.199343 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e0d42a-4a6c-4dc1-8773-deaf6070a889 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:05.200556 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e0d42a-4a6c-4dc1-8773-deaf6070a889 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:05.202073 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e0d42a-4a6c-4dc1-8773-deaf6070a889 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:05.204022 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 119/239] 10.222.0.79 () {56 vars in 1108 bytes} [Tue Aug 30 00:59:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:59:05.212190 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2a97d5-34c3-4514-979b-5412a00008d4 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:05.291729 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e0d42a-4a6c-4dc1-8773-deaf6070a889 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:05.316601 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:05.365158 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2a97d5-34c3-4514-979b-5412a00008d4 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:05.404312 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0712cb-60a2-4454-b1ec-600a1c66165a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:05.405065 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0712cb-60a2-4454-b1ec-600a1c66165a None admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:05.405334 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0712cb-60a2-4454-b1ec-600a1c66165a None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:05.405664 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0712cb-60a2-4454-b1ec-600a1c66165a None admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:05.406736 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0712cb-60a2-4454-b1ec-600a1c66165a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:05.408661 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0712cb-60a2-4454-b1ec-600a1c66165a None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:05.441659 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 121/240] 10.222.0.79 () {60 vars in 1132 bytes} [Tue Aug 30 00:59:05 2022] POST /identity/v3/users => generated 293 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:59:05.470454 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e0d42a-4a6c-4dc1-8773-deaf6070a889 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:05.516891 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd198e95-e561-4d19-a6f2-376612f1df74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:05.517557 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd198e95-e561-4d19-a6f2-376612f1df74 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:05.517834 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd198e95-e561-4d19-a6f2-376612f1df74 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:05.518105 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd198e95-e561-4d19-a6f2-376612f1df74 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:05.535727 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd198e95-e561-4d19-a6f2-376612f1df74 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:59:05.541336 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application [None req-fd198e95-e561-4d19-a6f2-376612f1df74 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 00:59:05.541336 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:59:05.541336 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:59:05.541336 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:59:05.541336 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:59:05.541336 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:59:05.541336 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:59:05.541336 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:59:05.541336 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:59:05.541336 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:59:05.541336 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:59:05.541336 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:59:05.541336 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:59:05.541336 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:59:05.541336 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:59:05.541336 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:59:05.542279 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:59:05.542279 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:59:05.542279 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:59:05.542279 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:59:05.542279 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:59:05.542279 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:59:05.542279 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:59:05.542279 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:59:05.542279 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:59:05.542279 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:59:05.542279 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:59:05.542279 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application with Lock( Aug 30 00:59:05.542279 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:59:05.542279 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:59:05.542279 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:59:05.542279 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:59:05.543513 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:59:05.543513 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:59:05.543513 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:59:05.543513 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:59:05.543513 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:59:05.543513 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:59:05.543513 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:59:05.543513 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:59:05.543513 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:59:05.543513 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:59:05.543513 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 00:59:05.543513 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Aug 30 00:59:05.543513 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 120/241] 10.222.0.79 () {56 vars in 1099 bytes} [Tue Aug 30 00:59:05 2022] GET /identity/v3/roles/reader => generated 84 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:59:05.551011 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0712cb-60a2-4454-b1ec-600a1c66165a None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:05.676063 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0712cb-60a2-4454-b1ec-600a1c66165a None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:05.693428 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:05.713075 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba20be9d-9631-4b59-86d2-a37bcb55839f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:05.713736 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba20be9d-9631-4b59-86d2-a37bcb55839f None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:05.714013 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba20be9d-9631-4b59-86d2-a37bcb55839f None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:05.714279 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba20be9d-9631-4b59-86d2-a37bcb55839f None admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:05.714991 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba20be9d-9631-4b59-86d2-a37bcb55839f None admin] RBAC: Adding query filter params (name=reader) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:59:05.715319 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba20be9d-9631-4b59-86d2-a37bcb55839f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:05.716796 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba20be9d-9631-4b59-86d2-a37bcb55839f None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:05.725923 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 122/242] 10.222.0.79 () {56 vars in 1101 bytes} [Tue Aug 30 00:59:05 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:59:05.731972 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd198e95-e561-4d19-a6f2-376612f1df74 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:05.789232 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:05.857627 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd198e95-e561-4d19-a6f2-376612f1df74 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:05.900850 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0bafe7-7ca0-486e-bfaa-15b931463132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:05.901502 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0bafe7-7ca0-486e-bfaa-15b931463132 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:05.901778 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0bafe7-7ca0-486e-bfaa-15b931463132 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:05.902047 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0bafe7-7ca0-486e-bfaa-15b931463132 None admin] PATH_INFO: `/v3/users/10b54bce06a94edfa794d969dc4bcf6f` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:05.919260 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0bafe7-7ca0-486e-bfaa-15b931463132 None admin] RBAC: Authorizing `identity:get_user(user_id=10b54bce06a94edfa794d969dc4bcf6f)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:05.920886 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0bafe7-7ca0-486e-bfaa-15b931463132 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:05.922632 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 121/243] 10.222.0.79 () {56 vars in 1177 bytes} [Tue Aug 30 00:59:05 2022] GET /identity/v3/users/10b54bce06a94edfa794d969dc4bcf6f => generated 297 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:59:05.932330 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba20be9d-9631-4b59-86d2-a37bcb55839f None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:06.050167 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3652a2f-ca7e-4cbb-b663-0574328beb12 None None] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:06.051215 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3652a2f-ca7e-4cbb-b663-0574328beb12 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:06.051689 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3652a2f-ca7e-4cbb-b663-0574328beb12 None None] PATH_INFO: `/` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:06.053490 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 122/244] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 00:59:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:59:06.059051 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db98eebb-a01d-40c8-abe1-923c59afade2 None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:06.059350 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db98eebb-a01d-40c8-abe1-923c59afade2 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:06.060189 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db98eebb-a01d-40c8-abe1-923c59afade2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:06.066210 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba20be9d-9631-4b59-86d2-a37bcb55839f None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:06.086482 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-db98eebb-a01d-40c8-abe1-923c59afade2 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:59:06.087734 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-db98eebb-a01d-40c8-abe1-923c59afade2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:59:06.110557 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8060dbcd-b2dc-4182-9f35-2322046c0cfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:06.111276 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8060dbcd-b2dc-4182-9f35-2322046c0cfa None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:06.111559 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8060dbcd-b2dc-4182-9f35-2322046c0cfa None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:06.111828 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8060dbcd-b2dc-4182-9f35-2322046c0cfa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:06.168452 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:06.176078 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 123/245] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 00:59:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 00:59:06.193805 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8060dbcd-b2dc-4182-9f35-2322046c0cfa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:06.195337 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8060dbcd-b2dc-4182-9f35-2322046c0cfa None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:06.226020 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4ecd90-aba8-4a21-bf5a-b5165f03b411 None None] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:06.226653 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4ecd90-aba8-4a21-bf5a-b5165f03b411 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:06.226923 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4ecd90-aba8-4a21-bf5a-b5165f03b411 None None] PATH_INFO: `/` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:06.242610 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 124/246] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 00:59:06 2022] GET /identity => generated 270 bytes in 17 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:59:06.245928 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc8a03c-d229-4bc6-a894-039c4e93ec0a None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:06.246209 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc8a03c-d229-4bc6-a894-039c4e93ec0a None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:06.246463 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc8a03c-d229-4bc6-a894-039c4e93ec0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:06.276355 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-2fc8a03c-d229-4bc6-a894-039c4e93ec0a None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:59:06.277574 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-2fc8a03c-d229-4bc6-a894-039c4e93ec0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:59:06.309605 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 123/247] 10.222.0.79 () {58 vars in 1282 bytes} [Tue Aug 30 00:59:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 00:59:06.315160 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:06.316723 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8060dbcd-b2dc-4182-9f35-2322046c0cfa None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:06.359225 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 125/248] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 00:59:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:59:06.426050 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:06.454585 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8060dbcd-b2dc-4182-9f35-2322046c0cfa None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:06.494546 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23f0455-999d-452d-a1b9-7f5f32529394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:06.495204 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23f0455-999d-452d-a1b9-7f5f32529394 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:06.495485 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23f0455-999d-452d-a1b9-7f5f32529394 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:06.495753 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23f0455-999d-452d-a1b9-7f5f32529394 None admin] PATH_INFO: `/v3/projects/3350ee60742e414d945ce547675b0abd` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:06.496900 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23f0455-999d-452d-a1b9-7f5f32529394 None admin] RBAC: Authorizing `identity:get_project(project_id=3350ee60742e414d945ce547675b0abd)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:06.498668 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23f0455-999d-452d-a1b9-7f5f32529394 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:06.500715 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 124/249] 10.222.0.79 () {56 vars in 1186 bytes} [Tue Aug 30 00:59:06 2022] GET /identity/v3/projects/3350ee60742e414d945ce547675b0abd => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:59:06.507243 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc8a03c-d229-4bc6-a894-039c4e93ec0a None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:06.644678 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23f0455-999d-452d-a1b9-7f5f32529394 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:06.649589 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc8a03c-d229-4bc6-a894-039c4e93ec0a None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:06.686080 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc57aa98-d613-46ce-945e-10310ef3b4b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:06.686792 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc57aa98-d613-46ce-945e-10310ef3b4b8 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:06.687069 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc57aa98-d613-46ce-945e-10310ef3b4b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:06.687357 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc57aa98-d613-46ce-945e-10310ef3b4b8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:06.688088 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc57aa98-d613-46ce-945e-10310ef3b4b8 None admin] RBAC: Adding query filter params (role.id=3e9116b044314295b1dabd1b6dbcd141, scope.project.id=3350ee60742e414d945ce547675b0abd, user.id=10b54bce06a94edfa794d969dc4bcf6f) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:59:06.688386 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc57aa98-d613-46ce-945e-10310ef3b4b8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:06.689930 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc57aa98-d613-46ce-945e-10310ef3b4b8 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:06.696247 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 126/250] 10.222.0.79 () {56 vars in 1374 bytes} [Tue Aug 30 00:59:06 2022] GET /identity/v3/role_assignments?user.id=10b54bce06a94edfa794d969dc4bcf6f&scope.project.id=3350ee60742e414d945ce547675b0abd&role.id=3e9116b044314295b1dabd1b6dbcd141 => generated 259 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:59:06.774706 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc57aa98-d613-46ce-945e-10310ef3b4b8 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:06.811951 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:06.865384 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23f0455-999d-452d-a1b9-7f5f32529394 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:06.900792 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc57aa98-d613-46ce-945e-10310ef3b4b8 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:06.942751 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d92f27-5746-46cc-8739-19665f5cf2d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:06.943431 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d92f27-5746-46cc-8739-19665f5cf2d3 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:06.943709 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d92f27-5746-46cc-8739-19665f5cf2d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:06.943977 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d92f27-5746-46cc-8739-19665f5cf2d3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:06.957886 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d92f27-5746-46cc-8739-19665f5cf2d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:59:06.964040 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application [None req-33d92f27-5746-46cc-8739-19665f5cf2d3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:59:06.964040 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:59:06.964040 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:59:06.964040 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:59:06.964040 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:59:06.964040 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:59:06.964040 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:59:06.964040 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:59:06.964040 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:59:06.964040 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:59:06.964040 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:59:06.964040 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:59:06.964040 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:59:06.964040 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:59:06.964040 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:59:06.964040 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:59:06.966967 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:59:06.966967 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:59:06.966967 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:59:06.966967 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:59:06.966967 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:59:06.966967 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:59:06.966967 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:59:06.966967 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:59:06.966967 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:59:06.966967 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:59:06.966967 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:59:06.966967 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application with Lock( Aug 30 00:59:06.966967 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:59:06.966967 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:59:06.966967 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:59:06.966967 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:59:06.968955 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:59:06.968955 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:59:06.968955 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:59:06.968955 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:59:06.968955 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:59:06.968955 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:59:06.968955 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:59:06.968955 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:59:06.968955 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:59:06.968955 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:59:06.968955 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:59:06.968955 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Aug 30 00:59:06.968955 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 127/251] 10.222.0.79 () {56 vars in 1096 bytes} [Tue Aug 30 00:59:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 00:59:06.976519 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d92f27-5746-46cc-8739-19665f5cf2d3 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:06.987882 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac32c15b-1a17-4c8f-9399-aee1bb87bcfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:06.988542 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac32c15b-1a17-4c8f-9399-aee1bb87bcfd None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:06.988822 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac32c15b-1a17-4c8f-9399-aee1bb87bcfd None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:06.989095 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac32c15b-1a17-4c8f-9399-aee1bb87bcfd None admin] PATH_INFO: `/v3/roles/member` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:07.015903 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac32c15b-1a17-4c8f-9399-aee1bb87bcfd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:59:07.027702 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-ac32c15b-1a17-4c8f-9399-aee1bb87bcfd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 00:59:07.027702 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:59:07.027702 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:59:07.027702 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:59:07.027702 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:59:07.027702 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:59:07.027702 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:59:07.027702 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:59:07.027702 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:59:07.027702 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:59:07.027702 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:59:07.027702 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:59:07.027702 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:59:07.027702 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:59:07.027702 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:59:07.027702 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:59:07.030571 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:59:07.030571 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:59:07.030571 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:59:07.030571 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:59:07.030571 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:59:07.030571 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:59:07.030571 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:59:07.030571 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:59:07.030571 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:59:07.030571 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:59:07.030571 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:59:07.030571 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Aug 30 00:59:07.030571 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:59:07.030571 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:59:07.030571 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:59:07.030571 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:59:07.032627 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:59:07.032627 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:59:07.032627 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:59:07.032627 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:59:07.032627 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:59:07.032627 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:59:07.032627 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:59:07.032627 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:59:07.032627 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:59:07.032627 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:59:07.032627 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 00:59:07.032627 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Aug 30 00:59:07.032627 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 125/252] 10.222.0.79 () {56 vars in 1099 bytes} [Tue Aug 30 00:59:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 385 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 00:59:07.036808 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac32c15b-1a17-4c8f-9399-aee1bb87bcfd None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:07.048263 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:07.164332 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:07.195950 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d92f27-5746-46cc-8739-19665f5cf2d3 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:07.249994 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac32c15b-1a17-4c8f-9399-aee1bb87bcfd None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:07.281104 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf2ed16-ce57-4360-b927-a526d0e203bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:07.282958 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf2ed16-ce57-4360-b927-a526d0e203bb None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:07.285948 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf2ed16-ce57-4360-b927-a526d0e203bb None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:07.286444 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf2ed16-ce57-4360-b927-a526d0e203bb None admin] PATH_INFO: `/v3/roles` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:07.287429 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf2ed16-ce57-4360-b927-a526d0e203bb None admin] RBAC: Adding query filter params (name=admin) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:59:07.287941 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf2ed16-ce57-4360-b927-a526d0e203bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:07.289506 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf2ed16-ce57-4360-b927-a526d0e203bb None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:07.299494 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 128/253] 10.222.0.79 () {56 vars in 1099 bytes} [Tue Aug 30 00:59:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:59:07.305252 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c8a868-04bd-4f13-8713-3634fc0fac5f None None] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:07.305937 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c8a868-04bd-4f13-8713-3634fc0fac5f None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:07.306431 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c8a868-04bd-4f13-8713-3634fc0fac5f None None] PATH_INFO: `/` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:07.308321 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 129/254] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 00:59:07 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:59:07.309325 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c8a868-04bd-4f13-8713-3634fc0fac5f None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:07.328781 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3406ef-bd2f-42eb-8c7f-190a36a569cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:07.329408 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3406ef-bd2f-42eb-8c7f-190a36a569cd None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:07.329688 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3406ef-bd2f-42eb-8c7f-190a36a569cd None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:07.329960 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3406ef-bd2f-42eb-8c7f-190a36a569cd None admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:07.330677 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3406ef-bd2f-42eb-8c7f-190a36a569cd None admin] RBAC: Adding query filter params (name=member) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:59:07.330930 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3406ef-bd2f-42eb-8c7f-190a36a569cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:07.332325 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3406ef-bd2f-42eb-8c7f-190a36a569cd None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:07.351635 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 126/255] 10.222.0.79 () {56 vars in 1101 bytes} [Tue Aug 30 00:59:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:59:07.353052 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d77f08-8fdf-4bb9-a498-9ceb6e76df26 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:07.353341 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d77f08-8fdf-4bb9-a498-9ceb6e76df26 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:07.353615 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d77f08-8fdf-4bb9-a498-9ceb6e76df26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:07.396367 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-a0d77f08-8fdf-4bb9-a498-9ceb6e76df26 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:59:07.397744 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-a0d77f08-8fdf-4bb9-a498-9ceb6e76df26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:59:07.423501 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c8a868-04bd-4f13-8713-3634fc0fac5f None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:07.460171 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b9d4a1-4e6d-4e9c-93fa-63a5cca17d8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:07.461167 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b9d4a1-4e6d-4e9c-93fa-63a5cca17d8c None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:07.461634 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b9d4a1-4e6d-4e9c-93fa-63a5cca17d8c None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:07.462110 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b9d4a1-4e6d-4e9c-93fa-63a5cca17d8c None admin] PATH_INFO: `/v3/users/3119586a8051437eae97516465a2f958` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:07.463594 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b9d4a1-4e6d-4e9c-93fa-63a5cca17d8c None admin] RBAC: Authorizing `identity:get_user(user_id=3119586a8051437eae97516465a2f958)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:07.465434 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b9d4a1-4e6d-4e9c-93fa-63a5cca17d8c None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:07.468146 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 130/256] 10.222.0.79 () {56 vars in 1177 bytes} [Tue Aug 30 00:59:07 2022] GET /identity/v3/users/3119586a8051437eae97516465a2f958 => generated 283 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:59:07.469223 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b9d4a1-4e6d-4e9c-93fa-63a5cca17d8c None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:07.494107 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:07.535685 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:07.544730 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 127/257] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 00:59:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:59:07.545669 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d77f08-8fdf-4bb9-a498-9ceb6e76df26 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:07.588572 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b9d4a1-4e6d-4e9c-93fa-63a5cca17d8c None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:07.627150 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c413bb-9edd-4b63-89f1-c2041526fcb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:07.628197 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c413bb-9edd-4b63-89f1-c2041526fcb3 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:07.628669 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c413bb-9edd-4b63-89f1-c2041526fcb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:07.629170 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c413bb-9edd-4b63-89f1-c2041526fcb3 None admin] PATH_INFO: `/v3/users/d717effe6885459c87c824e721bd6cbf` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:07.630653 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c413bb-9edd-4b63-89f1-c2041526fcb3 None admin] RBAC: Authorizing `identity:get_user(user_id=d717effe6885459c87c824e721bd6cbf)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:07.632380 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c413bb-9edd-4b63-89f1-c2041526fcb3 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:07.634340 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 131/258] 10.222.0.79 () {56 vars in 1177 bytes} [Tue Aug 30 00:59:07 2022] GET /identity/v3/users/d717effe6885459c87c824e721bd6cbf => generated 297 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:59:07.641338 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c413bb-9edd-4b63-89f1-c2041526fcb3 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:07.730502 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d77f08-8fdf-4bb9-a498-9ceb6e76df26 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:07.740642 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:07.758606 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c413bb-9edd-4b63-89f1-c2041526fcb3 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:07.794475 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4971019a-9f09-48c7-9c34-933e6b609f97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:07.795501 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4971019a-9f09-48c7-9c34-933e6b609f97 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:07.795973 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4971019a-9f09-48c7-9c34-933e6b609f97 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:07.796448 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4971019a-9f09-48c7-9c34-933e6b609f97 None admin] PATH_INFO: `/v3/projects/3350ee60742e414d945ce547675b0abd` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:07.798050 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4971019a-9f09-48c7-9c34-933e6b609f97 None admin] RBAC: Authorizing `identity:get_project(project_id=3350ee60742e414d945ce547675b0abd)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:07.799744 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4971019a-9f09-48c7-9c34-933e6b609f97 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:07.801853 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 132/259] 10.222.0.79 () {56 vars in 1186 bytes} [Tue Aug 30 00:59:07 2022] GET /identity/v3/projects/3350ee60742e414d945ce547675b0abd => generated 302 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:59:07.804506 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e95923e-65f5-40a3-8db1-6e98355c0211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:07.805339 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e95923e-65f5-40a3-8db1-6e98355c0211 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:07.805805 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e95923e-65f5-40a3-8db1-6e98355c0211 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:07.806288 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e95923e-65f5-40a3-8db1-6e98355c0211 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:07.807249 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4971019a-9f09-48c7-9c34-933e6b609f97 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:07.941035 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4971019a-9f09-48c7-9c34-933e6b609f97 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:07.944344 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:07.956147 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e95923e-65f5-40a3-8db1-6e98355c0211 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:07.957631 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e95923e-65f5-40a3-8db1-6e98355c0211 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:07.978152 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da3b893-94ee-4ec0-b0cd-0f228e5f9385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:07.979142 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da3b893-94ee-4ec0-b0cd-0f228e5f9385 None admin] REQUEST_METHOD: `PUT` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:07.979665 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da3b893-94ee-4ec0-b0cd-0f228e5f9385 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:07.980124 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da3b893-94ee-4ec0-b0cd-0f228e5f9385 None admin] PATH_INFO: `/v3/projects/3350ee60742e414d945ce547675b0abd/users/d717effe6885459c87c824e721bd6cbf/roles/c37945a17623465f899d4f217e7af593` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:07.983366 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da3b893-94ee-4ec0-b0cd-0f228e5f9385 None admin] RBAC: Authorizing `identity:create_grant(project_id=3350ee60742e414d945ce547675b0abd, user_id=d717effe6885459c87c824e721bd6cbf, role_id=c37945a17623465f899d4f217e7af593)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:07.985007 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da3b893-94ee-4ec0-b0cd-0f228e5f9385 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:08.011720 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 133/260] 10.222.0.79 () {58 vars in 1439 bytes} [Tue Aug 30 00:59:07 2022] PUT /identity/v3/projects/3350ee60742e414d945ce547675b0abd/users/d717effe6885459c87c824e721bd6cbf/roles/c37945a17623465f899d4f217e7af593 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:59:08.015939 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da3b893-94ee-4ec0-b0cd-0f228e5f9385 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:08.051967 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:08.170436 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 128/261] 10.222.0.79 () {58 vars in 1282 bytes} [Tue Aug 30 00:59:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 625 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 00:59:08.177496 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e95923e-65f5-40a3-8db1-6e98355c0211 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:08.245671 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da3b893-94ee-4ec0-b0cd-0f228e5f9385 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:08.288071 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1fd9c3-2968-487f-9595-aec15931769a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:08.288891 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1fd9c3-2968-487f-9595-aec15931769a None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:08.289233 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1fd9c3-2968-487f-9595-aec15931769a None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:08.289520 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1fd9c3-2968-487f-9595-aec15931769a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:08.302473 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1fd9c3-2968-487f-9595-aec15931769a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:59:08.308283 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application [None req-ff1fd9c3-2968-487f-9595-aec15931769a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 00:59:08.308283 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:59:08.308283 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:59:08.308283 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:59:08.308283 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:59:08.308283 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:59:08.308283 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:59:08.308283 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:59:08.308283 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:59:08.308283 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:59:08.308283 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:59:08.308283 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:59:08.308283 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:59:08.308283 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:59:08.308283 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:59:08.308283 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:59:08.309160 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:59:08.309160 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:59:08.309160 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:59:08.309160 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:59:08.309160 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:59:08.309160 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:59:08.309160 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:59:08.309160 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:59:08.309160 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:59:08.309160 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:59:08.309160 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:59:08.309160 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application with Lock( Aug 30 00:59:08.309160 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:59:08.309160 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:59:08.309160 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:59:08.309160 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:59:08.310480 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:59:08.310480 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:59:08.310480 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:59:08.310480 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:59:08.310480 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:59:08.310480 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:59:08.310480 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:59:08.310480 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:59:08.310480 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:59:08.310480 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:59:08.310480 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 00:59:08.310480 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Aug 30 00:59:08.310480 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 134/262] 10.222.0.79 () {56 vars in 1114 bytes} [Tue Aug 30 00:59:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:59:08.322586 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1fd9c3-2968-487f-9595-aec15931769a None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:08.384942 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e95923e-65f5-40a3-8db1-6e98355c0211 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:08.395521 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:08.475697 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0fe982-84f7-412d-8e72-e213f38e55f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:08.477068 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0fe982-84f7-412d-8e72-e213f38e55f5 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:08.477703 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0fe982-84f7-412d-8e72-e213f38e55f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:08.478386 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0fe982-84f7-412d-8e72-e213f38e55f5 None admin] PATH_INFO: `/v3/projects/3350ee60742e414d945ce547675b0abd` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:08.481615 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0fe982-84f7-412d-8e72-e213f38e55f5 None admin] RBAC: Authorizing `identity:get_project(project_id=3350ee60742e414d945ce547675b0abd)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:08.489212 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0fe982-84f7-412d-8e72-e213f38e55f5 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:08.491488 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:08.493697 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 129/263] 10.222.0.79 () {56 vars in 1186 bytes} [Tue Aug 30 00:59:08 2022] GET /identity/v3/projects/3350ee60742e414d945ce547675b0abd => generated 302 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:59:08.502030 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0fe982-84f7-412d-8e72-e213f38e55f5 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:08.552274 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1fd9c3-2968-487f-9595-aec15931769a None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:08.640772 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912c014a-6a43-4b60-b3a0-bd4de78d89aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:08.641400 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912c014a-6a43-4b60-b3a0-bd4de78d89aa None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:08.641680 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912c014a-6a43-4b60-b3a0-bd4de78d89aa None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:08.641950 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912c014a-6a43-4b60-b3a0-bd4de78d89aa None admin] PATH_INFO: `/v3/roles` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:08.642632 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912c014a-6a43-4b60-b3a0-bd4de78d89aa None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:59:08.642933 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912c014a-6a43-4b60-b3a0-bd4de78d89aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:08.644650 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912c014a-6a43-4b60-b3a0-bd4de78d89aa None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:08.665399 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 135/264] 10.222.0.79 () {56 vars in 1111 bytes} [Tue Aug 30 00:59:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:59:08.673097 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912c014a-6a43-4b60-b3a0-bd4de78d89aa None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:08.709723 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0fe982-84f7-412d-8e72-e213f38e55f5 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:08.768018 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e976f2c7-b247-430b-bc06-7a68dcebd1ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:08.768558 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e976f2c7-b247-430b-bc06-7a68dcebd1ba None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:08.768838 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e976f2c7-b247-430b-bc06-7a68dcebd1ba None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:08.769651 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e976f2c7-b247-430b-bc06-7a68dcebd1ba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:08.770402 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e976f2c7-b247-430b-bc06-7a68dcebd1ba None admin] RBAC: Adding query filter params (role.id=d14c3070c9184d76a7b23df69bd3db07, scope.project.id=3350ee60742e414d945ce547675b0abd, user.id=3119586a8051437eae97516465a2f958) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:59:08.770761 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e976f2c7-b247-430b-bc06-7a68dcebd1ba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:08.772293 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e976f2c7-b247-430b-bc06-7a68dcebd1ba None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:08.787619 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 130/265] 10.222.0.79 () {56 vars in 1374 bytes} [Tue Aug 30 00:59:08 2022] GET /identity/v3/role_assignments?user.id=3119586a8051437eae97516465a2f958&scope.project.id=3350ee60742e414d945ce547675b0abd&role.id=d14c3070c9184d76a7b23df69bd3db07 => generated 608 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:59:08.860770 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5c9a94-f20e-4942-b749-adc087d9312c None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:08.861131 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5c9a94-f20e-4942-b749-adc087d9312c None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:08.861323 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5c9a94-f20e-4942-b749-adc087d9312c None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:08.862667 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 131/266] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 00:59:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:59:08.868438 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7124fd5f-607f-49f1-9254-6d7f7b4b14e4 None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:08.868710 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7124fd5f-607f-49f1-9254-6d7f7b4b14e4 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:08.868983 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7124fd5f-607f-49f1-9254-6d7f7b4b14e4 None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:08.870395 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 132/267] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 00:59:08 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:59:08.877131 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912c014a-6a43-4b60-b3a0-bd4de78d89aa None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:08.877343 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c9b58e-7717-4f88-8247-94a851315631 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:08.877422 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c9b58e-7717-4f88-8247-94a851315631 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:08.877669 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c9b58e-7717-4f88-8247-94a851315631 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:08.915684 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-24c9b58e-7717-4f88-8247-94a851315631 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:59:08.916924 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-24c9b58e-7717-4f88-8247-94a851315631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:59:08.926886 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559e3529-3abb-4ced-8a8e-f6830bbb924f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:08.927564 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559e3529-3abb-4ced-8a8e-f6830bbb924f None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:08.927851 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559e3529-3abb-4ced-8a8e-f6830bbb924f None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:08.928152 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559e3529-3abb-4ced-8a8e-f6830bbb924f None admin] PATH_INFO: `/v3/users/3119586a8051437eae97516465a2f958` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:08.931977 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559e3529-3abb-4ced-8a8e-f6830bbb924f None admin] RBAC: Authorizing `identity:get_user(user_id=3119586a8051437eae97516465a2f958)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:08.933696 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559e3529-3abb-4ced-8a8e-f6830bbb924f None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:08.935919 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 136/268] 10.222.0.79 () {56 vars in 1177 bytes} [Tue Aug 30 00:59:08 2022] GET /identity/v3/users/3119586a8051437eae97516465a2f958 => generated 283 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:59:08.937215 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aea89cc-e57a-4d7e-84e5-eac99f5e8ab6 None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:08.937495 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aea89cc-e57a-4d7e-84e5-eac99f5e8ab6 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:08.937767 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aea89cc-e57a-4d7e-84e5-eac99f5e8ab6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:08.950064 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:08.956372 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:08.978720 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-4aea89cc-e57a-4d7e-84e5-eac99f5e8ab6 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:59:08.979973 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-4aea89cc-e57a-4d7e-84e5-eac99f5e8ab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:59:09.047054 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 133/269] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 00:59:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:59:09.048313 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c9b58e-7717-4f88-8247-94a851315631 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:09.074307 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 137/270] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 00:59:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:59:09.162125 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c9b58e-7717-4f88-8247-94a851315631 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:09.200532 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524745f0-aeab-40bc-a96b-c1c447a037c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:09.201870 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524745f0-aeab-40bc-a96b-c1c447a037c7 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:09.202407 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524745f0-aeab-40bc-a96b-c1c447a037c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:09.202858 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524745f0-aeab-40bc-a96b-c1c447a037c7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:09.233662 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:09.280527 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524745f0-aeab-40bc-a96b-c1c447a037c7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:09.282258 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524745f0-aeab-40bc-a96b-c1c447a037c7 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:09.392458 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 134/271] 10.222.0.79 () {58 vars in 1282 bytes} [Tue Aug 30 00:59:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 00:59:09.398444 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aea89cc-e57a-4d7e-84e5-eac99f5e8ab6 None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:09.414183 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524745f0-aeab-40bc-a96b-c1c447a037c7 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:09.520195 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:09.573063 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aea89cc-e57a-4d7e-84e5-eac99f5e8ab6 None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:09.576914 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524745f0-aeab-40bc-a96b-c1c447a037c7 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:09.610306 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:09.616392 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b719cf-e151-42bc-94f2-f5e0f057c950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:09.616576 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad591902-e75c-406c-9070-28e77a2caacb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:09.617017 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad591902-e75c-406c-9070-28e77a2caacb None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:09.617154 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b719cf-e151-42bc-94f2-f5e0f057c950 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:09.617287 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad591902-e75c-406c-9070-28e77a2caacb None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:09.617400 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b719cf-e151-42bc-94f2-f5e0f057c950 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:09.617640 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad591902-e75c-406c-9070-28e77a2caacb None admin] PATH_INFO: `/v3/roles/member` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:09.617764 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b719cf-e151-42bc-94f2-f5e0f057c950 None admin] PATH_INFO: `/v3/projects/3350ee60742e414d945ce547675b0abd` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:09.618662 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b719cf-e151-42bc-94f2-f5e0f057c950 None admin] RBAC: Authorizing `identity:get_project(project_id=3350ee60742e414d945ce547675b0abd)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:09.620924 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b719cf-e151-42bc-94f2-f5e0f057c950 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:09.623402 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 138/272] 10.222.0.79 () {56 vars in 1186 bytes} [Tue Aug 30 00:59:09 2022] GET /identity/v3/projects/3350ee60742e414d945ce547675b0abd => generated 302 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:59:09.624204 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b719cf-e151-42bc-94f2-f5e0f057c950 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:09.635834 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad591902-e75c-406c-9070-28e77a2caacb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:59:09.641049 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-ad591902-e75c-406c-9070-28e77a2caacb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 00:59:09.641049 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:59:09.641049 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:59:09.641049 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:59:09.641049 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:59:09.641049 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:59:09.641049 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:59:09.641049 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:59:09.641049 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:59:09.641049 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:59:09.641049 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:59:09.641049 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:59:09.641049 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:59:09.641049 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:59:09.641049 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:59:09.641049 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:59:09.642396 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:59:09.642396 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:59:09.642396 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:59:09.642396 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:59:09.642396 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:59:09.642396 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:59:09.642396 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:59:09.642396 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:59:09.642396 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:59:09.642396 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:59:09.642396 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:59:09.642396 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Aug 30 00:59:09.642396 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:59:09.642396 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:59:09.642396 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:59:09.642396 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:59:09.643268 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:59:09.643268 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:59:09.643268 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:59:09.643268 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:59:09.643268 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:59:09.643268 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:59:09.643268 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:59:09.643268 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:59:09.643268 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:59:09.643268 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:59:09.643268 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 00:59:09.643268 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Aug 30 00:59:09.643268 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 135/273] 10.222.0.79 () {56 vars in 1099 bytes} [Tue Aug 30 00:59:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:59:09.643933 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad591902-e75c-406c-9070-28e77a2caacb None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:09.751018 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad591902-e75c-406c-9070-28e77a2caacb None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:09.764202 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b719cf-e151-42bc-94f2-f5e0f057c950 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:09.777325 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:09.794675 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dd91a2-a85b-4d56-bd0c-e7554e1d7a64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:09.795397 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dd91a2-a85b-4d56-bd0c-e7554e1d7a64 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:09.795610 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dd91a2-a85b-4d56-bd0c-e7554e1d7a64 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:09.796014 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dd91a2-a85b-4d56-bd0c-e7554e1d7a64 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:09.796753 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dd91a2-a85b-4d56-bd0c-e7554e1d7a64 None admin] RBAC: Adding query filter params (role.id=0e24ae0a2cb9401e8f818402105e9fab, scope.project.id=3350ee60742e414d945ce547675b0abd, user.id=3119586a8051437eae97516465a2f958) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:59:09.797331 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dd91a2-a85b-4d56-bd0c-e7554e1d7a64 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:09.798502 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dd91a2-a85b-4d56-bd0c-e7554e1d7a64 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:09.810712 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 136/274] 10.222.0.79 () {56 vars in 1374 bytes} [Tue Aug 30 00:59:09 2022] GET /identity/v3/role_assignments?user.id=3119586a8051437eae97516465a2f958&scope.project.id=3350ee60742e414d945ce547675b0abd&role.id=0e24ae0a2cb9401e8f818402105e9fab => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:59:09.810712 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dd91a2-a85b-4d56-bd0c-e7554e1d7a64 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:09.816549 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd06e8e-e033-4c8a-93e0-9dc51aa68f65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:09.817198 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd06e8e-e033-4c8a-93e0-9dc51aa68f65 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:09.817473 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd06e8e-e033-4c8a-93e0-9dc51aa68f65 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:09.817742 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd06e8e-e033-4c8a-93e0-9dc51aa68f65 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:09.819051 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd06e8e-e033-4c8a-93e0-9dc51aa68f65 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:09.820806 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd06e8e-e033-4c8a-93e0-9dc51aa68f65 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:09.822808 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 139/275] 10.222.0.79 () {56 vars in 1108 bytes} [Tue Aug 30 00:59:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:59:09.828379 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece9d30e-6571-4ed9-b49f-eef0712312c8 None None] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:09.828686 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece9d30e-6571-4ed9-b49f-eef0712312c8 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:09.829061 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece9d30e-6571-4ed9-b49f-eef0712312c8 None None] PATH_INFO: `/` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:09.834617 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 140/276] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 00:59:09 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:59:09.834617 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece9d30e-6571-4ed9-b49f-eef0712312c8 None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:09.936168 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dd91a2-a85b-4d56-bd0c-e7554e1d7a64 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:09.943048 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:09.985628 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1b9118-f877-428a-8cef-a393fa7d0de6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:09.986253 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1b9118-f877-428a-8cef-a393fa7d0de6 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:09.987166 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1b9118-f877-428a-8cef-a393fa7d0de6 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:09.987166 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1b9118-f877-428a-8cef-a393fa7d0de6 None admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:09.987507 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1b9118-f877-428a-8cef-a393fa7d0de6 None admin] RBAC: Adding query filter params (name=member) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:59:09.987813 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1b9118-f877-428a-8cef-a393fa7d0de6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:09.989209 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1b9118-f877-428a-8cef-a393fa7d0de6 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:09.990795 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece9d30e-6571-4ed9-b49f-eef0712312c8 None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:09.999398 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 137/277] 10.222.0.79 () {56 vars in 1101 bytes} [Tue Aug 30 00:59:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:59:10.000606 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bb1300-b070-4a47-a0c3-46e0c449a30a None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:10.000896 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bb1300-b070-4a47-a0c3-46e0c449a30a None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:10.002328 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bb1300-b070-4a47-a0c3-46e0c449a30a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:10.023005 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-63bb1300-b070-4a47-a0c3-46e0c449a30a None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:59:10.024251 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-63bb1300-b070-4a47-a0c3-46e0c449a30a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:59:10.031453 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f968b04-24f5-4642-ab03-7c9733a8e691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:10.032070 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f968b04-24f5-4642-ab03-7c9733a8e691 None admin] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:10.032350 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f968b04-24f5-4642-ab03-7c9733a8e691 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:10.032618 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f968b04-24f5-4642-ab03-7c9733a8e691 None admin] PATH_INFO: `/v3/users` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:10.033277 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f968b04-24f5-4642-ab03-7c9733a8e691 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:10.034877 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f968b04-24f5-4642-ab03-7c9733a8e691 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:10.062824 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 141/278] 10.222.0.79 () {60 vars in 1132 bytes} [Tue Aug 30 00:59:09 2022] POST /identity/v3/users => generated 293 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:59:10.063758 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f968b04-24f5-4642-ab03-7c9733a8e691 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:10.084704 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:10.116376 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 138/279] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 00:59:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:59:10.191387 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f968b04-24f5-4642-ab03-7c9733a8e691 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:10.218833 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:10.244142 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad1243a-f977-46e4-b7d8-279fb504d4f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:10.245196 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad1243a-f977-46e4-b7d8-279fb504d4f7 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:10.245739 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad1243a-f977-46e4-b7d8-279fb504d4f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:10.246219 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad1243a-f977-46e4-b7d8-279fb504d4f7 None admin] PATH_INFO: `/v3/users/eea8571f07804f1cae718e29e1f84b54` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:10.267575 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad1243a-f977-46e4-b7d8-279fb504d4f7 None admin] RBAC: Authorizing `identity:get_user(user_id=eea8571f07804f1cae718e29e1f84b54)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:10.269379 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad1243a-f977-46e4-b7d8-279fb504d4f7 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:10.271348 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 142/280] 10.222.0.79 () {56 vars in 1177 bytes} [Tue Aug 30 00:59:10 2022] GET /identity/v3/users/eea8571f07804f1cae718e29e1f84b54 => generated 293 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:59:10.277353 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bb1300-b070-4a47-a0c3-46e0c449a30a None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:10.362466 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6710400a-0640-44f1-965d-7a350accc704 None None] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:10.362763 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6710400a-0640-44f1-965d-7a350accc704 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:10.364027 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6710400a-0640-44f1-965d-7a350accc704 None None] PATH_INFO: `/` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:10.365664 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 143/281] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 00:59:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:59:10.372923 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17541303-b154-4a54-aea4-03603e47b3f0 None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:10.373205 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17541303-b154-4a54-aea4-03603e47b3f0 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:10.373504 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17541303-b154-4a54-aea4-03603e47b3f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:10.395929 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-17541303-b154-4a54-aea4-03603e47b3f0 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:59:10.397438 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-17541303-b154-4a54-aea4-03603e47b3f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:59:10.410114 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bb1300-b070-4a47-a0c3-46e0c449a30a None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:10.461427 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829605f2-c084-44f9-8dfe-36f6c63bbb29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:10.461997 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829605f2-c084-44f9-8dfe-36f6c63bbb29 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:10.462268 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829605f2-c084-44f9-8dfe-36f6c63bbb29 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:10.462534 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829605f2-c084-44f9-8dfe-36f6c63bbb29 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:10.463308 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829605f2-c084-44f9-8dfe-36f6c63bbb29 None admin] RBAC: Adding query filter params (role.id=c37945a17623465f899d4f217e7af593, user.id=eea8571f07804f1cae718e29e1f84b54, scope.system=all) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:59:10.463616 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829605f2-c084-44f9-8dfe-36f6c63bbb29 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:10.465066 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829605f2-c084-44f9-8dfe-36f6c63bbb29 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:10.475421 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 139/282] 10.222.0.79 () {56 vars in 1308 bytes} [Tue Aug 30 00:59:10 2022] GET /identity/v3/role_assignments?user.id=eea8571f07804f1cae718e29e1f84b54&scope.system=all&role.id=c37945a17623465f899d4f217e7af593 => generated 226 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:59:10.476748 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829605f2-c084-44f9-8dfe-36f6c63bbb29 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:10.485784 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 144/283] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 00:59:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:59:10.533243 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:10.604642 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829605f2-c084-44f9-8dfe-36f6c63bbb29 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:10.648447 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daa8a7b-c0c8-4e1f-a6f9-1a339111a2e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:10.649352 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daa8a7b-c0c8-4e1f-a6f9-1a339111a2e5 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:10.649772 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daa8a7b-c0c8-4e1f-a6f9-1a339111a2e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:10.650180 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daa8a7b-c0c8-4e1f-a6f9-1a339111a2e5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:10.662231 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8daa8a7b-c0c8-4e1f-a6f9-1a339111a2e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:59:10.672339 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-8daa8a7b-c0c8-4e1f-a6f9-1a339111a2e5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 00:59:10.672339 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:59:10.672339 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:59:10.672339 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:59:10.672339 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:59:10.672339 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:59:10.672339 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:59:10.672339 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:59:10.672339 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:59:10.672339 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:59:10.672339 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:59:10.672339 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:59:10.672339 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:59:10.672339 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:59:10.672339 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:59:10.672339 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:59:10.673442 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:59:10.673442 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:59:10.673442 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:59:10.673442 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:59:10.673442 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:59:10.673442 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:59:10.673442 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:59:10.673442 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:59:10.673442 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:59:10.673442 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:59:10.673442 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:59:10.673442 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Aug 30 00:59:10.673442 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:59:10.673442 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:59:10.673442 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:59:10.673442 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:59:10.674427 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:59:10.674427 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:59:10.674427 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:59:10.674427 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:59:10.674427 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:59:10.674427 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:59:10.674427 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:59:10.674427 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:59:10.674427 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:59:10.674427 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:59:10.674427 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 00:59:10.674427 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Aug 30 00:59:10.676676 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 140/284] 10.222.0.79 () {56 vars in 1099 bytes} [Tue Aug 30 00:59:10 2022] GET /identity/v3/roles/reader => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:59:10.682621 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17541303-b154-4a54-aea4-03603e47b3f0 None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:10.789592 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17541303-b154-4a54-aea4-03603e47b3f0 None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:10.807493 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:10.827556 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639392ff-357f-4bef-a9c9-818ff39f8531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:10.828178 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639392ff-357f-4bef-a9c9-818ff39f8531 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:10.828451 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639392ff-357f-4bef-a9c9-818ff39f8531 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:10.828720 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639392ff-357f-4bef-a9c9-818ff39f8531 None admin] PATH_INFO: `/v3/roles` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:10.829394 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639392ff-357f-4bef-a9c9-818ff39f8531 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:59:10.829696 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639392ff-357f-4bef-a9c9-818ff39f8531 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:10.831155 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639392ff-357f-4bef-a9c9-818ff39f8531 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:10.836544 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daa8a7b-c0c8-4e1f-a6f9-1a339111a2e5 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:10.842775 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 145/285] 10.222.0.79 () {56 vars in 1101 bytes} [Tue Aug 30 00:59:10 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:59:10.849186 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639392ff-357f-4bef-a9c9-818ff39f8531 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:10.956859 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639392ff-357f-4bef-a9c9-818ff39f8531 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:10.993535 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a3ed09-a938-4c10-90c8-5ec2a7b933af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:10.994174 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a3ed09-a938-4c10-90c8-5ec2a7b933af None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:10.994450 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a3ed09-a938-4c10-90c8-5ec2a7b933af None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:10.994722 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a3ed09-a938-4c10-90c8-5ec2a7b933af None admin] PATH_INFO: `/v3/users/10b54bce06a94edfa794d969dc4bcf6f` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:10.995915 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a3ed09-a938-4c10-90c8-5ec2a7b933af None admin] RBAC: Authorizing `identity:get_user(user_id=10b54bce06a94edfa794d969dc4bcf6f)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:10.997895 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a3ed09-a938-4c10-90c8-5ec2a7b933af None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:11.000590 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 146/286] 10.222.0.79 () {56 vars in 1177 bytes} [Tue Aug 30 00:59:10 2022] GET /identity/v3/users/10b54bce06a94edfa794d969dc4bcf6f => generated 297 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:59:11.005714 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a3ed09-a938-4c10-90c8-5ec2a7b933af None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:11.025564 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:11.034091 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daa8a7b-c0c8-4e1f-a6f9-1a339111a2e5 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:11.055634 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:11.098252 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6838952a-2e03-42aa-9311-1610c4b2c2a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:11.099055 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6838952a-2e03-42aa-9311-1610c4b2c2a1 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:11.099455 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6838952a-2e03-42aa-9311-1610c4b2c2a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:11.099827 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6838952a-2e03-42aa-9311-1610c4b2c2a1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:11.117422 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a3ed09-a938-4c10-90c8-5ec2a7b933af None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:11.117956 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6838952a-2e03-42aa-9311-1610c4b2c2a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:59:11.131620 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-6838952a-2e03-42aa-9311-1610c4b2c2a1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 00:59:11.131620 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:59:11.131620 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:59:11.131620 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:59:11.131620 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:59:11.131620 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:59:11.131620 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:59:11.131620 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:59:11.131620 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:59:11.131620 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:59:11.131620 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:59:11.131620 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:59:11.131620 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:59:11.131620 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:59:11.131620 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:59:11.131620 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:59:11.132612 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:59:11.132612 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:59:11.132612 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:59:11.132612 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:59:11.132612 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:59:11.132612 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:59:11.132612 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:59:11.132612 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:59:11.132612 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:59:11.132612 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:59:11.132612 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:59:11.132612 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Aug 30 00:59:11.132612 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:59:11.132612 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:59:11.132612 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:59:11.132612 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:59:11.133387 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:59:11.133387 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:59:11.133387 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:59:11.133387 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:59:11.133387 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:59:11.133387 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:59:11.133387 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:59:11.133387 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:59:11.133387 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:59:11.133387 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:59:11.133387 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 00:59:11.133387 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Aug 30 00:59:11.133387 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 141/287] 10.222.0.79 () {56 vars in 1099 bytes} [Tue Aug 30 00:59:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 00:59:11.139115 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6838952a-2e03-42aa-9311-1610c4b2c2a1 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:11.170465 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa52976c-2d4c-4d50-b084-81eb477c6d00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:11.171649 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa52976c-2d4c-4d50-b084-81eb477c6d00 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:11.172125 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa52976c-2d4c-4d50-b084-81eb477c6d00 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:11.172591 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa52976c-2d4c-4d50-b084-81eb477c6d00 None admin] PATH_INFO: `/v3/projects/3350ee60742e414d945ce547675b0abd` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:11.177894 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa52976c-2d4c-4d50-b084-81eb477c6d00 None admin] RBAC: Authorizing `identity:get_project(project_id=3350ee60742e414d945ce547675b0abd)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:11.179616 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa52976c-2d4c-4d50-b084-81eb477c6d00 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:11.181543 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 147/288] 10.222.0.79 () {56 vars in 1186 bytes} [Tue Aug 30 00:59:11 2022] GET /identity/v3/projects/3350ee60742e414d945ce547675b0abd => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:59:11.188813 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa52976c-2d4c-4d50-b084-81eb477c6d00 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:11.269171 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6838952a-2e03-42aa-9311-1610c4b2c2a1 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:11.317391 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f89a1d-3a4d-4f6c-ba94-fad4fa395d57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:11.317977 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f89a1d-3a4d-4f6c-ba94-fad4fa395d57 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:11.318200 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f89a1d-3a4d-4f6c-ba94-fad4fa395d57 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:11.323150 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f89a1d-3a4d-4f6c-ba94-fad4fa395d57 None admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:11.323150 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f89a1d-3a4d-4f6c-ba94-fad4fa395d57 None admin] RBAC: Adding query filter params (name=member) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:59:11.323150 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f89a1d-3a4d-4f6c-ba94-fad4fa395d57 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:11.323150 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f89a1d-3a4d-4f6c-ba94-fad4fa395d57 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:11.337989 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 142/289] 10.222.0.79 () {56 vars in 1101 bytes} [Tue Aug 30 00:59:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:59:11.340836 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f89a1d-3a4d-4f6c-ba94-fad4fa395d57 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:11.369349 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:11.455741 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f89a1d-3a4d-4f6c-ba94-fad4fa395d57 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:11.469487 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa52976c-2d4c-4d50-b084-81eb477c6d00 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:11.492004 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:11.494186 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc6a009-24bf-461d-842c-a86026acfc3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:11.495048 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc6a009-24bf-461d-842c-a86026acfc3a None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:11.495595 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc6a009-24bf-461d-842c-a86026acfc3a None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:11.496065 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc6a009-24bf-461d-842c-a86026acfc3a None admin] PATH_INFO: `/v3/users/d717effe6885459c87c824e721bd6cbf` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:11.497484 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc6a009-24bf-461d-842c-a86026acfc3a None admin] RBAC: Authorizing `identity:get_user(user_id=d717effe6885459c87c824e721bd6cbf)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:11.499401 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc6a009-24bf-461d-842c-a86026acfc3a None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:11.501546 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 143/290] 10.222.0.79 () {56 vars in 1177 bytes} [Tue Aug 30 00:59:11 2022] GET /identity/v3/users/d717effe6885459c87c824e721bd6cbf => generated 297 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:59:11.507681 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc6a009-24bf-461d-842c-a86026acfc3a None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:11.539213 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52070494-184e-476e-a72b-fcf4e886a111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:11.540223 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52070494-184e-476e-a72b-fcf4e886a111 None admin] REQUEST_METHOD: `PUT` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:11.540698 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52070494-184e-476e-a72b-fcf4e886a111 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:11.541166 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52070494-184e-476e-a72b-fcf4e886a111 None admin] PATH_INFO: `/v3/projects/3350ee60742e414d945ce547675b0abd/users/10b54bce06a94edfa794d969dc4bcf6f/roles/3e9116b044314295b1dabd1b6dbcd141` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:11.544876 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52070494-184e-476e-a72b-fcf4e886a111 None admin] RBAC: Authorizing `identity:create_grant(project_id=3350ee60742e414d945ce547675b0abd, user_id=10b54bce06a94edfa794d969dc4bcf6f, role_id=3e9116b044314295b1dabd1b6dbcd141)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:11.546567 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52070494-184e-476e-a72b-fcf4e886a111 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:11.570379 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 148/291] 10.222.0.79 () {58 vars in 1439 bytes} [Tue Aug 30 00:59:11 2022] PUT /identity/v3/projects/3350ee60742e414d945ce547675b0abd/users/10b54bce06a94edfa794d969dc4bcf6f/roles/3e9116b044314295b1dabd1b6dbcd141 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:59:11.639649 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:11.648391 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc6a009-24bf-461d-842c-a86026acfc3a None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:11.687537 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae954400-dcf9-46ef-98dd-405c7233a091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:11.688294 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae954400-dcf9-46ef-98dd-405c7233a091 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:11.688569 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae954400-dcf9-46ef-98dd-405c7233a091 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:11.688841 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae954400-dcf9-46ef-98dd-405c7233a091 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:11.762069 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae954400-dcf9-46ef-98dd-405c7233a091 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:11.764137 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae954400-dcf9-46ef-98dd-405c7233a091 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:11.865462 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:11.869704 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 144/292] 10.222.0.79 () {58 vars in 1282 bytes} [Tue Aug 30 00:59:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 30 00:59:11.880270 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52070494-184e-476e-a72b-fcf4e886a111 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:11.997104 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52070494-184e-476e-a72b-fcf4e886a111 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:12.041653 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54dd727-f0ab-45d6-94e4-5c67a8eff5b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:12.042722 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54dd727-f0ab-45d6-94e4-5c67a8eff5b7 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:12.043237 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54dd727-f0ab-45d6-94e4-5c67a8eff5b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:12.043707 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54dd727-f0ab-45d6-94e4-5c67a8eff5b7 None admin] PATH_INFO: `/v3/projects/3350ee60742e414d945ce547675b0abd` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:12.046317 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54dd727-f0ab-45d6-94e4-5c67a8eff5b7 None admin] RBAC: Authorizing `identity:get_project(project_id=3350ee60742e414d945ce547675b0abd)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:12.049026 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54dd727-f0ab-45d6-94e4-5c67a8eff5b7 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:12.052239 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 149/293] 10.222.0.79 () {56 vars in 1186 bytes} [Tue Aug 30 00:59:11 2022] GET /identity/v3/projects/3350ee60742e414d945ce547675b0abd => generated 302 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:59:12.060334 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae954400-dcf9-46ef-98dd-405c7233a091 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:12.182536 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae954400-dcf9-46ef-98dd-405c7233a091 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:12.217773 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86876877-b7f3-42fe-a5d2-aa81d5df0ecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:12.218374 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86876877-b7f3-42fe-a5d2-aa81d5df0ecf None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:12.218646 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86876877-b7f3-42fe-a5d2-aa81d5df0ecf None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:12.218912 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86876877-b7f3-42fe-a5d2-aa81d5df0ecf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:12.219667 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86876877-b7f3-42fe-a5d2-aa81d5df0ecf None admin] RBAC: Adding query filter params (role.id=c37945a17623465f899d4f217e7af593, scope.project.id=3350ee60742e414d945ce547675b0abd, user.id=d717effe6885459c87c824e721bd6cbf) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:59:12.219974 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86876877-b7f3-42fe-a5d2-aa81d5df0ecf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:12.221385 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86876877-b7f3-42fe-a5d2-aa81d5df0ecf None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:12.227564 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 145/294] 10.222.0.79 () {56 vars in 1374 bytes} [Tue Aug 30 00:59:12 2022] GET /identity/v3/role_assignments?user.id=d717effe6885459c87c824e721bd6cbf&scope.project.id=3350ee60742e414d945ce547675b0abd&role.id=c37945a17623465f899d4f217e7af593 => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:59:12.464976 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f11ce8b-f673-4698-aa3f-94f5abddcd3a None None] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:12.465175 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f11ce8b-f673-4698-aa3f-94f5abddcd3a None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:12.465789 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f11ce8b-f673-4698-aa3f-94f5abddcd3a None None] PATH_INFO: `/` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:12.468303 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 150/295] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 00:59:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:59:12.474218 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e26ba5-aba5-4eaf-a56f-4b5e85ad98c6 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:12.475161 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e26ba5-aba5-4eaf-a56f-4b5e85ad98c6 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:12.475631 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e26ba5-aba5-4eaf-a56f-4b5e85ad98c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:12.495046 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-78e26ba5-aba5-4eaf-a56f-4b5e85ad98c6 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:59:12.496622 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-78e26ba5-aba5-4eaf-a56f-4b5e85ad98c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:59:12.553131 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:12.579242 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 146/296] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 00:59:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:59:12.774780 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2265d6c4-aa5d-4c91-b30c-4188ad2379c1 None None] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:12.775811 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2265d6c4-aa5d-4c91-b30c-4188ad2379c1 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:12.776324 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2265d6c4-aa5d-4c91-b30c-4188ad2379c1 None None] PATH_INFO: `/` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:12.777864 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 151/297] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 00:59:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:59:12.784045 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3ba4d9-c4fb-4476-bb92-29ccfbb27f9f None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:12.784588 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3ba4d9-c4fb-4476-bb92-29ccfbb27f9f None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:12.785047 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3ba4d9-c4fb-4476-bb92-29ccfbb27f9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:12.803603 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-1d3ba4d9-c4fb-4476-bb92-29ccfbb27f9f None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:59:12.805102 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-1d3ba4d9-c4fb-4476-bb92-29ccfbb27f9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:59:12.862207 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2265d6c4-aa5d-4c91-b30c-4188ad2379c1 None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:12.903176 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 147/298] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 00:59:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:59:12.917163 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:12.933581 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bfda31-4d3e-46ab-a478-2ead50ead03b None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:12.933911 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bfda31-4d3e-46ab-a478-2ead50ead03b None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:12.934148 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bfda31-4d3e-46ab-a478-2ead50ead03b None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:12.935964 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 148/299] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 00:59:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 00:59:12.942320 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9958233-365e-409e-9fc5-e61751ae256b None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:12.943224 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9958233-365e-409e-9fc5-e61751ae256b None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:12.943700 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9958233-365e-409e-9fc5-e61751ae256b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:12.969544 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-e9958233-365e-409e-9fc5-e61751ae256b None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:59:12.971610 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-e9958233-365e-409e-9fc5-e61751ae256b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:59:12.999357 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2265d6c4-aa5d-4c91-b30c-4188ad2379c1 None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:13.048593 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4dfa75-2324-4cd4-b67d-84eec52578f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:13.049588 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4dfa75-2324-4cd4-b67d-84eec52578f3 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:13.050144 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4dfa75-2324-4cd4-b67d-84eec52578f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:13.050685 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4dfa75-2324-4cd4-b67d-84eec52578f3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:13.062633 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 149/300] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 00:59:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:59:13.064174 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4dfa75-2324-4cd4-b67d-84eec52578f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:59:13.075220 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application [None req-eb4dfa75-2324-4cd4-b67d-84eec52578f3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 00:59:13.075220 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:59:13.075220 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:59:13.075220 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:59:13.075220 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:59:13.075220 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:59:13.075220 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:59:13.075220 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:59:13.075220 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:59:13.075220 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:59:13.075220 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:59:13.075220 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:59:13.075220 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:59:13.075220 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:59:13.075220 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:59:13.075220 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:59:13.077124 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:59:13.077124 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:59:13.077124 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:59:13.077124 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:59:13.077124 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:59:13.077124 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:59:13.077124 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:59:13.077124 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:59:13.077124 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:59:13.077124 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:59:13.077124 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:59:13.077124 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application with Lock( Aug 30 00:59:13.077124 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:59:13.077124 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:59:13.077124 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:59:13.077124 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:59:13.077905 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:59:13.077905 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:59:13.077905 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:59:13.077905 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:59:13.077905 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:59:13.077905 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:59:13.077905 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:59:13.077905 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:59:13.077905 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:59:13.077905 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:59:13.077905 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 00:59:13.077905 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Aug 30 00:59:13.077905 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 152/301] 10.222.0.79 () {56 vars in 1099 bytes} [Tue Aug 30 00:59:12 2022] GET /identity/v3/roles/reader => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:59:13.078543 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9958233-365e-409e-9fc5-e61751ae256b None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:13.125617 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:13.180903 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4dfa75-2324-4cd4-b67d-84eec52578f3 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:13.182079 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9958233-365e-409e-9fc5-e61751ae256b None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:13.225376 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cef810-4894-4406-bc9c-f89d484df62a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:13.226302 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cef810-4894-4406-bc9c-f89d484df62a None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:13.226587 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cef810-4894-4406-bc9c-f89d484df62a None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:13.227178 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cef810-4894-4406-bc9c-f89d484df62a None admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:13.227916 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cef810-4894-4406-bc9c-f89d484df62a None admin] RBAC: Adding query filter params (name=reader) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:59:13.228224 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cef810-4894-4406-bc9c-f89d484df62a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:13.229804 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cef810-4894-4406-bc9c-f89d484df62a None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:13.241097 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 150/302] 10.222.0.79 () {56 vars in 1101 bytes} [Tue Aug 30 00:59:13 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:59:13.247630 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cef810-4894-4406-bc9c-f89d484df62a None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:13.322577 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:13.333598 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4dfa75-2324-4cd4-b67d-84eec52578f3 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:13.379888 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997abdf3-14c2-43ff-b646-51915ee676f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:13.380595 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997abdf3-14c2-43ff-b646-51915ee676f9 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:13.380867 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997abdf3-14c2-43ff-b646-51915ee676f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:13.381138 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997abdf3-14c2-43ff-b646-51915ee676f9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:13.384250 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cef810-4894-4406-bc9c-f89d484df62a None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:13.394180 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997abdf3-14c2-43ff-b646-51915ee676f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:59:13.399048 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application [None req-997abdf3-14c2-43ff-b646-51915ee676f9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 00:59:13.399048 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:59:13.399048 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:59:13.399048 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:59:13.399048 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:59:13.399048 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:59:13.399048 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:59:13.399048 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:59:13.399048 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:59:13.399048 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:59:13.399048 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:59:13.399048 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:59:13.399048 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:59:13.399048 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:59:13.399048 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:59:13.399048 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:59:13.407740 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:59:13.407740 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:59:13.407740 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:59:13.407740 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:59:13.407740 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:59:13.407740 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:59:13.407740 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:59:13.407740 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:59:13.407740 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:59:13.407740 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:59:13.407740 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:59:13.407740 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application with Lock( Aug 30 00:59:13.407740 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:59:13.407740 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:59:13.407740 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:59:13.407740 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:59:13.408661 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:59:13.408661 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:59:13.408661 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:59:13.408661 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:59:13.408661 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:59:13.408661 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:59:13.408661 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:59:13.408661 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:59:13.408661 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:59:13.408661 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:59:13.408661 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 00:59:13.408661 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Aug 30 00:59:13.409277 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:13.409350 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 153/303] 10.222.0.79 () {56 vars in 1099 bytes} [Tue Aug 30 00:59:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 00:59:13.409350 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997abdf3-14c2-43ff-b646-51915ee676f9 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:13.439426 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c6a213-8dcc-4cf8-aca8-75385331afb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:13.440066 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c6a213-8dcc-4cf8-aca8-75385331afb6 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:13.440340 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c6a213-8dcc-4cf8-aca8-75385331afb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:13.440607 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c6a213-8dcc-4cf8-aca8-75385331afb6 None admin] PATH_INFO: `/v3/users/c9fc36da82d944118656a396bdb94a01` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:13.456243 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c6a213-8dcc-4cf8-aca8-75385331afb6 None admin] RBAC: Authorizing `identity:get_user(user_id=c9fc36da82d944118656a396bdb94a01)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:13.457715 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c6a213-8dcc-4cf8-aca8-75385331afb6 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:13.464114 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 151/304] 10.222.0.79 () {56 vars in 1177 bytes} [Tue Aug 30 00:59:13 2022] GET /identity/v3/users/c9fc36da82d944118656a396bdb94a01 => generated 293 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:59:13.464114 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c6a213-8dcc-4cf8-aca8-75385331afb6 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:13.528419 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997abdf3-14c2-43ff-b646-51915ee676f9 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:13.562863 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eeb571d-1148-4c48-b16e-2db715729c13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:13.563526 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeb571d-1148-4c48-b16e-2db715729c13 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:13.563799 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeb571d-1148-4c48-b16e-2db715729c13 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:13.564063 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeb571d-1148-4c48-b16e-2db715729c13 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:13.565158 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eeb571d-1148-4c48-b16e-2db715729c13 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:13.566844 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eeb571d-1148-4c48-b16e-2db715729c13 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:13.568443 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 154/305] 10.222.0.79 () {56 vars in 1108 bytes} [Tue Aug 30 00:59:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:59:13.569213 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eeb571d-1148-4c48-b16e-2db715729c13 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:13.578239 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c6a213-8dcc-4cf8-aca8-75385331afb6 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:13.598357 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:13.615446 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6263b250-e8ce-4172-87d0-96a7d9cc16b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:13.616067 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6263b250-e8ce-4172-87d0-96a7d9cc16b0 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:13.616344 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6263b250-e8ce-4172-87d0-96a7d9cc16b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:13.616613 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6263b250-e8ce-4172-87d0-96a7d9cc16b0 None admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:13.617282 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6263b250-e8ce-4172-87d0-96a7d9cc16b0 None admin] RBAC: Adding query filter params (name=member) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:59:13.617582 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6263b250-e8ce-4172-87d0-96a7d9cc16b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:13.618943 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6263b250-e8ce-4172-87d0-96a7d9cc16b0 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:13.632341 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 152/306] 10.222.0.79 () {56 vars in 1101 bytes} [Tue Aug 30 00:59:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:59:13.632341 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6263b250-e8ce-4172-87d0-96a7d9cc16b0 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:13.660899 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:13.686926 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eeb571d-1148-4c48-b16e-2db715729c13 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:13.723151 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d71480a-7eef-4ea0-bbf6-1047ce12a416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:13.723890 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d71480a-7eef-4ea0-bbf6-1047ce12a416 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:13.724164 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d71480a-7eef-4ea0-bbf6-1047ce12a416 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:13.724423 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d71480a-7eef-4ea0-bbf6-1047ce12a416 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:13.725145 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d71480a-7eef-4ea0-bbf6-1047ce12a416 None admin] RBAC: Adding query filter params (role.id=3e9116b044314295b1dabd1b6dbcd141, user.id=c9fc36da82d944118656a396bdb94a01, scope.system=all) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:59:13.725449 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d71480a-7eef-4ea0-bbf6-1047ce12a416 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:13.726903 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d71480a-7eef-4ea0-bbf6-1047ce12a416 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:13.734711 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 155/307] 10.222.0.79 () {56 vars in 1308 bytes} [Tue Aug 30 00:59:13 2022] GET /identity/v3/role_assignments?user.id=c9fc36da82d944118656a396bdb94a01&scope.system=all&role.id=3e9116b044314295b1dabd1b6dbcd141 => generated 226 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:59:13.735910 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d71480a-7eef-4ea0-bbf6-1047ce12a416 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:13.765491 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6263b250-e8ce-4172-87d0-96a7d9cc16b0 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:13.819429 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2667ee14-80a4-48c4-a573-5bcaf094aff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:13.819966 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2667ee14-80a4-48c4-a573-5bcaf094aff5 None admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:13.820247 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2667ee14-80a4-48c4-a573-5bcaf094aff5 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:13.820518 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2667ee14-80a4-48c4-a573-5bcaf094aff5 None admin] PATH_INFO: `/v3/groups` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:13.821184 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2667ee14-80a4-48c4-a573-5bcaf094aff5 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:13.822682 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2667ee14-80a4-48c4-a573-5bcaf094aff5 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:13.841633 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 153/308] 10.222.0.79 () {60 vars in 1134 bytes} [Tue Aug 30 00:59:13 2022] POST /identity/v3/groups => generated 229 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:59:13.854793 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:13.868952 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d71480a-7eef-4ea0-bbf6-1047ce12a416 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:13.911008 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0a5564-0a9f-4a8a-8f5b-f93b01d8232f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:13.911693 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0a5564-0a9f-4a8a-8f5b-f93b01d8232f None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:13.911998 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0a5564-0a9f-4a8a-8f5b-f93b01d8232f None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:13.912270 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0a5564-0a9f-4a8a-8f5b-f93b01d8232f None admin] PATH_INFO: `/v3/users/eea8571f07804f1cae718e29e1f84b54` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:13.913480 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0a5564-0a9f-4a8a-8f5b-f93b01d8232f None admin] RBAC: Authorizing `identity:get_user(user_id=eea8571f07804f1cae718e29e1f84b54)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:13.914961 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0a5564-0a9f-4a8a-8f5b-f93b01d8232f None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:13.917037 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 156/309] 10.222.0.79 () {56 vars in 1177 bytes} [Tue Aug 30 00:59:13 2022] GET /identity/v3/users/eea8571f07804f1cae718e29e1f84b54 => generated 293 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:59:13.923839 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2667ee14-80a4-48c4-a573-5bcaf094aff5 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:14.023195 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:14.041434 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2667ee14-80a4-48c4-a573-5bcaf094aff5 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:14.079440 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f44e417-3189-428c-91f9-37acd7f5c4fa None None] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:14.079721 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f44e417-3189-428c-91f9-37acd7f5c4fa None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:14.079995 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f44e417-3189-428c-91f9-37acd7f5c4fa None None] PATH_INFO: `/` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:14.081450 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 157/310] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 00:59:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 00:59:14.082848 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72e5f40-7ae7-4261-95a7-7097713bca82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:14.083552 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72e5f40-7ae7-4261-95a7-7097713bca82 None admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:14.083832 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72e5f40-7ae7-4261-95a7-7097713bca82 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:14.084111 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72e5f40-7ae7-4261-95a7-7097713bca82 None admin] PATH_INFO: `/v3/system/users/eea8571f07804f1cae718e29e1f84b54/roles/c37945a17623465f899d4f217e7af593` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:14.085648 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72e5f40-7ae7-4261-95a7-7097713bca82 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=eea8571f07804f1cae718e29e1f84b54, role_id=c37945a17623465f899d4f217e7af593)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:14.087080 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72e5f40-7ae7-4261-95a7-7097713bca82 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:14.088593 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e0f796-463b-4743-9658-42863a6cda8a None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:14.089308 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e0f796-463b-4743-9658-42863a6cda8a None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:14.089780 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e0f796-463b-4743-9658-42863a6cda8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:14.103110 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 154/311] 10.222.0.79 () {58 vars in 1334 bytes} [Tue Aug 30 00:59:13 2022] PUT /identity/v3/system/users/eea8571f07804f1cae718e29e1f84b54/roles/c37945a17623465f899d4f217e7af593 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:59:14.118241 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-64e0f796-463b-4743-9658-42863a6cda8a None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:59:14.119561 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-64e0f796-463b-4743-9658-42863a6cda8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:59:14.226991 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 158/312] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 00:59:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 00:59:14.497552 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72e5f40-7ae7-4261-95a7-7097713bca82 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:14.606533 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72e5f40-7ae7-4261-95a7-7097713bca82 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:14.643763 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e10a13d-e2e9-4557-8de4-48fd605fadbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:14.644758 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e10a13d-e2e9-4557-8de4-48fd605fadbb None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:14.645230 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e10a13d-e2e9-4557-8de4-48fd605fadbb None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:14.645693 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e10a13d-e2e9-4557-8de4-48fd605fadbb None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:14.657135 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e10a13d-e2e9-4557-8de4-48fd605fadbb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:59:14.662857 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-4e10a13d-e2e9-4557-8de4-48fd605fadbb None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 00:59:14.662857 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:59:14.662857 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:59:14.662857 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:59:14.662857 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:59:14.662857 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:59:14.662857 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:59:14.662857 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:59:14.662857 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:59:14.662857 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:59:14.662857 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:59:14.662857 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:59:14.662857 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:59:14.662857 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:59:14.662857 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:59:14.662857 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:59:14.663790 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:59:14.663790 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:59:14.663790 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:59:14.663790 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:59:14.663790 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:59:14.663790 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:59:14.663790 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:59:14.663790 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:59:14.663790 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:59:14.663790 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:59:14.663790 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:59:14.663790 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Aug 30 00:59:14.663790 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:59:14.663790 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:59:14.663790 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:59:14.663790 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:59:14.664592 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:59:14.664592 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:59:14.664592 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:59:14.664592 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:59:14.664592 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:59:14.664592 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:59:14.664592 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:59:14.664592 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:59:14.664592 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:59:14.664592 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:59:14.664592 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 00:59:14.664592 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Aug 30 00:59:14.671191 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 155/313] 10.222.0.79 () {56 vars in 1099 bytes} [Tue Aug 30 00:59:14 2022] GET /identity/v3/roles/reader => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:59:14.673197 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e0f796-463b-4743-9658-42863a6cda8a None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:14.767099 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:14.780104 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e0f796-463b-4743-9658-42863a6cda8a None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:14.819157 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addaeb26-ef53-4804-86a7-4be6192d9c10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:14.819776 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addaeb26-ef53-4804-86a7-4be6192d9c10 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:14.820051 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addaeb26-ef53-4804-86a7-4be6192d9c10 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:14.820322 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addaeb26-ef53-4804-86a7-4be6192d9c10 None admin] PATH_INFO: `/v3/roles` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:14.820995 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addaeb26-ef53-4804-86a7-4be6192d9c10 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:59:14.821293 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addaeb26-ef53-4804-86a7-4be6192d9c10 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:14.822688 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addaeb26-ef53-4804-86a7-4be6192d9c10 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:14.832699 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 159/314] 10.222.0.79 () {56 vars in 1101 bytes} [Tue Aug 30 00:59:14 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:59:14.840509 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e10a13d-e2e9-4557-8de4-48fd605fadbb None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:14.856742 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:14.959104 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e10a13d-e2e9-4557-8de4-48fd605fadbb None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:14.994551 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f3e2de-743c-460a-b124-524d83c32a0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:14.995561 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f3e2de-743c-460a-b124-524d83c32a0c None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:14.996059 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f3e2de-743c-460a-b124-524d83c32a0c None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:14.996548 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f3e2de-743c-460a-b124-524d83c32a0c None admin] PATH_INFO: `/v3/users/10b54bce06a94edfa794d969dc4bcf6f` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:14.998432 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f3e2de-743c-460a-b124-524d83c32a0c None admin] RBAC: Authorizing `identity:get_user(user_id=10b54bce06a94edfa794d969dc4bcf6f)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:15.000188 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f3e2de-743c-460a-b124-524d83c32a0c None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:15.002246 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 156/315] 10.222.0.79 () {56 vars in 1177 bytes} [Tue Aug 30 00:59:14 2022] GET /identity/v3/users/10b54bce06a94edfa794d969dc4bcf6f => generated 297 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:59:15.010735 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addaeb26-ef53-4804-86a7-4be6192d9c10 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:15.119183 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addaeb26-ef53-4804-86a7-4be6192d9c10 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:15.158812 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f7943f-1bcd-470d-b6d7-30084f9c15b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:15.159457 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f7943f-1bcd-470d-b6d7-30084f9c15b3 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:15.159735 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f7943f-1bcd-470d-b6d7-30084f9c15b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:15.160006 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f7943f-1bcd-470d-b6d7-30084f9c15b3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:15.183762 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:15.237358 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f7943f-1bcd-470d-b6d7-30084f9c15b3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:15.238822 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f7943f-1bcd-470d-b6d7-30084f9c15b3 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:15.347274 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 160/316] 10.222.0.79 () {58 vars in 1282 bytes} [Tue Aug 30 00:59:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 00:59:15.352839 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f3e2de-743c-460a-b124-524d83c32a0c None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:15.438423 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:15.462856 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f3e2de-743c-460a-b124-524d83c32a0c None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:15.501230 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e624cf-175f-408a-9e79-64acdfb78d84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:15.502231 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e624cf-175f-408a-9e79-64acdfb78d84 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:15.502700 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e624cf-175f-408a-9e79-64acdfb78d84 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:15.503203 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e624cf-175f-408a-9e79-64acdfb78d84 None admin] PATH_INFO: `/v3/projects/3350ee60742e414d945ce547675b0abd` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:15.504553 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e624cf-175f-408a-9e79-64acdfb78d84 None admin] RBAC: Authorizing `identity:get_project(project_id=3350ee60742e414d945ce547675b0abd)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:15.506181 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e624cf-175f-408a-9e79-64acdfb78d84 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:15.508477 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 157/317] 10.222.0.79 () {56 vars in 1186 bytes} [Tue Aug 30 00:59:15 2022] GET /identity/v3/projects/3350ee60742e414d945ce547675b0abd => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:59:15.514987 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f7943f-1bcd-470d-b6d7-30084f9c15b3 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:15.568213 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:15.620329 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f7943f-1bcd-470d-b6d7-30084f9c15b3 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:15.655968 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911c0f38-fb61-44ed-ad09-066813f2f0da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:15.656577 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911c0f38-fb61-44ed-ad09-066813f2f0da None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:15.656848 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911c0f38-fb61-44ed-ad09-066813f2f0da None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:15.657117 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911c0f38-fb61-44ed-ad09-066813f2f0da None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:15.657841 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911c0f38-fb61-44ed-ad09-066813f2f0da None admin] RBAC: Adding query filter params (role.id=3e9116b044314295b1dabd1b6dbcd141, scope.project.id=3350ee60742e414d945ce547675b0abd, user.id=10b54bce06a94edfa794d969dc4bcf6f) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:59:15.658138 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911c0f38-fb61-44ed-ad09-066813f2f0da None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:15.659593 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911c0f38-fb61-44ed-ad09-066813f2f0da None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:15.665923 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 161/318] 10.222.0.79 () {56 vars in 1374 bytes} [Tue Aug 30 00:59:15 2022] GET /identity/v3/role_assignments?user.id=10b54bce06a94edfa794d969dc4bcf6f&scope.project.id=3350ee60742e414d945ce547675b0abd&role.id=3e9116b044314295b1dabd1b6dbcd141 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:59:15.851421 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d0f98e-9b9a-4a28-8700-47691b9ce2c7 None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:15.851935 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d0f98e-9b9a-4a28-8700-47691b9ce2c7 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:15.851935 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d0f98e-9b9a-4a28-8700-47691b9ce2c7 None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:15.853421 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 158/319] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 00:59:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:59:15.860095 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f2c2ad-78e9-4063-9b90-b48b58cda1f1 None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:15.860382 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f2c2ad-78e9-4063-9b90-b48b58cda1f1 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:15.860644 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f2c2ad-78e9-4063-9b90-b48b58cda1f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:15.870771 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79395df0-f708-4b09-bc15-8f1a13ac0da9 None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:15.871091 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79395df0-f708-4b09-bc15-8f1a13ac0da9 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:15.871351 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79395df0-f708-4b09-bc15-8f1a13ac0da9 None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:15.873084 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 159/320] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 00:59:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:59:15.878470 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc78250-7a34-4c28-9d49-95f176a168be None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:15.878741 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc78250-7a34-4c28-9d49-95f176a168be None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:15.879016 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc78250-7a34-4c28-9d49-95f176a168be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:15.882231 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-08f2c2ad-78e9-4063-9b90-b48b58cda1f1 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:59:15.883447 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-08f2c2ad-78e9-4063-9b90-b48b58cda1f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:59:15.898411 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-ffc78250-7a34-4c28-9d49-95f176a168be None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:59:15.899640 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-ffc78250-7a34-4c28-9d49-95f176a168be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:59:15.964548 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 162/321] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 00:59:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:59:15.982568 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 160/322] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 00:59:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 00:59:16.165225 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f637942f-4920-474d-8230-1f404e40fe5b None None] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:16.165731 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f637942f-4920-474d-8230-1f404e40fe5b None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:16.165731 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f637942f-4920-474d-8230-1f404e40fe5b None None] PATH_INFO: `/` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:16.167177 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 163/323] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 00:59:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:59:16.172474 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee673d6-a781-40e4-b221-a16faead7982 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:16.172766 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee673d6-a781-40e4-b221-a16faead7982 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:16.173038 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee673d6-a781-40e4-b221-a16faead7982 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:16.193013 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-aee673d6-a781-40e4-b221-a16faead7982 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:59:16.194230 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-aee673d6-a781-40e4-b221-a16faead7982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:59:16.237595 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f637942f-4920-474d-8230-1f404e40fe5b None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:16.272171 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 161/324] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 00:59:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:59:16.273044 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee673d6-a781-40e4-b221-a16faead7982 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:16.282198 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:16.292817 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:16.354091 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f637942f-4920-474d-8230-1f404e40fe5b None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:16.382815 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee673d6-a781-40e4-b221-a16faead7982 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:16.393501 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b348c7cc-aa4f-46d4-a583-edb31eb4f673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:16.394508 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b348c7cc-aa4f-46d4-a583-edb31eb4f673 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:16.394800 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b348c7cc-aa4f-46d4-a583-edb31eb4f673 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:16.395343 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b348c7cc-aa4f-46d4-a583-edb31eb4f673 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:16.406390 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b348c7cc-aa4f-46d4-a583-edb31eb4f673 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:59:16.411413 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application [None req-b348c7cc-aa4f-46d4-a583-edb31eb4f673 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 00:59:16.411413 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:59:16.411413 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:59:16.411413 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:59:16.411413 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:59:16.411413 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:59:16.411413 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:59:16.411413 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:59:16.411413 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:59:16.411413 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:59:16.411413 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:59:16.411413 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:59:16.411413 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:59:16.411413 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:59:16.411413 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:59:16.411413 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:59:16.412443 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:59:16.412443 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:59:16.412443 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:59:16.412443 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:59:16.412443 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:59:16.412443 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:59:16.412443 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:59:16.412443 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:59:16.412443 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:59:16.412443 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:59:16.412443 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:59:16.412443 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application with Lock( Aug 30 00:59:16.412443 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:59:16.412443 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:59:16.412443 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:59:16.412443 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:59:16.413408 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:59:16.413408 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:59:16.413408 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:59:16.413408 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:59:16.413408 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:59:16.413408 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:59:16.413408 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:59:16.413408 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:59:16.413408 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:59:16.413408 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:59:16.413408 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 00:59:16.413408 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Aug 30 00:59:16.413408 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 164/325] 10.222.0.79 () {56 vars in 1099 bytes} [Tue Aug 30 00:59:16 2022] GET /identity/v3/roles/reader => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:59:16.420106 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b348c7cc-aa4f-46d4-a583-edb31eb4f673 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:16.421988 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121eb457-2bde-4068-b174-f2e415472706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:16.422854 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121eb457-2bde-4068-b174-f2e415472706 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:16.423312 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121eb457-2bde-4068-b174-f2e415472706 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:16.423583 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121eb457-2bde-4068-b174-f2e415472706 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:16.425049 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121eb457-2bde-4068-b174-f2e415472706 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:16.426227 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121eb457-2bde-4068-b174-f2e415472706 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:16.428032 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 162/326] 10.222.0.79 () {56 vars in 1108 bytes} [Tue Aug 30 00:59:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:59:16.433555 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121eb457-2bde-4068-b174-f2e415472706 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:16.518994 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:16.540541 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b348c7cc-aa4f-46d4-a583-edb31eb4f673 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:16.544943 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:16.552044 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121eb457-2bde-4068-b174-f2e415472706 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:16.581325 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7963cff-510b-4a5a-99d4-fc42909453eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:16.581933 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7963cff-510b-4a5a-99d4-fc42909453eb None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:16.582206 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7963cff-510b-4a5a-99d4-fc42909453eb None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:16.582471 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7963cff-510b-4a5a-99d4-fc42909453eb None admin] PATH_INFO: `/v3/roles` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:16.583152 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7963cff-510b-4a5a-99d4-fc42909453eb None admin] RBAC: Adding query filter params (name=reader) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:59:16.583453 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7963cff-510b-4a5a-99d4-fc42909453eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:16.584833 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7963cff-510b-4a5a-99d4-fc42909453eb None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:16.589546 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775ce5c2-8d28-4f1f-a853-d8c1fb61ccb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:16.590140 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775ce5c2-8d28-4f1f-a853-d8c1fb61ccb2 None admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:16.590413 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775ce5c2-8d28-4f1f-a853-d8c1fb61ccb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:16.590741 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775ce5c2-8d28-4f1f-a853-d8c1fb61ccb2 None admin] PATH_INFO: `/v3/groups` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:16.591432 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775ce5c2-8d28-4f1f-a853-d8c1fb61ccb2 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:16.593057 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775ce5c2-8d28-4f1f-a853-d8c1fb61ccb2 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:16.593799 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 165/327] 10.222.0.79 () {56 vars in 1101 bytes} [Tue Aug 30 00:59:16 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:59:16.596044 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7963cff-510b-4a5a-99d4-fc42909453eb None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:16.619453 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 163/328] 10.222.0.79 () {60 vars in 1134 bytes} [Tue Aug 30 00:59:16 2022] POST /identity/v3/groups => generated 226 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 00:59:16.619453 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775ce5c2-8d28-4f1f-a853-d8c1fb61ccb2 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:16.711771 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7963cff-510b-4a5a-99d4-fc42909453eb None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:16.737427 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775ce5c2-8d28-4f1f-a853-d8c1fb61ccb2 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:16.749845 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cccbf00-6885-45da-86a4-363a4c93854a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:16.750498 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cccbf00-6885-45da-86a4-363a4c93854a None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:16.750771 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cccbf00-6885-45da-86a4-363a4c93854a None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:16.751045 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cccbf00-6885-45da-86a4-363a4c93854a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:16.762521 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cccbf00-6885-45da-86a4-363a4c93854a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:59:16.767999 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application [None req-6cccbf00-6885-45da-86a4-363a4c93854a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 00:59:16.767999 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:59:16.767999 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:59:16.767999 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:59:16.767999 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:59:16.767999 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:59:16.767999 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:59:16.767999 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:59:16.767999 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:59:16.767999 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:59:16.767999 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:59:16.767999 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:59:16.767999 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:59:16.767999 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:59:16.767999 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:59:16.767999 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:59:16.769079 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:59:16.769079 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:59:16.769079 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:59:16.769079 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:59:16.769079 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:59:16.769079 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:59:16.769079 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:59:16.769079 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:59:16.769079 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:59:16.769079 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:59:16.769079 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:59:16.769079 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application with Lock( Aug 30 00:59:16.769079 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:59:16.769079 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:59:16.769079 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:59:16.769079 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:59:16.770044 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:59:16.770044 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:59:16.770044 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:59:16.770044 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:59:16.770044 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:59:16.770044 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:59:16.770044 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:59:16.770044 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:59:16.770044 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:59:16.770044 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:59:16.770044 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 00:59:16.770044 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Aug 30 00:59:16.770044 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 166/329] 10.222.0.79 () {56 vars in 1099 bytes} [Tue Aug 30 00:59:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:59:16.776407 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cccbf00-6885-45da-86a4-363a4c93854a None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:16.784700 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5e5423-6abc-41eb-893b-9d3a7c637995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:16.785338 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5e5423-6abc-41eb-893b-9d3a7c637995 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:16.785636 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5e5423-6abc-41eb-893b-9d3a7c637995 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:16.785916 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5e5423-6abc-41eb-893b-9d3a7c637995 None admin] PATH_INFO: `/v3/users/c9fc36da82d944118656a396bdb94a01` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:16.787158 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5e5423-6abc-41eb-893b-9d3a7c637995 None admin] RBAC: Authorizing `identity:get_user(user_id=c9fc36da82d944118656a396bdb94a01)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:16.788628 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5e5423-6abc-41eb-893b-9d3a7c637995 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:16.790218 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 164/330] 10.222.0.79 () {56 vars in 1177 bytes} [Tue Aug 30 00:59:16 2022] GET /identity/v3/users/c9fc36da82d944118656a396bdb94a01 => generated 293 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:59:16.798137 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5e5423-6abc-41eb-893b-9d3a7c637995 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:16.801145 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:16.809008 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:16.908487 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cccbf00-6885-45da-86a4-363a4c93854a None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:16.931484 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5e5423-6abc-41eb-893b-9d3a7c637995 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:16.952557 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a29711-ab62-48af-9ad3-9b78f5c5080e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:16.953182 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a29711-ab62-48af-9ad3-9b78f5c5080e None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:16.953685 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a29711-ab62-48af-9ad3-9b78f5c5080e None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:16.953685 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a29711-ab62-48af-9ad3-9b78f5c5080e None admin] PATH_INFO: `/v3/roles` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:16.954350 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a29711-ab62-48af-9ad3-9b78f5c5080e None admin] RBAC: Adding query filter params (name=member) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:59:16.954649 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a29711-ab62-48af-9ad3-9b78f5c5080e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:16.956052 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a29711-ab62-48af-9ad3-9b78f5c5080e None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:16.967937 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 167/331] 10.222.0.79 () {56 vars in 1101 bytes} [Tue Aug 30 00:59:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:59:16.974627 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a29711-ab62-48af-9ad3-9b78f5c5080e None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:16.978977 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11a7741-df56-411e-b110-617137542e8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:16.979797 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11a7741-df56-411e-b110-617137542e8e None admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:16.980233 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11a7741-df56-411e-b110-617137542e8e None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:16.980632 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11a7741-df56-411e-b110-617137542e8e None admin] PATH_INFO: `/v3/system/users/c9fc36da82d944118656a396bdb94a01/roles/3e9116b044314295b1dabd1b6dbcd141` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:16.982804 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11a7741-df56-411e-b110-617137542e8e None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=c9fc36da82d944118656a396bdb94a01, role_id=3e9116b044314295b1dabd1b6dbcd141)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:16.984962 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11a7741-df56-411e-b110-617137542e8e None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:17.003067 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 165/332] 10.222.0.79 () {58 vars in 1334 bytes} [Tue Aug 30 00:59:16 2022] PUT /identity/v3/system/users/c9fc36da82d944118656a396bdb94a01/roles/3e9116b044314295b1dabd1b6dbcd141 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:59:17.089705 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:17.105412 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a29711-ab62-48af-9ad3-9b78f5c5080e None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:17.147747 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95071e8e-498f-4110-9e08-af506f37b2c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:17.148395 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95071e8e-498f-4110-9e08-af506f37b2c4 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:17.148668 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95071e8e-498f-4110-9e08-af506f37b2c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:17.148937 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95071e8e-498f-4110-9e08-af506f37b2c4 None admin] PATH_INFO: `/v3/users/eea8571f07804f1cae718e29e1f84b54` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:17.150517 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95071e8e-498f-4110-9e08-af506f37b2c4 None admin] RBAC: Authorizing `identity:get_user(user_id=eea8571f07804f1cae718e29e1f84b54)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:17.152029 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95071e8e-498f-4110-9e08-af506f37b2c4 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:17.154461 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 168/333] 10.222.0.79 () {56 vars in 1177 bytes} [Tue Aug 30 00:59:16 2022] GET /identity/v3/users/eea8571f07804f1cae718e29e1f84b54 => generated 293 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:59:17.160432 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11a7741-df56-411e-b110-617137542e8e None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:17.248729 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:17.290705 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11a7741-df56-411e-b110-617137542e8e None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:17.330557 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fbc196-6b42-4e62-a5ad-8a13f4ef4fb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:17.331217 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fbc196-6b42-4e62-a5ad-8a13f4ef4fb2 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:17.331498 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fbc196-6b42-4e62-a5ad-8a13f4ef4fb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:17.331767 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fbc196-6b42-4e62-a5ad-8a13f4ef4fb2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:17.332505 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fbc196-6b42-4e62-a5ad-8a13f4ef4fb2 None admin] RBAC: Adding query filter params (role.id=c37945a17623465f899d4f217e7af593, user.id=eea8571f07804f1cae718e29e1f84b54, scope.system=all) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:59:17.332808 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fbc196-6b42-4e62-a5ad-8a13f4ef4fb2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:17.334248 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fbc196-6b42-4e62-a5ad-8a13f4ef4fb2 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:17.347587 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 166/334] 10.222.0.79 () {56 vars in 1308 bytes} [Tue Aug 30 00:59:17 2022] GET /identity/v3/role_assignments?user.id=eea8571f07804f1cae718e29e1f84b54&scope.system=all&role.id=c37945a17623465f899d4f217e7af593 => generated 510 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:59:19.124738 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6c1540-e1bd-4e59-b58a-0e442835c0e9 None None] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:19.125736 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6c1540-e1bd-4e59-b58a-0e442835c0e9 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:19.126218 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6c1540-e1bd-4e59-b58a-0e442835c0e9 None None] PATH_INFO: `/` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:19.128121 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 169/335] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 00:59:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:59:19.128722 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649c8b90-608a-433b-9345-854c225fc69d None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:19.129104 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649c8b90-608a-433b-9345-854c225fc69d None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:19.129256 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649c8b90-608a-433b-9345-854c225fc69d None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:19.130817 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 167/336] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 00:59:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 00:59:19.136881 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232bd32c-0639-4486-a489-2cee93f9ea7a None None] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:19.137459 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232bd32c-0639-4486-a489-2cee93f9ea7a None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:19.137973 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232bd32c-0639-4486-a489-2cee93f9ea7a None None] PATH_INFO: `/` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:19.140503 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 170/337] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 00:59:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:59:19.142581 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deba9abb-9a64-4e47-92e7-7ab258e67ff5 None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:19.143083 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deba9abb-9a64-4e47-92e7-7ab258e67ff5 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:19.143607 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deba9abb-9a64-4e47-92e7-7ab258e67ff5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:19.147112 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673dca26-7e27-4d6f-bc8d-ba97c1913476 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:19.147643 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673dca26-7e27-4d6f-bc8d-ba97c1913476 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:19.148120 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673dca26-7e27-4d6f-bc8d-ba97c1913476 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:19.173647 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-673dca26-7e27-4d6f-bc8d-ba97c1913476 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:59:19.178165 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-673dca26-7e27-4d6f-bc8d-ba97c1913476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:59:19.181306 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-deba9abb-9a64-4e47-92e7-7ab258e67ff5 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:59:19.182655 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-deba9abb-9a64-4e47-92e7-7ab258e67ff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:59:19.299450 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 168/338] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 00:59:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:59:19.301026 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a0f69f-447a-4364-b2f2-a58e8928760e None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:19.301336 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a0f69f-447a-4364-b2f2-a58e8928760e None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:19.301579 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a0f69f-447a-4364-b2f2-a58e8928760e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:19.325835 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 171/339] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 00:59:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:59:19.336225 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-85a0f69f-447a-4364-b2f2-a58e8928760e None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:59:19.337432 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-85a0f69f-447a-4364-b2f2-a58e8928760e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:59:19.415958 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:19.438520 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 169/340] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 00:59:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:59:19.840701 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deba9abb-9a64-4e47-92e7-7ab258e67ff5 None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:19.890898 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a0f69f-447a-4364-b2f2-a58e8928760e None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:19.970683 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:19.992668 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deba9abb-9a64-4e47-92e7-7ab258e67ff5 None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:20.027055 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a0f69f-447a-4364-b2f2-a58e8928760e None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:20.042278 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dd1b50-545a-4f63-86cb-e96cf32f655e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:20.043278 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dd1b50-545a-4f63-86cb-e96cf32f655e None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:20.043691 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dd1b50-545a-4f63-86cb-e96cf32f655e None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:20.044313 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dd1b50-545a-4f63-86cb-e96cf32f655e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:20.055920 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dd1b50-545a-4f63-86cb-e96cf32f655e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:59:20.062175 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application [None req-93dd1b50-545a-4f63-86cb-e96cf32f655e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 00:59:20.062175 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:59:20.062175 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:59:20.062175 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:59:20.062175 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:59:20.062175 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:59:20.062175 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:59:20.062175 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:59:20.062175 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:59:20.062175 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:59:20.062175 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:59:20.062175 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:59:20.062175 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:59:20.062175 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:59:20.062175 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:59:20.062175 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:59:20.063059 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:59:20.063059 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:59:20.063059 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:59:20.063059 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:59:20.063059 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:59:20.063059 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:59:20.063059 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:59:20.063059 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:59:20.063059 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:59:20.063059 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:59:20.063059 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:59:20.063059 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application with Lock( Aug 30 00:59:20.063059 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:59:20.063059 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:59:20.063059 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:59:20.063059 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:59:20.063862 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:59:20.063862 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:59:20.063862 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:59:20.063862 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:59:20.063862 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:59:20.063862 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:59:20.063862 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:59:20.063862 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:59:20.063862 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:59:20.063862 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:59:20.063862 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 00:59:20.063862 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Aug 30 00:59:20.066623 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64070792-a543-4914-91cb-0686e0f90b86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:20.066861 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 172/341] 10.222.0.79 () {56 vars in 1114 bytes} [Tue Aug 30 00:59:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:59:20.067291 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64070792-a543-4914-91cb-0686e0f90b86 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:20.067571 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64070792-a543-4914-91cb-0686e0f90b86 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:20.067839 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64070792-a543-4914-91cb-0686e0f90b86 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:20.068579 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dd1b50-545a-4f63-86cb-e96cf32f655e None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:20.080116 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64070792-a543-4914-91cb-0686e0f90b86 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:59:20.085226 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-64070792-a543-4914-91cb-0686e0f90b86 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 00:59:20.085226 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:59:20.085226 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:59:20.085226 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:59:20.085226 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:59:20.085226 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:59:20.085226 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:59:20.085226 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:59:20.085226 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:59:20.085226 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:59:20.085226 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:59:20.085226 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:59:20.085226 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:59:20.085226 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:59:20.085226 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:59:20.085226 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:59:20.086140 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:59:20.086140 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:59:20.086140 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:59:20.086140 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:59:20.086140 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:59:20.086140 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:59:20.086140 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:59:20.086140 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:59:20.086140 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:59:20.086140 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:59:20.086140 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:59:20.086140 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Aug 30 00:59:20.086140 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:59:20.086140 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:59:20.086140 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:59:20.086140 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:59:20.086936 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:59:20.086936 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:59:20.086936 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:59:20.086936 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:59:20.086936 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:59:20.086936 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:59:20.086936 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:59:20.086936 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:59:20.086936 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:59:20.086936 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:59:20.086936 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 00:59:20.086936 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Aug 30 00:59:20.086936 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 170/342] 10.222.0.79 () {56 vars in 1099 bytes} [Tue Aug 30 00:59:19 2022] GET /identity/v3/roles/reader => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 00:59:20.092237 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23549f7-ce8b-4395-951d-efd6df73a60b None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:20.092237 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23549f7-ce8b-4395-951d-efd6df73a60b None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:20.092237 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23549f7-ce8b-4395-951d-efd6df73a60b None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:20.092237 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 171/343] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 00:59:20 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:59:20.092237 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23549f7-ce8b-4395-951d-efd6df73a60b None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:20.150002 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:20.191489 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dd1b50-545a-4f63-86cb-e96cf32f655e None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:20.212744 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23549f7-ce8b-4395-951d-efd6df73a60b None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:20.238797 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3675a627-1f3a-464e-af20-30484802fe70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:20.239695 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3675a627-1f3a-464e-af20-30484802fe70 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:20.240217 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3675a627-1f3a-464e-af20-30484802fe70 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:20.240698 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3675a627-1f3a-464e-af20-30484802fe70 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:20.254369 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3675a627-1f3a-464e-af20-30484802fe70 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:59:20.254988 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a2fec0-f402-4393-b0e2-2015c4ec4f19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:20.255623 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a2fec0-f402-4393-b0e2-2015c4ec4f19 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:20.255895 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a2fec0-f402-4393-b0e2-2015c4ec4f19 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:20.256162 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a2fec0-f402-4393-b0e2-2015c4ec4f19 None admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:20.256821 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a2fec0-f402-4393-b0e2-2015c4ec4f19 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:59:20.257120 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a2fec0-f402-4393-b0e2-2015c4ec4f19 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:20.258510 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a2fec0-f402-4393-b0e2-2015c4ec4f19 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:20.261507 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application [None req-3675a627-1f3a-464e-af20-30484802fe70 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 00:59:20.261507 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:59:20.261507 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:59:20.261507 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:59:20.261507 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:59:20.261507 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:59:20.261507 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:59:20.261507 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:59:20.261507 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:59:20.261507 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:59:20.261507 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:59:20.261507 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:59:20.261507 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:59:20.261507 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:59:20.261507 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:59:20.261507 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:59:20.262399 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:59:20.262399 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:59:20.262399 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:59:20.262399 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:59:20.262399 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:59:20.262399 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:59:20.262399 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:59:20.262399 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:59:20.262399 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:59:20.262399 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:59:20.262399 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:59:20.262399 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application with Lock( Aug 30 00:59:20.262399 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:59:20.262399 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:59:20.262399 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:59:20.262399 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:59:20.263276 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:59:20.263276 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:59:20.263276 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:59:20.263276 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:59:20.263276 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:59:20.263276 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:59:20.263276 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:59:20.263276 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:59:20.263276 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:59:20.263276 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:59:20.263276 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 00:59:20.263276 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Aug 30 00:59:20.265613 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 173/344] 10.222.0.79 () {56 vars in 1099 bytes} [Tue Aug 30 00:59:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:59:20.268019 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ad0436-86c8-4028-8595-8ebe225a968a None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:20.268570 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ad0436-86c8-4028-8595-8ebe225a968a None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:20.269048 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ad0436-86c8-4028-8595-8ebe225a968a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:20.272180 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 172/345] 10.222.0.79 () {56 vars in 1111 bytes} [Tue Aug 30 00:59:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:59:20.273266 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a2fec0-f402-4393-b0e2-2015c4ec4f19 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:20.283794 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:20.290178 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-26ad0436-86c8-4028-8595-8ebe225a968a None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:59:20.291545 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-26ad0436-86c8-4028-8595-8ebe225a968a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:59:20.367834 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 174/346] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 00:59:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:59:20.368749 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ad0436-86c8-4028-8595-8ebe225a968a None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:20.393141 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a2fec0-f402-4393-b0e2-2015c4ec4f19 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:20.401087 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:20.433227 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec392888-600b-4103-be0a-e1006a22442d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:20.434270 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec392888-600b-4103-be0a-e1006a22442d None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:20.435410 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec392888-600b-4103-be0a-e1006a22442d None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:20.435876 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec392888-600b-4103-be0a-e1006a22442d None admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:20.436731 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec392888-600b-4103-be0a-e1006a22442d None admin] RBAC: Adding query filter params (name=reader) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:59:20.437246 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec392888-600b-4103-be0a-e1006a22442d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:20.439003 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec392888-600b-4103-be0a-e1006a22442d None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:20.449285 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 173/347] 10.222.0.79 () {56 vars in 1101 bytes} [Tue Aug 30 00:59:20 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:59:20.450422 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec392888-600b-4103-be0a-e1006a22442d None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:20.486006 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ad0436-86c8-4028-8595-8ebe225a968a None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:20.523799 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327dac29-ae26-4719-a418-227f79cd8894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:20.524641 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327dac29-ae26-4719-a418-227f79cd8894 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:20.525056 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327dac29-ae26-4719-a418-227f79cd8894 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:20.525459 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327dac29-ae26-4719-a418-227f79cd8894 None admin] PATH_INFO: `/v3/roles` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:20.526307 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327dac29-ae26-4719-a418-227f79cd8894 None admin] RBAC: Adding query filter params (name=member) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:59:20.526970 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327dac29-ae26-4719-a418-227f79cd8894 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:20.528627 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327dac29-ae26-4719-a418-227f79cd8894 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:20.531220 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:20.540980 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 175/348] 10.222.0.79 () {56 vars in 1101 bytes} [Tue Aug 30 00:59:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:59:20.541996 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327dac29-ae26-4719-a418-227f79cd8894 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:20.568209 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec392888-600b-4103-be0a-e1006a22442d None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:20.604200 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82c9d0b-e7c2-4323-b6ec-ade0c7f9cc58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:20.605175 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82c9d0b-e7c2-4323-b6ec-ade0c7f9cc58 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:20.605627 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82c9d0b-e7c2-4323-b6ec-ade0c7f9cc58 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:20.606139 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82c9d0b-e7c2-4323-b6ec-ade0c7f9cc58 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:20.680271 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:20.727258 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327dac29-ae26-4719-a418-227f79cd8894 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:20.768184 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82c9d0b-e7c2-4323-b6ec-ade0c7f9cc58 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:20.769641 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82c9d0b-e7c2-4323-b6ec-ade0c7f9cc58 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:20.770484 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59db967-a77b-4815-9ba0-af4bb07ca76d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:20.771118 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59db967-a77b-4815-9ba0-af4bb07ca76d None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:20.771412 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59db967-a77b-4815-9ba0-af4bb07ca76d None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:20.771973 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59db967-a77b-4815-9ba0-af4bb07ca76d None admin] PATH_INFO: `/v3/users/c9fc36da82d944118656a396bdb94a01` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:20.773242 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59db967-a77b-4815-9ba0-af4bb07ca76d None admin] RBAC: Authorizing `identity:get_user(user_id=c9fc36da82d944118656a396bdb94a01)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:20.774789 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59db967-a77b-4815-9ba0-af4bb07ca76d None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:20.777877 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 176/349] 10.222.0.79 () {56 vars in 1177 bytes} [Tue Aug 30 00:59:20 2022] GET /identity/v3/users/c9fc36da82d944118656a396bdb94a01 => generated 293 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:59:20.779561 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59db967-a77b-4815-9ba0-af4bb07ca76d None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:20.864597 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:20.910399 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59db967-a77b-4815-9ba0-af4bb07ca76d None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:20.925171 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 174/350] 10.222.0.79 () {58 vars in 1282 bytes} [Tue Aug 30 00:59:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 475 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 00:59:20.926129 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82c9d0b-e7c2-4323-b6ec-ade0c7f9cc58 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:20.948968 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193f674c-b900-41c4-9d0c-e7989d1a0873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:20.949817 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193f674c-b900-41c4-9d0c-e7989d1a0873 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:20.950759 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193f674c-b900-41c4-9d0c-e7989d1a0873 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:20.951188 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193f674c-b900-41c4-9d0c-e7989d1a0873 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:21.011537 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:21.044188 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193f674c-b900-41c4-9d0c-e7989d1a0873 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:21.046388 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193f674c-b900-41c4-9d0c-e7989d1a0873 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:21.054918 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82c9d0b-e7c2-4323-b6ec-ade0c7f9cc58 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:21.098456 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546b9961-db99-4e2e-b59e-ffe8d233c280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:21.099062 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546b9961-db99-4e2e-b59e-ffe8d233c280 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:21.099434 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546b9961-db99-4e2e-b59e-ffe8d233c280 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:21.099703 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546b9961-db99-4e2e-b59e-ffe8d233c280 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:21.100435 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546b9961-db99-4e2e-b59e-ffe8d233c280 None admin] RBAC: Adding query filter params (role.id=3e9116b044314295b1dabd1b6dbcd141, user.id=c9fc36da82d944118656a396bdb94a01, scope.system=all) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:59:21.100734 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546b9961-db99-4e2e-b59e-ffe8d233c280 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:21.102746 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546b9961-db99-4e2e-b59e-ffe8d233c280 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:21.120324 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 175/351] 10.222.0.79 () {56 vars in 1308 bytes} [Tue Aug 30 00:59:20 2022] GET /identity/v3/role_assignments?user.id=c9fc36da82d944118656a396bdb94a01&scope.system=all&role.id=3e9116b044314295b1dabd1b6dbcd141 => generated 510 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:59:21.121959 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcde061f-f46c-4cbc-8aad-7679c004b26f None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:21.122436 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcde061f-f46c-4cbc-8aad-7679c004b26f None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:21.123206 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcde061f-f46c-4cbc-8aad-7679c004b26f None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:21.125042 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 176/352] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 00:59:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:59:21.126068 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcde061f-f46c-4cbc-8aad-7679c004b26f None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:21.143512 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:21.207158 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 177/353] 10.222.0.79 () {58 vars in 1282 bytes} [Tue Aug 30 00:59:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 00:59:21.207158 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193f674c-b900-41c4-9d0c-e7989d1a0873 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:21.280280 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcde061f-f46c-4cbc-8aad-7679c004b26f None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:21.317152 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:21.335921 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df3387f-aada-49e6-aee8-2dc5a4074b31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:21.336517 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df3387f-aada-49e6-aee8-2dc5a4074b31 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:21.336793 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df3387f-aada-49e6-aee8-2dc5a4074b31 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:21.337058 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df3387f-aada-49e6-aee8-2dc5a4074b31 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:21.343991 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193f674c-b900-41c4-9d0c-e7989d1a0873 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:21.348327 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df3387f-aada-49e6-aee8-2dc5a4074b31 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:59:21.353696 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-1df3387f-aada-49e6-aee8-2dc5a4074b31 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 00:59:21.353696 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:59:21.353696 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:59:21.353696 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:59:21.353696 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:59:21.353696 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:59:21.353696 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:59:21.353696 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:59:21.353696 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:59:21.353696 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:59:21.353696 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:59:21.353696 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:59:21.353696 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:59:21.353696 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:59:21.353696 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:59:21.353696 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:59:21.355960 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:59:21.355960 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:59:21.355960 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:59:21.355960 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:59:21.355960 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:59:21.355960 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:59:21.355960 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:59:21.355960 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:59:21.355960 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:59:21.355960 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:59:21.355960 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:59:21.355960 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Aug 30 00:59:21.355960 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:59:21.355960 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:59:21.355960 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:59:21.355960 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:59:21.357077 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:59:21.357077 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:59:21.357077 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:59:21.357077 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:59:21.357077 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:59:21.357077 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:59:21.357077 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:59:21.357077 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:59:21.357077 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:59:21.357077 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:59:21.357077 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 00:59:21.357077 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Aug 30 00:59:21.357077 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 177/354] 10.222.0.79 () {56 vars in 1099 bytes} [Tue Aug 30 00:59:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:59:21.357077 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb5f502-459d-4d9c-9ab7-e4b743cf5e13 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:21.357985 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb5f502-459d-4d9c-9ab7-e4b743cf5e13 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:21.357985 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb5f502-459d-4d9c-9ab7-e4b743cf5e13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:21.381372 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-fcb5f502-459d-4d9c-9ab7-e4b743cf5e13 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:59:21.383416 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-fcb5f502-459d-4d9c-9ab7-e4b743cf5e13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:59:21.388931 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e1787c-efc5-4ae5-be58-b4af47743f45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:21.389883 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e1787c-efc5-4ae5-be58-b4af47743f45 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:21.390163 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e1787c-efc5-4ae5-be58-b4af47743f45 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:21.390429 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e1787c-efc5-4ae5-be58-b4af47743f45 None admin] PATH_INFO: `/v3/projects/4ec1a052ca044bdfa9052279c09cd55c` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:21.391699 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e1787c-efc5-4ae5-be58-b4af47743f45 None admin] RBAC: Authorizing `identity:get_project(project_id=4ec1a052ca044bdfa9052279c09cd55c)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:21.393114 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e1787c-efc5-4ae5-be58-b4af47743f45 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:21.394901 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 178/355] 10.222.0.79 () {56 vars in 1186 bytes} [Tue Aug 30 00:59:21 2022] GET /identity/v3/projects/4ec1a052ca044bdfa9052279c09cd55c => generated 298 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:59:21.396989 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e1787c-efc5-4ae5-be58-b4af47743f45 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:21.438696 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:21.464233 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 178/356] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 00:59:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:59:21.465481 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101873d9-9bb8-49f2-bfaa-65d6e6c3572e None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:21.466122 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101873d9-9bb8-49f2-bfaa-65d6e6c3572e None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:21.466122 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101873d9-9bb8-49f2-bfaa-65d6e6c3572e None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:21.469858 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 179/357] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 00:59:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:59:21.469858 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101873d9-9bb8-49f2-bfaa-65d6e6c3572e None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:21.534181 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e1787c-efc5-4ae5-be58-b4af47743f45 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:21.573661 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf73408-562f-43bd-82b2-e0dff3f27fd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:21.575308 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf73408-562f-43bd-82b2-e0dff3f27fd9 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:21.575594 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf73408-562f-43bd-82b2-e0dff3f27fd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:21.576373 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf73408-562f-43bd-82b2-e0dff3f27fd9 None admin] PATH_INFO: `/v3/projects/4ec1a052ca044bdfa9052279c09cd55c` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:21.577915 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf73408-562f-43bd-82b2-e0dff3f27fd9 None admin] RBAC: Authorizing `identity:get_project(project_id=4ec1a052ca044bdfa9052279c09cd55c)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:21.579827 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf73408-562f-43bd-82b2-e0dff3f27fd9 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:21.582012 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 179/358] 10.222.0.79 () {56 vars in 1186 bytes} [Tue Aug 30 00:59:21 2022] GET /identity/v3/projects/4ec1a052ca044bdfa9052279c09cd55c => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:59:21.582749 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf73408-562f-43bd-82b2-e0dff3f27fd9 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:21.602764 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101873d9-9bb8-49f2-bfaa-65d6e6c3572e None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:21.626866 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:21.657624 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7e399e-956b-44ac-ac70-262ee3d220ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:21.658474 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7e399e-956b-44ac-ac70-262ee3d220ab None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:21.658752 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7e399e-956b-44ac-ac70-262ee3d220ab None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:21.659362 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7e399e-956b-44ac-ac70-262ee3d220ab None admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:21.660054 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7e399e-956b-44ac-ac70-262ee3d220ab None admin] RBAC: Adding query filter params (name=member) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:59:21.660619 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7e399e-956b-44ac-ac70-262ee3d220ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:21.662149 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7e399e-956b-44ac-ac70-262ee3d220ab None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:21.673269 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 180/359] 10.222.0.79 () {56 vars in 1101 bytes} [Tue Aug 30 00:59:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:59:21.674536 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3719b3de-815b-4a8f-8aaa-3dd9958a6f9f None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:21.674820 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3719b3de-815b-4a8f-8aaa-3dd9958a6f9f None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:21.675088 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3719b3de-815b-4a8f-8aaa-3dd9958a6f9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:21.699771 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-3719b3de-815b-4a8f-8aaa-3dd9958a6f9f None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:59:21.701675 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-3719b3de-815b-4a8f-8aaa-3dd9958a6f9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:59:21.722161 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf73408-562f-43bd-82b2-e0dff3f27fd9 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:21.725355 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:21.772380 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dcabbd-2c6f-4f77-ab88-138ff3150e7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:21.773025 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dcabbd-2c6f-4f77-ab88-138ff3150e7a None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:21.773295 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dcabbd-2c6f-4f77-ab88-138ff3150e7a None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:21.773567 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dcabbd-2c6f-4f77-ab88-138ff3150e7a None admin] PATH_INFO: `/v3/groups/168e483cdde449b4a20bcad575fadea9` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:21.780393 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dcabbd-2c6f-4f77-ab88-138ff3150e7a None admin] RBAC: Authorizing `identity:get_group(group_id=168e483cdde449b4a20bcad575fadea9)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:21.782334 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 181/360] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 00:59:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:59:21.782469 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dcabbd-2c6f-4f77-ab88-138ff3150e7a None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:21.782697 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3719b3de-815b-4a8f-8aaa-3dd9958a6f9f None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:21.783574 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 180/361] 10.222.0.79 () {56 vars in 1180 bytes} [Tue Aug 30 00:59:21 2022] GET /identity/v3/groups/168e483cdde449b4a20bcad575fadea9 => generated 226 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:59:21.784392 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dcabbd-2c6f-4f77-ab88-138ff3150e7a None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:21.916435 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3719b3de-815b-4a8f-8aaa-3dd9958a6f9f None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:21.931727 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:21.935601 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dcabbd-2c6f-4f77-ab88-138ff3150e7a None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:21.974059 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d8cf4f-5125-4974-88b5-0ccf5920d4a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:21.974968 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d8cf4f-5125-4974-88b5-0ccf5920d4a0 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:21.975429 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d8cf4f-5125-4974-88b5-0ccf5920d4a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:21.975892 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d8cf4f-5125-4974-88b5-0ccf5920d4a0 None admin] PATH_INFO: `/v3/groups/168e483cdde449b4a20bcad575fadea9` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:21.977527 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d8cf4f-5125-4974-88b5-0ccf5920d4a0 None admin] RBAC: Authorizing `identity:get_group(group_id=168e483cdde449b4a20bcad575fadea9)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:21.979118 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d8cf4f-5125-4974-88b5-0ccf5920d4a0 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:21.981176 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 182/362] 10.222.0.79 () {56 vars in 1180 bytes} [Tue Aug 30 00:59:21 2022] GET /identity/v3/groups/168e483cdde449b4a20bcad575fadea9 => generated 226 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:59:21.982667 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d8cf4f-5125-4974-88b5-0ccf5920d4a0 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:21.993482 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4d9687-2db0-46a7-90a7-a744bc542559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:21.993672 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4d9687-2db0-46a7-90a7-a744bc542559 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:21.994020 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4d9687-2db0-46a7-90a7-a744bc542559 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:21.994364 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4d9687-2db0-46a7-90a7-a744bc542559 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:22.038291 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:22.086926 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4d9687-2db0-46a7-90a7-a744bc542559 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:22.088584 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4d9687-2db0-46a7-90a7-a744bc542559 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:22.113702 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d8cf4f-5125-4974-88b5-0ccf5920d4a0 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:22.154040 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304f02f4-40aa-4a72-81c5-0336430974d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:22.154672 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304f02f4-40aa-4a72-81c5-0336430974d8 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:22.154948 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304f02f4-40aa-4a72-81c5-0336430974d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:22.155244 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304f02f4-40aa-4a72-81c5-0336430974d8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:22.167471 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304f02f4-40aa-4a72-81c5-0336430974d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:59:22.173385 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-304f02f4-40aa-4a72-81c5-0336430974d8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 00:59:22.173385 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:59:22.173385 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:59:22.173385 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:59:22.173385 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:59:22.173385 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:59:22.173385 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:59:22.173385 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:59:22.173385 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:59:22.173385 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:59:22.173385 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:59:22.173385 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:59:22.173385 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:59:22.173385 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:59:22.173385 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:59:22.173385 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:59:22.174421 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:59:22.174421 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:59:22.174421 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:59:22.174421 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:59:22.174421 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:59:22.174421 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:59:22.174421 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:59:22.174421 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:59:22.174421 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:59:22.174421 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:59:22.174421 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:59:22.174421 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Aug 30 00:59:22.174421 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:59:22.174421 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:59:22.174421 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:59:22.174421 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:59:22.175259 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:59:22.175259 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:59:22.175259 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:59:22.175259 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:59:22.175259 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:59:22.175259 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:59:22.175259 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:59:22.175259 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:59:22.175259 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:59:22.175259 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:59:22.175259 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 00:59:22.175259 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Aug 30 00:59:22.175259 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 183/363] 10.222.0.79 () {56 vars in 1114 bytes} [Tue Aug 30 00:59:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:59:22.175913 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304f02f4-40aa-4a72-81c5-0336430974d8 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:22.219021 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:22.221600 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 181/364] 10.222.0.79 () {58 vars in 1282 bytes} [Tue Aug 30 00:59:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 00:59:22.225232 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4d9687-2db0-46a7-90a7-a744bc542559 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:22.302484 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304f02f4-40aa-4a72-81c5-0336430974d8 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:22.306623 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:22.348119 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eca69f4-a526-4563-9021-659ff4ad4dbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:22.348119 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eca69f4-a526-4563-9021-659ff4ad4dbe None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:22.348119 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eca69f4-a526-4563-9021-659ff4ad4dbe None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:22.348119 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eca69f4-a526-4563-9021-659ff4ad4dbe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:22.348770 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eca69f4-a526-4563-9021-659ff4ad4dbe None admin] RBAC: Adding query filter params (group.id=168e483cdde449b4a20bcad575fadea9, role.id=0e24ae0a2cb9401e8f818402105e9fab, scope.project.id=4ec1a052ca044bdfa9052279c09cd55c) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:59:22.349078 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eca69f4-a526-4563-9021-659ff4ad4dbe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:22.350525 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eca69f4-a526-4563-9021-659ff4ad4dbe None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:22.353428 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4d9687-2db0-46a7-90a7-a744bc542559 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:22.356158 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 184/365] 10.222.0.79 () {56 vars in 1376 bytes} [Tue Aug 30 00:59:22 2022] GET /identity/v3/role_assignments?group.id=168e483cdde449b4a20bcad575fadea9&scope.project.id=4ec1a052ca044bdfa9052279c09cd55c&role.id=0e24ae0a2cb9401e8f818402105e9fab => generated 260 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:59:22.364080 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eca69f4-a526-4563-9021-659ff4ad4dbe None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:22.400540 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba317cb-37ec-4705-b5b5-da987cb88c2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:22.401471 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba317cb-37ec-4705-b5b5-da987cb88c2d None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:22.402045 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba317cb-37ec-4705-b5b5-da987cb88c2d None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:22.402547 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba317cb-37ec-4705-b5b5-da987cb88c2d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:22.404185 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba317cb-37ec-4705-b5b5-da987cb88c2d None admin] RBAC: Adding query filter params (group.id=168e483cdde449b4a20bcad575fadea9, role.id=c37945a17623465f899d4f217e7af593, scope.project.id=4ec1a052ca044bdfa9052279c09cd55c) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:59:22.404702 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba317cb-37ec-4705-b5b5-da987cb88c2d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:22.406437 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba317cb-37ec-4705-b5b5-da987cb88c2d None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:22.413581 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 182/366] 10.222.0.79 () {56 vars in 1376 bytes} [Tue Aug 30 00:59:22 2022] GET /identity/v3/role_assignments?group.id=168e483cdde449b4a20bcad575fadea9&scope.project.id=4ec1a052ca044bdfa9052279c09cd55c&role.id=c37945a17623465f899d4f217e7af593 => generated 260 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:59:22.414766 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba317cb-37ec-4705-b5b5-da987cb88c2d None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:22.488168 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:22.492949 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eca69f4-a526-4563-9021-659ff4ad4dbe None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:22.539778 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063f93c0-0ea8-4530-992a-fca523ae2dde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:22.540515 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063f93c0-0ea8-4530-992a-fca523ae2dde None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:22.540950 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063f93c0-0ea8-4530-992a-fca523ae2dde None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:22.541291 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063f93c0-0ea8-4530-992a-fca523ae2dde None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:22.552598 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba317cb-37ec-4705-b5b5-da987cb88c2d None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:22.554213 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063f93c0-0ea8-4530-992a-fca523ae2dde None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:59:22.560342 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-063f93c0-0ea8-4530-992a-fca523ae2dde None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:59:22.560342 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:59:22.560342 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:59:22.560342 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:59:22.560342 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:59:22.560342 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:59:22.560342 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:59:22.560342 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:59:22.560342 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:59:22.560342 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:59:22.560342 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:59:22.560342 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:59:22.560342 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:59:22.560342 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:59:22.560342 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:59:22.560342 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:59:22.561293 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:59:22.561293 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:59:22.561293 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:59:22.561293 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:59:22.561293 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:59:22.561293 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:59:22.561293 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:59:22.561293 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:59:22.561293 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:59:22.561293 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:59:22.561293 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:59:22.561293 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Aug 30 00:59:22.561293 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:59:22.561293 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:59:22.561293 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:59:22.561293 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:59:22.562119 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:59:22.562119 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:59:22.562119 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:59:22.562119 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:59:22.562119 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:59:22.562119 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:59:22.562119 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:59:22.562119 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:59:22.562119 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:59:22.562119 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:59:22.562119 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:59:22.562119 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Aug 30 00:59:22.562119 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 185/367] 10.222.0.79 () {56 vars in 1096 bytes} [Tue Aug 30 00:59:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:59:22.562768 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063f93c0-0ea8-4530-992a-fca523ae2dde None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:22.597947 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:22.605612 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22027977-5e32-47bd-882e-c1cd02561b6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:22.606308 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22027977-5e32-47bd-882e-c1cd02561b6f None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:22.606632 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22027977-5e32-47bd-882e-c1cd02561b6f None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:22.606898 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22027977-5e32-47bd-882e-c1cd02561b6f None admin] PATH_INFO: `/v3/roles` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:22.607609 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22027977-5e32-47bd-882e-c1cd02561b6f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:59:22.607906 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22027977-5e32-47bd-882e-c1cd02561b6f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:22.609297 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22027977-5e32-47bd-882e-c1cd02561b6f None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:22.620144 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 183/368] 10.222.0.79 () {56 vars in 1111 bytes} [Tue Aug 30 00:59:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:59:22.621053 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22027977-5e32-47bd-882e-c1cd02561b6f None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:22.703764 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063f93c0-0ea8-4530-992a-fca523ae2dde None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:22.753171 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad70474-1617-4b5e-8434-260a93c23372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:22.753754 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad70474-1617-4b5e-8434-260a93c23372 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:22.754027 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad70474-1617-4b5e-8434-260a93c23372 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:22.754294 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad70474-1617-4b5e-8434-260a93c23372 None admin] PATH_INFO: `/v3/projects/3350ee60742e414d945ce547675b0abd` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:22.755566 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad70474-1617-4b5e-8434-260a93c23372 None admin] RBAC: Authorizing `identity:get_project(project_id=3350ee60742e414d945ce547675b0abd)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:22.757068 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad70474-1617-4b5e-8434-260a93c23372 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:22.759081 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 186/369] 10.222.0.79 () {56 vars in 1186 bytes} [Tue Aug 30 00:59:22 2022] GET /identity/v3/projects/3350ee60742e414d945ce547675b0abd => generated 302 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:59:22.759888 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad70474-1617-4b5e-8434-260a93c23372 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:22.760239 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22027977-5e32-47bd-882e-c1cd02561b6f None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:22.798178 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:22.811440 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f10d0a-0db0-48fa-b93d-a79ba9dd9ec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:22.812055 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f10d0a-0db0-48fa-b93d-a79ba9dd9ec3 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:22.812328 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f10d0a-0db0-48fa-b93d-a79ba9dd9ec3 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:22.812592 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f10d0a-0db0-48fa-b93d-a79ba9dd9ec3 None admin] PATH_INFO: `/v3/roles` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:22.813256 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f10d0a-0db0-48fa-b93d-a79ba9dd9ec3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:59:22.813550 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f10d0a-0db0-48fa-b93d-a79ba9dd9ec3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:22.815093 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f10d0a-0db0-48fa-b93d-a79ba9dd9ec3 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:22.826718 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 184/370] 10.222.0.79 () {56 vars in 1099 bytes} [Tue Aug 30 00:59:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:59:22.827683 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f10d0a-0db0-48fa-b93d-a79ba9dd9ec3 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:22.896734 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad70474-1617-4b5e-8434-260a93c23372 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:22.902626 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:22.945744 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcd5aea-eead-4cb0-9791-d2ff3a3f8ead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:22.946373 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcd5aea-eead-4cb0-9791-d2ff3a3f8ead None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:22.946648 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcd5aea-eead-4cb0-9791-d2ff3a3f8ead None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:22.946918 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcd5aea-eead-4cb0-9791-d2ff3a3f8ead None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:22.956880 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f10d0a-0db0-48fa-b93d-a79ba9dd9ec3 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:22.993109 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1c71e1-b8fb-4e0a-b6f4-f6fd67725ff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:22.993738 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1c71e1-b8fb-4e0a-b6f4-f6fd67725ff3 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:22.994012 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1c71e1-b8fb-4e0a-b6f4-f6fd67725ff3 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:22.994279 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1c71e1-b8fb-4e0a-b6f4-f6fd67725ff3 None admin] PATH_INFO: `/v3/groups/168e483cdde449b4a20bcad575fadea9` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:22.995442 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1c71e1-b8fb-4e0a-b6f4-f6fd67725ff3 None admin] RBAC: Authorizing `identity:get_group(group_id=168e483cdde449b4a20bcad575fadea9)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:22.996931 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1c71e1-b8fb-4e0a-b6f4-f6fd67725ff3 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:23.000390 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 185/371] 10.222.0.79 () {56 vars in 1180 bytes} [Tue Aug 30 00:59:22 2022] GET /identity/v3/groups/168e483cdde449b4a20bcad575fadea9 => generated 226 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:59:23.001192 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1c71e1-b8fb-4e0a-b6f4-f6fd67725ff3 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:23.033804 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcd5aea-eead-4cb0-9791-d2ff3a3f8ead None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:23.035252 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcd5aea-eead-4cb0-9791-d2ff3a3f8ead None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:23.072337 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:23.111347 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1c71e1-b8fb-4e0a-b6f4-f6fd67725ff3 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:23.138436 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:23.154430 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fef684-43ef-4694-a8aa-480675a8e977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:23.155059 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fef684-43ef-4694-a8aa-480675a8e977 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:23.155362 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fef684-43ef-4694-a8aa-480675a8e977 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:23.155619 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fef684-43ef-4694-a8aa-480675a8e977 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:23.171021 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 187/372] 10.222.0.79 () {58 vars in 1282 bytes} [Tue Aug 30 00:59:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 00:59:23.172283 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcd5aea-eead-4cb0-9791-d2ff3a3f8ead None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:23.252509 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fef684-43ef-4694-a8aa-480675a8e977 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:23.254038 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fef684-43ef-4694-a8aa-480675a8e977 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:23.319674 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcd5aea-eead-4cb0-9791-d2ff3a3f8ead None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:23.349189 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:23.360354 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6450334-534b-467e-8700-730ea8e717a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:23.361018 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6450334-534b-467e-8700-730ea8e717a5 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:23.361292 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6450334-534b-467e-8700-730ea8e717a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:23.361603 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6450334-534b-467e-8700-730ea8e717a5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:23.362334 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6450334-534b-467e-8700-730ea8e717a5 None admin] RBAC: Adding query filter params (group.id=168e483cdde449b4a20bcad575fadea9, role.id=c37945a17623465f899d4f217e7af593, scope.project.id=3350ee60742e414d945ce547675b0abd) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:59:23.362631 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6450334-534b-467e-8700-730ea8e717a5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:23.364182 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6450334-534b-467e-8700-730ea8e717a5 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:23.371204 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 188/373] 10.222.0.79 () {56 vars in 1376 bytes} [Tue Aug 30 00:59:23 2022] GET /identity/v3/role_assignments?group.id=168e483cdde449b4a20bcad575fadea9&scope.project.id=3350ee60742e414d945ce547675b0abd&role.id=c37945a17623465f899d4f217e7af593 => generated 260 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:59:23.372133 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6450334-534b-467e-8700-730ea8e717a5 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:23.389174 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 186/374] 10.222.0.79 () {58 vars in 1282 bytes} [Tue Aug 30 00:59:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 00:59:23.396044 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fef684-43ef-4694-a8aa-480675a8e977 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:23.431646 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:23.510194 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6450334-534b-467e-8700-730ea8e717a5 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:23.529207 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fef684-43ef-4694-a8aa-480675a8e977 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:23.559459 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186e6a4f-d129-4fd4-96a9-4f530e09fc6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:23.560636 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186e6a4f-d129-4fd4-96a9-4f530e09fc6d None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:23.561180 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186e6a4f-d129-4fd4-96a9-4f530e09fc6d None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:23.561455 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186e6a4f-d129-4fd4-96a9-4f530e09fc6d None admin] PATH_INFO: `/v3/projects/3350ee60742e414d945ce547675b0abd` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:23.563362 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186e6a4f-d129-4fd4-96a9-4f530e09fc6d None admin] RBAC: Authorizing `identity:get_project(project_id=3350ee60742e414d945ce547675b0abd)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:23.565042 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186e6a4f-d129-4fd4-96a9-4f530e09fc6d None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:23.568050 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 189/375] 10.222.0.79 () {56 vars in 1186 bytes} [Tue Aug 30 00:59:23 2022] GET /identity/v3/projects/3350ee60742e414d945ce547675b0abd => generated 302 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:59:23.573324 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186e6a4f-d129-4fd4-96a9-4f530e09fc6d None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:23.588233 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab46139-8456-4099-86ab-247acf64aea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:23.588883 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab46139-8456-4099-86ab-247acf64aea5 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:23.589155 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab46139-8456-4099-86ab-247acf64aea5 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:23.589421 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab46139-8456-4099-86ab-247acf64aea5 None admin] PATH_INFO: `/v3/projects/7112c39aad764cbc9493ab829d1c571c` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:23.590624 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab46139-8456-4099-86ab-247acf64aea5 None admin] RBAC: Authorizing `identity:get_project(project_id=7112c39aad764cbc9493ab829d1c571c)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:23.592262 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab46139-8456-4099-86ab-247acf64aea5 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:23.593983 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 187/376] 10.222.0.79 () {56 vars in 1186 bytes} [Tue Aug 30 00:59:23 2022] GET /identity/v3/projects/7112c39aad764cbc9493ab829d1c571c => generated 344 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:59:23.599789 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab46139-8456-4099-86ab-247acf64aea5 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:23.676801 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:23.737429 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:23.753479 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab46139-8456-4099-86ab-247acf64aea5 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:23.760125 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186e6a4f-d129-4fd4-96a9-4f530e09fc6d None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:23.797492 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52cbb6a-99c1-47aa-95c7-9e10bf5d3cba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:23.798138 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52cbb6a-99c1-47aa-95c7-9e10bf5d3cba None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:23.798413 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52cbb6a-99c1-47aa-95c7-9e10bf5d3cba None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:23.798681 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52cbb6a-99c1-47aa-95c7-9e10bf5d3cba None admin] PATH_INFO: `/v3/groups/168e483cdde449b4a20bcad575fadea9` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:23.799881 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52cbb6a-99c1-47aa-95c7-9e10bf5d3cba None admin] RBAC: Authorizing `identity:get_group(group_id=168e483cdde449b4a20bcad575fadea9)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:23.801343 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52cbb6a-99c1-47aa-95c7-9e10bf5d3cba None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:23.803351 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 190/377] 10.222.0.79 () {56 vars in 1180 bytes} [Tue Aug 30 00:59:23 2022] GET /identity/v3/groups/168e483cdde449b4a20bcad575fadea9 => generated 226 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:59:23.809122 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52cbb6a-99c1-47aa-95c7-9e10bf5d3cba None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:23.823435 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f96dc8-0971-409d-b752-5fe9cad02b7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:23.823997 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f96dc8-0971-409d-b752-5fe9cad02b7e None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:23.824271 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f96dc8-0971-409d-b752-5fe9cad02b7e None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:23.824544 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f96dc8-0971-409d-b752-5fe9cad02b7e None admin] PATH_INFO: `/v3/groups/df6d90fa648749fa9a8f951c57c3015d` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:23.834685 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f96dc8-0971-409d-b752-5fe9cad02b7e None admin] RBAC: Authorizing `identity:get_group(group_id=df6d90fa648749fa9a8f951c57c3015d)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:23.836169 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f96dc8-0971-409d-b752-5fe9cad02b7e None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:23.838335 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 188/378] 10.222.0.79 () {56 vars in 1180 bytes} [Tue Aug 30 00:59:23 2022] GET /identity/v3/groups/df6d90fa648749fa9a8f951c57c3015d => generated 229 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:59:23.844124 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f96dc8-0971-409d-b752-5fe9cad02b7e None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:23.919724 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52cbb6a-99c1-47aa-95c7-9e10bf5d3cba None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:23.955553 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:23.960312 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a544517b-6d8f-40a3-8eb4-623cd7a7da7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:23.961023 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a544517b-6d8f-40a3-8eb4-623cd7a7da7d None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:23.961299 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a544517b-6d8f-40a3-8eb4-623cd7a7da7d None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:23.961567 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a544517b-6d8f-40a3-8eb4-623cd7a7da7d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:23.962296 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a544517b-6d8f-40a3-8eb4-623cd7a7da7d None admin] RBAC: Adding query filter params (group.id=168e483cdde449b4a20bcad575fadea9, role.id=0e24ae0a2cb9401e8f818402105e9fab, scope.project.id=3350ee60742e414d945ce547675b0abd) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:59:23.962599 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a544517b-6d8f-40a3-8eb4-623cd7a7da7d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:23.964181 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a544517b-6d8f-40a3-8eb4-623cd7a7da7d None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:23.972169 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 191/379] 10.222.0.79 () {56 vars in 1376 bytes} [Tue Aug 30 00:59:23 2022] GET /identity/v3/role_assignments?group.id=168e483cdde449b4a20bcad575fadea9&scope.project.id=3350ee60742e414d945ce547675b0abd&role.id=0e24ae0a2cb9401e8f818402105e9fab => generated 260 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:59:24.014016 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f96dc8-0971-409d-b752-5fe9cad02b7e None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:24.065832 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f77ee15-7e0d-4d34-bcb2-ee6d7434d757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:24.066704 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f77ee15-7e0d-4d34-bcb2-ee6d7434d757 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:24.066977 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f77ee15-7e0d-4d34-bcb2-ee6d7434d757 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:24.067268 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f77ee15-7e0d-4d34-bcb2-ee6d7434d757 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:24.068135 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f77ee15-7e0d-4d34-bcb2-ee6d7434d757 None admin] RBAC: Adding query filter params (group.id=df6d90fa648749fa9a8f951c57c3015d, role.id=d14c3070c9184d76a7b23df69bd3db07, scope.project.id=7112c39aad764cbc9493ab829d1c571c) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:59:24.068436 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f77ee15-7e0d-4d34-bcb2-ee6d7434d757 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:24.069946 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f77ee15-7e0d-4d34-bcb2-ee6d7434d757 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:24.080099 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 189/380] 10.222.0.79 () {56 vars in 1376 bytes} [Tue Aug 30 00:59:23 2022] GET /identity/v3/role_assignments?group.id=df6d90fa648749fa9a8f951c57c3015d&scope.project.id=7112c39aad764cbc9493ab829d1c571c&role.id=d14c3070c9184d76a7b23df69bd3db07 => generated 260 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:59:24.823868 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bcaa0d-7a2c-4ce8-a9f3-68f2e5ed4cd0 None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:24.824391 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bcaa0d-7a2c-4ce8-a9f3-68f2e5ed4cd0 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:24.824391 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bcaa0d-7a2c-4ce8-a9f3-68f2e5ed4cd0 None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:24.826231 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 192/381] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 00:59:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:59:24.841001 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab7f2e6-ea7f-4737-9288-a7b0425c13aa None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:24.841001 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab7f2e6-ea7f-4737-9288-a7b0425c13aa None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:24.841001 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab7f2e6-ea7f-4737-9288-a7b0425c13aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:24.862566 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-5ab7f2e6-ea7f-4737-9288-a7b0425c13aa None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:59:24.864158 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-5ab7f2e6-ea7f-4737-9288-a7b0425c13aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:59:24.873090 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f0cb2e-3cd1-4d91-94cf-af11de156faa None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:24.873747 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f0cb2e-3cd1-4d91-94cf-af11de156faa None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:24.874210 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f0cb2e-3cd1-4d91-94cf-af11de156faa None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:24.876001 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 193/382] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 00:59:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:59:24.881379 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63418751-10c4-4738-8557-740e149a1ffb None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:24.881947 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63418751-10c4-4738-8557-740e149a1ffb None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:24.882410 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63418751-10c4-4738-8557-740e149a1ffb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:24.884610 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:24.904322 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-63418751-10c4-4738-8557-740e149a1ffb None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:59:24.905944 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-63418751-10c4-4738-8557-740e149a1ffb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:59:24.968493 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 190/383] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 00:59:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:59:25.017951 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 194/384] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 00:59:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:59:25.313493 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab7f2e6-ea7f-4737-9288-a7b0425c13aa None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:25.367778 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63418751-10c4-4738-8557-740e149a1ffb None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:25.436045 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab7f2e6-ea7f-4737-9288-a7b0425c13aa None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:25.475769 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c18aeee-9bce-4f80-b81e-b18930d17689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:25.476638 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c18aeee-9bce-4f80-b81e-b18930d17689 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:25.477052 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c18aeee-9bce-4f80-b81e-b18930d17689 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:25.477452 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c18aeee-9bce-4f80-b81e-b18930d17689 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:25.489251 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c18aeee-9bce-4f80-b81e-b18930d17689 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:59:25.494426 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application [None req-8c18aeee-9bce-4f80-b81e-b18930d17689 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 00:59:25.494426 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:59:25.494426 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:59:25.494426 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:59:25.494426 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:59:25.494426 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:59:25.494426 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:59:25.494426 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:59:25.494426 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:59:25.494426 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:59:25.494426 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:59:25.494426 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:59:25.494426 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:59:25.494426 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:59:25.494426 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:59:25.494426 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:59:25.495299 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:59:25.495299 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:59:25.495299 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:59:25.495299 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:59:25.495299 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:59:25.495299 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:59:25.495299 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:59:25.495299 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:59:25.495299 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:59:25.495299 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:59:25.495299 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:59:25.495299 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application with Lock( Aug 30 00:59:25.495299 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:59:25.495299 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:59:25.495299 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:59:25.495299 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:59:25.496097 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:59:25.496097 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:59:25.496097 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:59:25.496097 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:59:25.496097 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:59:25.496097 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:59:25.496097 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:59:25.496097 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:59:25.496097 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:59:25.496097 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:59:25.496097 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 00:59:25.496097 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Aug 30 00:59:25.499218 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 191/385] 10.222.0.79 () {56 vars in 1099 bytes} [Tue Aug 30 00:59:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:59:25.505037 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c18aeee-9bce-4f80-b81e-b18930d17689 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:25.517930 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:25.601958 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63418751-10c4-4738-8557-740e149a1ffb None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:25.643454 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c18aeee-9bce-4f80-b81e-b18930d17689 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:25.649249 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:25.667082 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc136f8d-489b-46bf-8e83-c27738bd4c60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:25.668088 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc136f8d-489b-46bf-8e83-c27738bd4c60 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:25.668591 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc136f8d-489b-46bf-8e83-c27738bd4c60 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:25.669109 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc136f8d-489b-46bf-8e83-c27738bd4c60 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:25.679967 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc136f8d-489b-46bf-8e83-c27738bd4c60 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:59:25.685214 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-bc136f8d-489b-46bf-8e83-c27738bd4c60 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 00:59:25.685214 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:59:25.685214 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:59:25.685214 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:59:25.685214 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:59:25.685214 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:59:25.685214 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:59:25.685214 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:59:25.685214 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:59:25.685214 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:59:25.685214 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:59:25.685214 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:59:25.685214 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:59:25.685214 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:59:25.685214 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:59:25.685214 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:59:25.686175 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:59:25.686175 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:59:25.686175 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:59:25.686175 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:59:25.686175 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:59:25.686175 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:59:25.686175 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:59:25.686175 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:59:25.686175 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:59:25.686175 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:59:25.686175 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:59:25.686175 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Aug 30 00:59:25.686175 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:59:25.686175 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:59:25.686175 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:59:25.686175 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:59:25.686949 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:59:25.686949 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:59:25.686949 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:59:25.686949 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:59:25.686949 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:59:25.686949 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:59:25.686949 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:59:25.686949 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:59:25.686949 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:59:25.686949 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:59:25.686949 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 00:59:25.686949 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Aug 30 00:59:25.689691 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 195/386] 10.222.0.79 () {56 vars in 1114 bytes} [Tue Aug 30 00:59:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:59:25.696696 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc136f8d-489b-46bf-8e83-c27738bd4c60 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:25.735214 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7376a6e7-1540-4216-b16c-7189c32e1d63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:25.735831 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7376a6e7-1540-4216-b16c-7189c32e1d63 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:25.736109 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7376a6e7-1540-4216-b16c-7189c32e1d63 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:25.736377 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7376a6e7-1540-4216-b16c-7189c32e1d63 None admin] PATH_INFO: `/v3/roles` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:25.737047 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7376a6e7-1540-4216-b16c-7189c32e1d63 None admin] RBAC: Adding query filter params (name=member) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:59:25.737345 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7376a6e7-1540-4216-b16c-7189c32e1d63 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:25.738726 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7376a6e7-1540-4216-b16c-7189c32e1d63 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:25.749528 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 192/387] 10.222.0.79 () {56 vars in 1101 bytes} [Tue Aug 30 00:59:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:59:25.755348 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7376a6e7-1540-4216-b16c-7189c32e1d63 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:25.880254 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc136f8d-489b-46bf-8e83-c27738bd4c60 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:25.891729 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:25.921832 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6416a7a9-2176-415a-bcc5-6b704da203d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:25.922804 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6416a7a9-2176-415a-bcc5-6b704da203d6 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:25.923304 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6416a7a9-2176-415a-bcc5-6b704da203d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:25.923843 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6416a7a9-2176-415a-bcc5-6b704da203d6 None admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:25.924704 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6416a7a9-2176-415a-bcc5-6b704da203d6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:59:25.925190 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6416a7a9-2176-415a-bcc5-6b704da203d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:25.926784 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6416a7a9-2176-415a-bcc5-6b704da203d6 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:25.929142 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7376a6e7-1540-4216-b16c-7189c32e1d63 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:25.936818 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 196/388] 10.222.0.79 () {56 vars in 1111 bytes} [Tue Aug 30 00:59:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:59:25.938342 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39710371-2773-4909-80c2-310a4dad16d7 None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:25.938839 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39710371-2773-4909-80c2-310a4dad16d7 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:25.939388 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39710371-2773-4909-80c2-310a4dad16d7 None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:25.945673 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 197/389] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 00:59:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:59:25.946800 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39710371-2773-4909-80c2-310a4dad16d7 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:25.978096 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3705fe-d605-4ec2-8512-b960282225a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:25.979250 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3705fe-d605-4ec2-8512-b960282225a8 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:25.979740 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3705fe-d605-4ec2-8512-b960282225a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:25.980211 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3705fe-d605-4ec2-8512-b960282225a8 None admin] PATH_INFO: `/v3/groups/168e483cdde449b4a20bcad575fadea9` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:25.981732 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3705fe-d605-4ec2-8512-b960282225a8 None admin] RBAC: Authorizing `identity:get_group(group_id=168e483cdde449b4a20bcad575fadea9)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:25.983504 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3705fe-d605-4ec2-8512-b960282225a8 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:25.990249 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 193/390] 10.222.0.79 () {56 vars in 1180 bytes} [Tue Aug 30 00:59:25 2022] GET /identity/v3/groups/168e483cdde449b4a20bcad575fadea9 => generated 226 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:59:25.992004 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053682ff-52c7-48ff-97cb-77c1de83226e None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:25.992482 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053682ff-52c7-48ff-97cb-77c1de83226e None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:25.993038 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053682ff-52c7-48ff-97cb-77c1de83226e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:26.000030 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:26.020352 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-053682ff-52c7-48ff-97cb-77c1de83226e None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:59:26.022662 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-053682ff-52c7-48ff-97cb-77c1de83226e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:59:26.073466 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39710371-2773-4909-80c2-310a4dad16d7 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:26.119153 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 194/391] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 00:59:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:59:26.119153 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053682ff-52c7-48ff-97cb-77c1de83226e None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:26.124830 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a1875f-43ee-43e8-9bcd-5d8684b55653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:26.125757 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a1875f-43ee-43e8-9bcd-5d8684b55653 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:26.126282 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a1875f-43ee-43e8-9bcd-5d8684b55653 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:26.126758 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a1875f-43ee-43e8-9bcd-5d8684b55653 None admin] PATH_INFO: `/v3/groups/168e483cdde449b4a20bcad575fadea9` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:26.131819 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a1875f-43ee-43e8-9bcd-5d8684b55653 None admin] RBAC: Authorizing `identity:get_group(group_id=168e483cdde449b4a20bcad575fadea9)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:26.133550 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a1875f-43ee-43e8-9bcd-5d8684b55653 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:26.135670 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 198/392] 10.222.0.79 () {56 vars in 1180 bytes} [Tue Aug 30 00:59:25 2022] GET /identity/v3/groups/168e483cdde449b4a20bcad575fadea9 => generated 226 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:59:26.142474 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a1875f-43ee-43e8-9bcd-5d8684b55653 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:26.194187 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:26.245418 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053682ff-52c7-48ff-97cb-77c1de83226e None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:26.292845 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8d0fe6-59a8-4992-9a59-0f46c40206ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:26.293730 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8d0fe6-59a8-4992-9a59-0f46c40206ce None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:26.294686 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8d0fe6-59a8-4992-9a59-0f46c40206ce None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:26.295396 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8d0fe6-59a8-4992-9a59-0f46c40206ce None admin] PATH_INFO: `/v3/projects/4ec1a052ca044bdfa9052279c09cd55c` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:26.299945 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8d0fe6-59a8-4992-9a59-0f46c40206ce None admin] RBAC: Authorizing `identity:get_project(project_id=4ec1a052ca044bdfa9052279c09cd55c)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:26.301589 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8d0fe6-59a8-4992-9a59-0f46c40206ce None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:26.303742 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 195/393] 10.222.0.79 () {56 vars in 1186 bytes} [Tue Aug 30 00:59:26 2022] GET /identity/v3/projects/4ec1a052ca044bdfa9052279c09cd55c => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:59:26.311808 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8d0fe6-59a8-4992-9a59-0f46c40206ce None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:26.318055 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a1875f-43ee-43e8-9bcd-5d8684b55653 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:26.332315 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:26.356033 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542e23e1-93e1-4453-9792-b9bcc70639fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:26.357291 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542e23e1-93e1-4453-9792-b9bcc70639fe None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:26.357661 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542e23e1-93e1-4453-9792-b9bcc70639fe None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:26.358029 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542e23e1-93e1-4453-9792-b9bcc70639fe None admin] PATH_INFO: `/v3/projects/4ec1a052ca044bdfa9052279c09cd55c` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:26.363179 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542e23e1-93e1-4453-9792-b9bcc70639fe None admin] RBAC: Authorizing `identity:get_project(project_id=4ec1a052ca044bdfa9052279c09cd55c)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:26.363179 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542e23e1-93e1-4453-9792-b9bcc70639fe None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:26.363179 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 199/394] 10.222.0.79 () {56 vars in 1186 bytes} [Tue Aug 30 00:59:26 2022] GET /identity/v3/projects/4ec1a052ca044bdfa9052279c09cd55c => generated 298 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:59:26.371150 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542e23e1-93e1-4453-9792-b9bcc70639fe None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:26.477675 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8d0fe6-59a8-4992-9a59-0f46c40206ce None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:26.508523 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542e23e1-93e1-4453-9792-b9bcc70639fe None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:26.526964 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df707575-93a0-4240-91c1-ed5297405c12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:26.527995 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df707575-93a0-4240-91c1-ed5297405c12 None admin] REQUEST_METHOD: `PUT` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:26.528313 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df707575-93a0-4240-91c1-ed5297405c12 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:26.528598 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df707575-93a0-4240-91c1-ed5297405c12 None admin] PATH_INFO: `/v3/projects/4ec1a052ca044bdfa9052279c09cd55c/groups/168e483cdde449b4a20bcad575fadea9/roles/c37945a17623465f899d4f217e7af593` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:26.531274 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df707575-93a0-4240-91c1-ed5297405c12 None admin] RBAC: Authorizing `identity:create_grant(project_id=4ec1a052ca044bdfa9052279c09cd55c, group_id=168e483cdde449b4a20bcad575fadea9, role_id=c37945a17623465f899d4f217e7af593)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:26.533271 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df707575-93a0-4240-91c1-ed5297405c12 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:26.538009 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:26.547275 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83140fd-1f2a-46c1-b7df-ef0f27ddfc7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:26.547899 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83140fd-1f2a-46c1-b7df-ef0f27ddfc7c None admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:26.548183 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83140fd-1f2a-46c1-b7df-ef0f27ddfc7c None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:26.548455 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83140fd-1f2a-46c1-b7df-ef0f27ddfc7c None admin] PATH_INFO: `/v3/projects/4ec1a052ca044bdfa9052279c09cd55c/groups/168e483cdde449b4a20bcad575fadea9/roles/0e24ae0a2cb9401e8f818402105e9fab` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:26.550646 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83140fd-1f2a-46c1-b7df-ef0f27ddfc7c None admin] RBAC: Authorizing `identity:create_grant(project_id=4ec1a052ca044bdfa9052279c09cd55c, group_id=168e483cdde449b4a20bcad575fadea9, role_id=0e24ae0a2cb9401e8f818402105e9fab)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:26.552104 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83140fd-1f2a-46c1-b7df-ef0f27ddfc7c None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:26.552367 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 196/395] 10.222.0.79 () {58 vars in 1442 bytes} [Tue Aug 30 00:59:26 2022] PUT /identity/v3/projects/4ec1a052ca044bdfa9052279c09cd55c/groups/168e483cdde449b4a20bcad575fadea9/roles/c37945a17623465f899d4f217e7af593 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:59:26.553644 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661df4a2-d090-46ae-94e4-35001a4d0a78 None None] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:26.553926 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661df4a2-d090-46ae-94e4-35001a4d0a78 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:26.554195 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661df4a2-d090-46ae-94e4-35001a4d0a78 None None] PATH_INFO: `/` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:26.555445 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 197/396] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 00:59:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:59:26.556162 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661df4a2-d090-46ae-94e4-35001a4d0a78 None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:26.578305 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 200/397] 10.222.0.79 () {58 vars in 1442 bytes} [Tue Aug 30 00:59:26 2022] PUT /identity/v3/projects/4ec1a052ca044bdfa9052279c09cd55c/groups/168e483cdde449b4a20bcad575fadea9/roles/0e24ae0a2cb9401e8f818402105e9fab => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:59:26.579479 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e52a401-ee66-4fed-9049-218a0d4f3d3a None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:26.579762 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e52a401-ee66-4fed-9049-218a0d4f3d3a None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:26.580030 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e52a401-ee66-4fed-9049-218a0d4f3d3a None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:26.581520 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 201/398] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 00:59:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:59:26.582432 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f84e661-ba3f-4a45-b5aa-9cea57bad6d4 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:26.582767 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f84e661-ba3f-4a45-b5aa-9cea57bad6d4 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:26.583099 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f84e661-ba3f-4a45-b5aa-9cea57bad6d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:26.603494 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-0f84e661-ba3f-4a45-b5aa-9cea57bad6d4 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:59:26.604754 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-0f84e661-ba3f-4a45-b5aa-9cea57bad6d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:59:26.651534 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:26.701009 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 202/399] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 00:59:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:59:26.703092 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98978c1-8691-475c-bb1c-5ec3ea9b8e18 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:26.703539 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98978c1-8691-475c-bb1c-5ec3ea9b8e18 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:26.708277 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98978c1-8691-475c-bb1c-5ec3ea9b8e18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:26.718933 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661df4a2-d090-46ae-94e4-35001a4d0a78 None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:26.750458 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-f98978c1-8691-475c-bb1c-5ec3ea9b8e18 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:59:26.752067 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-f98978c1-8691-475c-bb1c-5ec3ea9b8e18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:59:26.775342 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba21c66-3879-4657-aa80-2bf2daf9209d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:26.775542 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba21c66-3879-4657-aa80-2bf2daf9209d None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:26.775867 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba21c66-3879-4657-aa80-2bf2daf9209d None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:26.776043 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba21c66-3879-4657-aa80-2bf2daf9209d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:26.791212 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba21c66-3879-4657-aa80-2bf2daf9209d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:59:26.797926 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application [None req-0ba21c66-3879-4657-aa80-2bf2daf9209d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 00:59:26.797926 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:59:26.797926 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:59:26.797926 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:59:26.797926 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:59:26.797926 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:59:26.797926 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:59:26.797926 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:59:26.797926 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:59:26.797926 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:59:26.797926 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:59:26.797926 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:59:26.797926 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:59:26.797926 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:59:26.797926 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:59:26.797926 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:59:26.799228 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:59:26.799228 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:59:26.799228 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:59:26.799228 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:59:26.799228 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:59:26.799228 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:59:26.799228 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:59:26.799228 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:59:26.799228 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:59:26.799228 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:59:26.799228 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:59:26.799228 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application with Lock( Aug 30 00:59:26.799228 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:59:26.799228 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:59:26.799228 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:59:26.799228 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:59:26.800267 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:59:26.800267 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:59:26.800267 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:59:26.800267 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:59:26.800267 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:59:26.800267 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:59:26.800267 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:59:26.800267 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:59:26.800267 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:59:26.800267 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:59:26.800267 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 00:59:26.800267 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Aug 30 00:59:26.801969 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 198/400] 10.222.0.79 () {56 vars in 1099 bytes} [Tue Aug 30 00:59:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:59:26.807283 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba21c66-3879-4657-aa80-2bf2daf9209d None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:26.843361 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 203/401] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 00:59:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:59:26.873653 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:26.934200 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba21c66-3879-4657-aa80-2bf2daf9209d None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:26.979174 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d36b3c-7050-4c92-94e7-44779d674bc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:26.979786 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d36b3c-7050-4c92-94e7-44779d674bc1 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:26.980058 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d36b3c-7050-4c92-94e7-44779d674bc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:26.980321 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d36b3c-7050-4c92-94e7-44779d674bc1 None admin] PATH_INFO: `/v3/roles` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:26.980982 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d36b3c-7050-4c92-94e7-44779d674bc1 None admin] RBAC: Adding query filter params (name=member) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:59:26.981278 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d36b3c-7050-4c92-94e7-44779d674bc1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:26.983306 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d36b3c-7050-4c92-94e7-44779d674bc1 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:26.998657 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 199/402] 10.222.0.79 () {56 vars in 1101 bytes} [Tue Aug 30 00:59:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:59:27.001174 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98978c1-8691-475c-bb1c-5ec3ea9b8e18 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:27.120938 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:27.127687 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98978c1-8691-475c-bb1c-5ec3ea9b8e18 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:27.143426 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d36b3c-7050-4c92-94e7-44779d674bc1 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:27.171791 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35baa3e5-5a65-4e87-a200-20b7f0098428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:27.172434 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35baa3e5-5a65-4e87-a200-20b7f0098428 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:27.172702 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35baa3e5-5a65-4e87-a200-20b7f0098428 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:27.172981 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35baa3e5-5a65-4e87-a200-20b7f0098428 None admin] PATH_INFO: `/v3/groups/168e483cdde449b4a20bcad575fadea9` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:27.174210 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35baa3e5-5a65-4e87-a200-20b7f0098428 None admin] RBAC: Authorizing `identity:get_group(group_id=168e483cdde449b4a20bcad575fadea9)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:27.176657 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35baa3e5-5a65-4e87-a200-20b7f0098428 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:27.181812 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 204/403] 10.222.0.79 () {56 vars in 1180 bytes} [Tue Aug 30 00:59:27 2022] GET /identity/v3/groups/168e483cdde449b4a20bcad575fadea9 => generated 226 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:59:27.183706 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35baa3e5-5a65-4e87-a200-20b7f0098428 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:27.281962 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d36b3c-7050-4c92-94e7-44779d674bc1 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:27.301510 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:27.322993 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168cfe07-15ec-47cd-b1da-f8d14443048b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:27.324081 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168cfe07-15ec-47cd-b1da-f8d14443048b None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:27.324562 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168cfe07-15ec-47cd-b1da-f8d14443048b None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:27.325035 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168cfe07-15ec-47cd-b1da-f8d14443048b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:27.326196 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35baa3e5-5a65-4e87-a200-20b7f0098428 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:27.337039 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168cfe07-15ec-47cd-b1da-f8d14443048b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:59:27.344482 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application [None req-168cfe07-15ec-47cd-b1da-f8d14443048b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:59:27.344482 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:59:27.344482 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:59:27.344482 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:59:27.344482 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:59:27.344482 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:59:27.344482 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:59:27.344482 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:59:27.344482 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:59:27.344482 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:59:27.344482 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:59:27.344482 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:59:27.344482 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:59:27.344482 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:59:27.344482 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:59:27.344482 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:59:27.345418 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:59:27.345418 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:59:27.345418 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:59:27.345418 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:59:27.345418 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:59:27.345418 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:59:27.345418 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:59:27.345418 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:59:27.345418 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:59:27.345418 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:59:27.345418 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:59:27.345418 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application with Lock( Aug 30 00:59:27.345418 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:59:27.345418 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:59:27.345418 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:59:27.345418 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:59:27.346213 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:59:27.346213 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:59:27.346213 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:59:27.346213 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:59:27.346213 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:59:27.346213 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:59:27.346213 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:59:27.346213 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:59:27.346213 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:59:27.346213 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:59:27.346213 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:59:27.346213 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Aug 30 00:59:27.348810 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 200/404] 10.222.0.79 () {56 vars in 1096 bytes} [Tue Aug 30 00:59:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 00:59:27.351945 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168cfe07-15ec-47cd-b1da-f8d14443048b None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:27.370565 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b80787-4646-4d9b-8ae2-e83ae61f50e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:27.371302 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b80787-4646-4d9b-8ae2-e83ae61f50e2 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:27.371515 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b80787-4646-4d9b-8ae2-e83ae61f50e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:27.371784 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b80787-4646-4d9b-8ae2-e83ae61f50e2 None admin] PATH_INFO: `/v3/projects/3350ee60742e414d945ce547675b0abd` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:27.372998 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b80787-4646-4d9b-8ae2-e83ae61f50e2 None admin] RBAC: Authorizing `identity:get_project(project_id=3350ee60742e414d945ce547675b0abd)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:27.374422 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b80787-4646-4d9b-8ae2-e83ae61f50e2 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:27.376476 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 205/405] 10.222.0.79 () {56 vars in 1186 bytes} [Tue Aug 30 00:59:27 2022] GET /identity/v3/projects/3350ee60742e414d945ce547675b0abd => generated 302 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:59:27.377364 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b80787-4646-4d9b-8ae2-e83ae61f50e2 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:27.413349 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:27.469456 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168cfe07-15ec-47cd-b1da-f8d14443048b None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:27.482495 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b80787-4646-4d9b-8ae2-e83ae61f50e2 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:27.506885 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3f3341-d5b8-4032-8d76-b2840f246097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:27.508018 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3f3341-d5b8-4032-8d76-b2840f246097 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:27.508489 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3f3341-d5b8-4032-8d76-b2840f246097 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:27.509015 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3f3341-d5b8-4032-8d76-b2840f246097 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:27.518616 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00871e71-b2d3-42c3-a787-978855a15aa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:27.519249 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00871e71-b2d3-42c3-a787-978855a15aa3 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:27.519529 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00871e71-b2d3-42c3-a787-978855a15aa3 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:27.519798 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00871e71-b2d3-42c3-a787-978855a15aa3 None admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:27.520459 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00871e71-b2d3-42c3-a787-978855a15aa3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:59:27.520758 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00871e71-b2d3-42c3-a787-978855a15aa3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:27.522127 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00871e71-b2d3-42c3-a787-978855a15aa3 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:27.523238 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3f3341-d5b8-4032-8d76-b2840f246097 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:59:27.529397 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application [None req-eb3f3341-d5b8-4032-8d76-b2840f246097 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 00:59:27.529397 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:59:27.529397 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:59:27.529397 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:59:27.529397 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:59:27.529397 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:59:27.529397 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:59:27.529397 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:59:27.529397 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:59:27.529397 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:59:27.529397 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:59:27.529397 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:59:27.529397 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:59:27.529397 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:59:27.529397 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:59:27.529397 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:59:27.530293 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:59:27.530293 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:59:27.530293 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:59:27.530293 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:59:27.530293 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:59:27.530293 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:59:27.530293 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:59:27.530293 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:59:27.530293 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:59:27.530293 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:59:27.530293 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:59:27.530293 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application with Lock( Aug 30 00:59:27.530293 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:59:27.530293 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:59:27.530293 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:59:27.530293 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:59:27.531075 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:59:27.531075 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:59:27.531075 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:59:27.531075 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:59:27.531075 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:59:27.531075 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:59:27.531075 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:59:27.531075 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:59:27.531075 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:59:27.531075 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:59:27.531075 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 00:59:27.531075 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Aug 30 00:59:27.531718 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 206/406] 10.222.0.79 () {56 vars in 1099 bytes} [Tue Aug 30 00:59:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:59:27.532273 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00871e71-b2d3-42c3-a787-978855a15aa3 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:27.538626 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 201/407] 10.222.0.79 () {56 vars in 1114 bytes} [Tue Aug 30 00:59:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:59:27.539825 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3f3341-d5b8-4032-8d76-b2840f246097 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:27.582426 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:27.633757 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:27.639252 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00871e71-b2d3-42c3-a787-978855a15aa3 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:27.649624 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3f3341-d5b8-4032-8d76-b2840f246097 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:27.675646 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792a234a-e1a0-452e-afd4-1269bd83015b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:27.676310 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792a234a-e1a0-452e-afd4-1269bd83015b None admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:27.676589 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792a234a-e1a0-452e-afd4-1269bd83015b None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:27.676862 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792a234a-e1a0-452e-afd4-1269bd83015b None admin] PATH_INFO: `/v3/projects/3350ee60742e414d945ce547675b0abd/groups/168e483cdde449b4a20bcad575fadea9/roles/c37945a17623465f899d4f217e7af593` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:27.678868 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792a234a-e1a0-452e-afd4-1269bd83015b None admin] RBAC: Authorizing `identity:create_grant(project_id=3350ee60742e414d945ce547675b0abd, group_id=168e483cdde449b4a20bcad575fadea9, role_id=c37945a17623465f899d4f217e7af593)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:27.680319 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792a234a-e1a0-452e-afd4-1269bd83015b None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:27.690949 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7137a859-bf5a-492b-82f1-722f75014a68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:27.692314 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7137a859-bf5a-492b-82f1-722f75014a68 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:27.692845 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7137a859-bf5a-492b-82f1-722f75014a68 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:27.693321 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7137a859-bf5a-492b-82f1-722f75014a68 None admin] PATH_INFO: `/v3/groups/df6d90fa648749fa9a8f951c57c3015d` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:27.694749 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7137a859-bf5a-492b-82f1-722f75014a68 None admin] RBAC: Authorizing `identity:get_group(group_id=df6d90fa648749fa9a8f951c57c3015d)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:27.695396 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 207/408] 10.222.0.79 () {58 vars in 1442 bytes} [Tue Aug 30 00:59:27 2022] PUT /identity/v3/projects/3350ee60742e414d945ce547675b0abd/groups/168e483cdde449b4a20bcad575fadea9/roles/c37945a17623465f899d4f217e7af593 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:59:27.696381 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792a234a-e1a0-452e-afd4-1269bd83015b None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:27.697217 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7137a859-bf5a-492b-82f1-722f75014a68 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:27.699540 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 202/409] 10.222.0.79 () {56 vars in 1180 bytes} [Tue Aug 30 00:59:27 2022] GET /identity/v3/groups/df6d90fa648749fa9a8f951c57c3015d => generated 229 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:59:27.712553 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7137a859-bf5a-492b-82f1-722f75014a68 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:27.884486 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792a234a-e1a0-452e-afd4-1269bd83015b None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:27.905570 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7137a859-bf5a-492b-82f1-722f75014a68 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:27.914355 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:27.932197 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef2bf0a-1e2f-4bca-818d-240ab08ac555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:27.932811 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef2bf0a-1e2f-4bca-818d-240ab08ac555 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:27.933088 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef2bf0a-1e2f-4bca-818d-240ab08ac555 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:27.933360 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef2bf0a-1e2f-4bca-818d-240ab08ac555 None admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:27.934100 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef2bf0a-1e2f-4bca-818d-240ab08ac555 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:59:27.934401 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef2bf0a-1e2f-4bca-818d-240ab08ac555 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:27.936867 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef2bf0a-1e2f-4bca-818d-240ab08ac555 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:27.945942 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 208/410] 10.222.0.79 () {56 vars in 1111 bytes} [Tue Aug 30 00:59:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:59:27.951704 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef2bf0a-1e2f-4bca-818d-240ab08ac555 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:27.967507 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492ccd76-2adb-4527-b044-2b4559fa1483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:27.968208 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492ccd76-2adb-4527-b044-2b4559fa1483 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:27.968494 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492ccd76-2adb-4527-b044-2b4559fa1483 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:27.968770 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492ccd76-2adb-4527-b044-2b4559fa1483 None admin] PATH_INFO: `/v3/projects/7112c39aad764cbc9493ab829d1c571c` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:27.970140 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492ccd76-2adb-4527-b044-2b4559fa1483 None admin] RBAC: Authorizing `identity:get_project(project_id=7112c39aad764cbc9493ab829d1c571c)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:27.973238 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492ccd76-2adb-4527-b044-2b4559fa1483 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:27.974884 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 203/411] 10.222.0.79 () {56 vars in 1186 bytes} [Tue Aug 30 00:59:27 2022] GET /identity/v3/projects/7112c39aad764cbc9493ab829d1c571c => generated 344 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:59:27.983407 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492ccd76-2adb-4527-b044-2b4559fa1483 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:27.999522 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:28.099552 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef2bf0a-1e2f-4bca-818d-240ab08ac555 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:28.155713 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b28fed-1949-4416-86ab-250a957fadc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:28.156371 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b28fed-1949-4416-86ab-250a957fadc7 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:28.156971 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b28fed-1949-4416-86ab-250a957fadc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:28.157252 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b28fed-1949-4416-86ab-250a957fadc7 None admin] PATH_INFO: `/v3/groups/168e483cdde449b4a20bcad575fadea9` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:28.158493 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b28fed-1949-4416-86ab-250a957fadc7 None admin] RBAC: Authorizing `identity:get_group(group_id=168e483cdde449b4a20bcad575fadea9)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:28.162480 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b28fed-1949-4416-86ab-250a957fadc7 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:28.164465 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 209/412] 10.222.0.79 () {56 vars in 1180 bytes} [Tue Aug 30 00:59:27 2022] GET /identity/v3/groups/168e483cdde449b4a20bcad575fadea9 => generated 226 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:59:28.170657 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b28fed-1949-4416-86ab-250a957fadc7 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:28.185700 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492ccd76-2adb-4527-b044-2b4559fa1483 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:28.252778 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319dc0ab-40c8-46ef-992d-9d1d4fdb05e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:28.253414 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319dc0ab-40c8-46ef-992d-9d1d4fdb05e9 None admin] REQUEST_METHOD: `PUT` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:28.253689 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319dc0ab-40c8-46ef-992d-9d1d4fdb05e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:28.253960 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319dc0ab-40c8-46ef-992d-9d1d4fdb05e9 None admin] PATH_INFO: `/v3/projects/7112c39aad764cbc9493ab829d1c571c/groups/df6d90fa648749fa9a8f951c57c3015d/roles/d14c3070c9184d76a7b23df69bd3db07` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:28.257845 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319dc0ab-40c8-46ef-992d-9d1d4fdb05e9 None admin] RBAC: Authorizing `identity:create_grant(project_id=7112c39aad764cbc9493ab829d1c571c, group_id=df6d90fa648749fa9a8f951c57c3015d, role_id=d14c3070c9184d76a7b23df69bd3db07)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:28.259578 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319dc0ab-40c8-46ef-992d-9d1d4fdb05e9 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:28.287257 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 204/413] 10.222.0.79 () {58 vars in 1442 bytes} [Tue Aug 30 00:59:27 2022] PUT /identity/v3/projects/7112c39aad764cbc9493ab829d1c571c/groups/df6d90fa648749fa9a8f951c57c3015d/roles/d14c3070c9184d76a7b23df69bd3db07 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:59:28.324917 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:28.341726 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b28fed-1949-4416-86ab-250a957fadc7 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:28.380395 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9196a551-df4d-4330-91af-68ecd3cf8a55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:28.381048 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9196a551-df4d-4330-91af-68ecd3cf8a55 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:28.381322 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9196a551-df4d-4330-91af-68ecd3cf8a55 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:28.381648 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9196a551-df4d-4330-91af-68ecd3cf8a55 None admin] PATH_INFO: `/v3/projects/3350ee60742e414d945ce547675b0abd` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:28.383050 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9196a551-df4d-4330-91af-68ecd3cf8a55 None admin] RBAC: Authorizing `identity:get_project(project_id=3350ee60742e414d945ce547675b0abd)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:28.384656 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9196a551-df4d-4330-91af-68ecd3cf8a55 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:28.386858 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 210/414] 10.222.0.79 () {56 vars in 1186 bytes} [Tue Aug 30 00:59:28 2022] GET /identity/v3/projects/3350ee60742e414d945ce547675b0abd => generated 302 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:59:28.392536 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319dc0ab-40c8-46ef-992d-9d1d4fdb05e9 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:28.444381 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:28.526516 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319dc0ab-40c8-46ef-992d-9d1d4fdb05e9 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:28.565944 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04af4cbb-0688-465b-9166-69cbae35df4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:28.566887 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04af4cbb-0688-465b-9166-69cbae35df4c None admin] REQUEST_METHOD: `PUT` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:28.567182 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04af4cbb-0688-465b-9166-69cbae35df4c None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:28.567450 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04af4cbb-0688-465b-9166-69cbae35df4c None admin] PATH_INFO: `/v3/projects/3350ee60742e414d945ce547675b0abd/groups/168e483cdde449b4a20bcad575fadea9/roles/0e24ae0a2cb9401e8f818402105e9fab` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:28.569787 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04af4cbb-0688-465b-9166-69cbae35df4c None admin] RBAC: Authorizing `identity:create_grant(project_id=3350ee60742e414d945ce547675b0abd, group_id=168e483cdde449b4a20bcad575fadea9, role_id=0e24ae0a2cb9401e8f818402105e9fab)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:28.571302 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04af4cbb-0688-465b-9166-69cbae35df4c None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:28.588672 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 205/415] 10.222.0.79 () {58 vars in 1442 bytes} [Tue Aug 30 00:59:28 2022] PUT /identity/v3/projects/3350ee60742e414d945ce547675b0abd/groups/168e483cdde449b4a20bcad575fadea9/roles/0e24ae0a2cb9401e8f818402105e9fab => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:59:28.867690 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041d6be9-6735-4a76-a404-0dc4f379a2ea None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:28.867975 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041d6be9-6735-4a76-a404-0dc4f379a2ea None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:28.868332 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041d6be9-6735-4a76-a404-0dc4f379a2ea None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:28.869881 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 211/416] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 00:59:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:59:28.876044 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12629db0-6c6c-4d5f-b762-89c54f28420d None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:28.876647 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12629db0-6c6c-4d5f-b762-89c54f28420d None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:28.877129 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12629db0-6c6c-4d5f-b762-89c54f28420d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:28.897328 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-12629db0-6c6c-4d5f-b762-89c54f28420d None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:59:28.898839 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-12629db0-6c6c-4d5f-b762-89c54f28420d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:59:28.923276 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea376a76-f66d-45fe-a2a3-3701d8c2b3d2 None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:28.923578 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea376a76-f66d-45fe-a2a3-3701d8c2b3d2 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:28.923826 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea376a76-f66d-45fe-a2a3-3701d8c2b3d2 None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:28.925404 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 212/417] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 00:59:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 00:59:28.931042 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543bb079-af9a-4c40-9fe6-4ce114ddfa31 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:28.931400 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543bb079-af9a-4c40-9fe6-4ce114ddfa31 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:28.931671 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543bb079-af9a-4c40-9fe6-4ce114ddfa31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:28.955537 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-543bb079-af9a-4c40-9fe6-4ce114ddfa31 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:59:28.956712 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-543bb079-af9a-4c40-9fe6-4ce114ddfa31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:59:28.985909 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 206/418] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 00:59:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:59:29.029309 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 213/419] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 00:59:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 00:59:29.344807 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12629db0-6c6c-4d5f-b762-89c54f28420d None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:29.370429 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543bb079-af9a-4c40-9fe6-4ce114ddfa31 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:29.375305 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:29.461373 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12629db0-6c6c-4d5f-b762-89c54f28420d None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:29.500716 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e59e23e-2c8f-401d-b3c5-5d823eafbbb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:29.501771 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e59e23e-2c8f-401d-b3c5-5d823eafbbb9 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:29.502270 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e59e23e-2c8f-401d-b3c5-5d823eafbbb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:29.502751 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e59e23e-2c8f-401d-b3c5-5d823eafbbb9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:29.516812 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e59e23e-2c8f-401d-b3c5-5d823eafbbb9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:59:29.522341 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application [None req-7e59e23e-2c8f-401d-b3c5-5d823eafbbb9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 00:59:29.522341 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:59:29.522341 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:59:29.522341 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:59:29.522341 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:59:29.522341 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:59:29.522341 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:59:29.522341 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:59:29.522341 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:59:29.522341 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:59:29.522341 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:59:29.522341 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:59:29.522341 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:59:29.522341 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:59:29.522341 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:59:29.522341 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:59:29.523375 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:59:29.523375 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:59:29.523375 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:59:29.523375 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:59:29.523375 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:59:29.523375 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:59:29.523375 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:59:29.523375 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:59:29.523375 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:59:29.523375 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:59:29.523375 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:59:29.523375 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application with Lock( Aug 30 00:59:29.523375 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:59:29.523375 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:59:29.523375 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:59:29.523375 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:59:29.524178 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:59:29.524178 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:59:29.524178 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:59:29.524178 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:59:29.524178 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:59:29.524178 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:59:29.524178 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:59:29.524178 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:59:29.524178 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:59:29.524178 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:59:29.524178 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 00:59:29.524178 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Aug 30 00:59:29.527791 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 207/420] 10.222.0.79 () {56 vars in 1099 bytes} [Tue Aug 30 00:59:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:59:29.543554 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e59e23e-2c8f-401d-b3c5-5d823eafbbb9 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:29.549499 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:29.582091 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543bb079-af9a-4c40-9fe6-4ce114ddfa31 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:29.652653 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3170f829-c53d-4fc6-ae81-d34787b86ff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:29.653429 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3170f829-c53d-4fc6-ae81-d34787b86ff1 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:29.653707 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3170f829-c53d-4fc6-ae81-d34787b86ff1 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:29.653974 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3170f829-c53d-4fc6-ae81-d34787b86ff1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:29.670923 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3170f829-c53d-4fc6-ae81-d34787b86ff1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:59:29.675811 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-3170f829-c53d-4fc6-ae81-d34787b86ff1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 00:59:29.675811 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:59:29.675811 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:59:29.675811 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:59:29.675811 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:59:29.675811 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:59:29.675811 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:59:29.675811 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:59:29.675811 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:59:29.675811 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:59:29.675811 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:59:29.675811 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:59:29.675811 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:59:29.675811 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:59:29.675811 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:59:29.675811 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:59:29.676762 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:59:29.676762 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:59:29.676762 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:59:29.676762 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:59:29.676762 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:59:29.676762 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:59:29.676762 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:59:29.676762 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:59:29.676762 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:59:29.676762 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:59:29.676762 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:59:29.676762 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Aug 30 00:59:29.676762 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:59:29.676762 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:59:29.676762 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:59:29.676762 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:59:29.677566 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:59:29.677566 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:59:29.677566 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:59:29.677566 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:59:29.677566 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:59:29.677566 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:59:29.677566 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:59:29.677566 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:59:29.677566 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:59:29.677566 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:59:29.677566 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 00:59:29.677566 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Aug 30 00:59:29.677566 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 214/421] 10.222.0.79 () {56 vars in 1114 bytes} [Tue Aug 30 00:59:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:59:29.692769 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3170f829-c53d-4fc6-ae81-d34787b86ff1 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:29.710538 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:29.730126 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e59e23e-2c8f-401d-b3c5-5d823eafbbb9 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:29.772270 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2948120-2b92-4546-9148-5aa7c6d5d707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:29.773138 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2948120-2b92-4546-9148-5aa7c6d5d707 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:29.773562 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2948120-2b92-4546-9148-5aa7c6d5d707 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:29.774595 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2948120-2b92-4546-9148-5aa7c6d5d707 None admin] PATH_INFO: `/v3/roles` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:29.775464 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2948120-2b92-4546-9148-5aa7c6d5d707 None admin] RBAC: Adding query filter params (name=member) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:59:29.776085 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2948120-2b92-4546-9148-5aa7c6d5d707 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:29.779992 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2948120-2b92-4546-9148-5aa7c6d5d707 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:29.797043 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 208/422] 10.222.0.79 () {56 vars in 1101 bytes} [Tue Aug 30 00:59:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:59:29.808165 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2948120-2b92-4546-9148-5aa7c6d5d707 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:29.893005 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3170f829-c53d-4fc6-ae81-d34787b86ff1 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:29.961114 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0019b1-8869-4590-a57c-14fe1738f134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:29.962175 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0019b1-8869-4590-a57c-14fe1738f134 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:29.962643 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0019b1-8869-4590-a57c-14fe1738f134 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:29.963162 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0019b1-8869-4590-a57c-14fe1738f134 None admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:29.964058 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0019b1-8869-4590-a57c-14fe1738f134 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:59:29.964561 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0019b1-8869-4590-a57c-14fe1738f134 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:29.966708 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0019b1-8869-4590-a57c-14fe1738f134 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:29.985732 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 215/423] 10.222.0.79 () {56 vars in 1111 bytes} [Tue Aug 30 00:59:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:59:29.992652 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0019b1-8869-4590-a57c-14fe1738f134 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:30.010619 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2948120-2b92-4546-9148-5aa7c6d5d707 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:30.013655 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:30.069324 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7ddfc3-876a-4ea0-9873-87a2c0db7dba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:30.070287 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7ddfc3-876a-4ea0-9873-87a2c0db7dba None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:30.070758 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7ddfc3-876a-4ea0-9873-87a2c0db7dba None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:30.071403 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7ddfc3-876a-4ea0-9873-87a2c0db7dba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:30.105436 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:30.186795 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0019b1-8869-4590-a57c-14fe1738f134 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:30.201947 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7ddfc3-876a-4ea0-9873-87a2c0db7dba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:30.204612 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7ddfc3-876a-4ea0-9873-87a2c0db7dba None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:30.225123 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12206ab3-74a6-4867-adf0-88ca7fe505a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:30.225733 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12206ab3-74a6-4867-adf0-88ca7fe505a2 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:30.226006 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12206ab3-74a6-4867-adf0-88ca7fe505a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:30.226621 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12206ab3-74a6-4867-adf0-88ca7fe505a2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:30.301423 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12206ab3-74a6-4867-adf0-88ca7fe505a2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:30.303195 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12206ab3-74a6-4867-adf0-88ca7fe505a2 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:30.316196 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:30.338828 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 209/424] 10.222.0.79 () {58 vars in 1282 bytes} [Tue Aug 30 00:59:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 526 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 00:59:30.340193 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559907d4-ae61-4d8f-ab46-f765f2a0c51a None None] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:30.340550 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559907d4-ae61-4d8f-ab46-f765f2a0c51a None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:30.340931 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559907d4-ae61-4d8f-ab46-f765f2a0c51a None None] PATH_INFO: `/` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:30.343150 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 210/425] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 00:59:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:59:30.347369 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559907d4-ae61-4d8f-ab46-f765f2a0c51a None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:30.414150 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:30.445172 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 216/426] 10.222.0.79 () {58 vars in 1282 bytes} [Tue Aug 30 00:59:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 30 00:59:30.448043 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea9455a-4149-49f5-b273-b0775f021318 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:30.448539 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea9455a-4149-49f5-b273-b0775f021318 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:30.449058 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea9455a-4149-49f5-b273-b0775f021318 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:30.472083 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-8ea9455a-4149-49f5-b273-b0775f021318 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:59:30.473602 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-8ea9455a-4149-49f5-b273-b0775f021318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:59:30.479401 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559907d4-ae61-4d8f-ab46-f765f2a0c51a None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:30.523438 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4c7cb5-fcd9-4587-815e-245f6af7cc3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:30.523887 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4c7cb5-fcd9-4587-815e-245f6af7cc3a None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:30.524168 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4c7cb5-fcd9-4587-815e-245f6af7cc3a None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:30.524438 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4c7cb5-fcd9-4587-815e-245f6af7cc3a None admin] PATH_INFO: `/v3/projects/4ec1a052ca044bdfa9052279c09cd55c` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:30.525989 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4c7cb5-fcd9-4587-815e-245f6af7cc3a None admin] RBAC: Authorizing `identity:get_project(project_id=4ec1a052ca044bdfa9052279c09cd55c)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:30.527474 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4c7cb5-fcd9-4587-815e-245f6af7cc3a None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:30.530104 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 211/427] 10.222.0.79 () {56 vars in 1186 bytes} [Tue Aug 30 00:59:30 2022] GET /identity/v3/projects/4ec1a052ca044bdfa9052279c09cd55c => generated 298 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:59:30.530865 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4c7cb5-fcd9-4587-815e-245f6af7cc3a None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:30.560734 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 217/428] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 00:59:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:59:30.562067 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea9455a-4149-49f5-b273-b0775f021318 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:30.640698 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:30.697114 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4c7cb5-fcd9-4587-815e-245f6af7cc3a None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:30.702105 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea9455a-4149-49f5-b273-b0775f021318 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:30.718659 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:30.741657 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db218c0a-7f82-4593-b7c3-4c706f6d1e17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:30.742550 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db218c0a-7f82-4593-b7c3-4c706f6d1e17 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:30.742971 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db218c0a-7f82-4593-b7c3-4c706f6d1e17 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:30.743409 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db218c0a-7f82-4593-b7c3-4c706f6d1e17 None admin] PATH_INFO: `/v3/groups/168e483cdde449b4a20bcad575fadea9` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:30.744051 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e71f88f-c21d-4c2c-a4f4-943d41c0a173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:30.744669 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e71f88f-c21d-4c2c-a4f4-943d41c0a173 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:30.744945 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e71f88f-c21d-4c2c-a4f4-943d41c0a173 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:30.745091 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db218c0a-7f82-4593-b7c3-4c706f6d1e17 None admin] RBAC: Authorizing `identity:get_group(group_id=168e483cdde449b4a20bcad575fadea9)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:30.745208 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e71f88f-c21d-4c2c-a4f4-943d41c0a173 None admin] PATH_INFO: `/v3/projects/4ec1a052ca044bdfa9052279c09cd55c` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:30.746315 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e71f88f-c21d-4c2c-a4f4-943d41c0a173 None admin] RBAC: Authorizing `identity:get_project(project_id=4ec1a052ca044bdfa9052279c09cd55c)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:30.746926 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db218c0a-7f82-4593-b7c3-4c706f6d1e17 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:30.748489 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e71f88f-c21d-4c2c-a4f4-943d41c0a173 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:30.748881 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 218/429] 10.222.0.79 () {56 vars in 1180 bytes} [Tue Aug 30 00:59:30 2022] GET /identity/v3/groups/168e483cdde449b4a20bcad575fadea9 => generated 226 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:59:30.750244 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90e7d0a-c924-4ed7-a2d3-a1d28e366ff9 None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:30.750680 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90e7d0a-c924-4ed7-a2d3-a1d28e366ff9 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:30.751087 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90e7d0a-c924-4ed7-a2d3-a1d28e366ff9 None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:30.752713 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 219/430] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 00:59:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:59:30.754358 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90e7d0a-c924-4ed7-a2d3-a1d28e366ff9 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:30.756926 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 212/431] 10.222.0.79 () {56 vars in 1186 bytes} [Tue Aug 30 00:59:30 2022] GET /identity/v3/projects/4ec1a052ca044bdfa9052279c09cd55c => generated 298 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:59:30.761618 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d77cae-2f48-403d-9eca-f99121317ad8 None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:30.761902 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d77cae-2f48-403d-9eca-f99121317ad8 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:30.762170 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d77cae-2f48-403d-9eca-f99121317ad8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:30.787825 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-e9d77cae-2f48-403d-9eca-f99121317ad8 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:59:30.789317 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-e9d77cae-2f48-403d-9eca-f99121317ad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:59:30.884052 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90e7d0a-c924-4ed7-a2d3-a1d28e366ff9 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:30.887442 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 213/432] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 00:59:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 00:59:30.889443 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d77cae-2f48-403d-9eca-f99121317ad8 None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:30.893509 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:30.926707 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3fc0ad-d7d6-4efc-b8f6-0753df71d8b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:30.927338 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3fc0ad-d7d6-4efc-b8f6-0753df71d8b9 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:30.927622 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3fc0ad-d7d6-4efc-b8f6-0753df71d8b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:30.928017 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3fc0ad-d7d6-4efc-b8f6-0753df71d8b9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:30.929146 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3fc0ad-d7d6-4efc-b8f6-0753df71d8b9 None admin] RBAC: Adding query filter params (group.id=168e483cdde449b4a20bcad575fadea9, role.id=c37945a17623465f899d4f217e7af593, scope.project.id=4ec1a052ca044bdfa9052279c09cd55c) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:59:30.929412 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3fc0ad-d7d6-4efc-b8f6-0753df71d8b9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:30.930979 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3fc0ad-d7d6-4efc-b8f6-0753df71d8b9 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:30.938225 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 220/433] 10.222.0.79 () {56 vars in 1376 bytes} [Tue Aug 30 00:59:30 2022] GET /identity/v3/role_assignments?group.id=168e483cdde449b4a20bcad575fadea9&scope.project.id=4ec1a052ca044bdfa9052279c09cd55c&role.id=c37945a17623465f899d4f217e7af593 => generated 611 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:59:30.939565 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3fc0ad-d7d6-4efc-b8f6-0753df71d8b9 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:31.045508 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d77cae-2f48-403d-9eca-f99121317ad8 None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:31.062535 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:31.088513 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f867fb-8ee4-41d5-8aeb-6d02660efb52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:31.089599 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f867fb-8ee4-41d5-8aeb-6d02660efb52 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:31.090088 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f867fb-8ee4-41d5-8aeb-6d02660efb52 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:31.090542 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3fc0ad-d7d6-4efc-b8f6-0753df71d8b9 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:31.090778 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f867fb-8ee4-41d5-8aeb-6d02660efb52 None admin] PATH_INFO: `/v3/groups/168e483cdde449b4a20bcad575fadea9` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:31.092474 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f867fb-8ee4-41d5-8aeb-6d02660efb52 None admin] RBAC: Authorizing `identity:get_group(group_id=168e483cdde449b4a20bcad575fadea9)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:31.094248 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f867fb-8ee4-41d5-8aeb-6d02660efb52 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:31.096558 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 214/434] 10.222.0.79 () {56 vars in 1180 bytes} [Tue Aug 30 00:59:30 2022] GET /identity/v3/groups/168e483cdde449b4a20bcad575fadea9 => generated 226 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:59:31.098017 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08335c3-29b8-418e-8093-07dd14c4a545 None None] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:31.098519 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08335c3-29b8-418e-8093-07dd14c4a545 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:31.098976 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08335c3-29b8-418e-8093-07dd14c4a545 None None] PATH_INFO: `/` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:31.100797 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 215/435] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 00:59:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:59:31.101871 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08335c3-29b8-418e-8093-07dd14c4a545 None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:31.147964 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449bbd32-9b94-4193-8ffd-8c85a4bf493e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:31.148526 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449bbd32-9b94-4193-8ffd-8c85a4bf493e None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:31.148806 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449bbd32-9b94-4193-8ffd-8c85a4bf493e None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:31.149078 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449bbd32-9b94-4193-8ffd-8c85a4bf493e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:31.161786 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449bbd32-9b94-4193-8ffd-8c85a4bf493e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:59:31.167512 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-449bbd32-9b94-4193-8ffd-8c85a4bf493e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 00:59:31.167512 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:59:31.167512 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:59:31.167512 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:59:31.167512 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:59:31.167512 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:59:31.167512 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:59:31.167512 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:59:31.167512 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:59:31.167512 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:59:31.167512 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:59:31.167512 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:59:31.167512 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:59:31.167512 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:59:31.167512 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:59:31.167512 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:59:31.168545 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:59:31.168545 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:59:31.168545 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:59:31.168545 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:59:31.168545 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:59:31.168545 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:59:31.168545 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:59:31.168545 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:59:31.168545 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:59:31.168545 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:59:31.168545 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:59:31.168545 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Aug 30 00:59:31.168545 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:59:31.168545 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:59:31.168545 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:59:31.168545 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:59:31.169412 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:59:31.169412 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:59:31.169412 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:59:31.169412 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:59:31.169412 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:59:31.169412 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:59:31.169412 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:59:31.169412 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:59:31.169412 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:59:31.169412 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:59:31.169412 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 00:59:31.169412 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Aug 30 00:59:31.170013 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 221/436] 10.222.0.79 () {56 vars in 1099 bytes} [Tue Aug 30 00:59:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:59:31.170801 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2ca0b7-d1e3-467c-bfb1-6ffcc02d4dea None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:31.171080 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2ca0b7-d1e3-467c-bfb1-6ffcc02d4dea None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:31.171393 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2ca0b7-d1e3-467c-bfb1-6ffcc02d4dea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:31.193910 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-9c2ca0b7-d1e3-467c-bfb1-6ffcc02d4dea None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:59:31.195417 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-9c2ca0b7-d1e3-467c-bfb1-6ffcc02d4dea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:59:31.224199 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:31.240598 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08335c3-29b8-418e-8093-07dd14c4a545 None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:31.281407 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947e53b7-eaae-4955-90c9-31e355fc2e10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:31.282066 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947e53b7-eaae-4955-90c9-31e355fc2e10 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:31.282318 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947e53b7-eaae-4955-90c9-31e355fc2e10 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:31.282589 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947e53b7-eaae-4955-90c9-31e355fc2e10 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:31.283514 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947e53b7-eaae-4955-90c9-31e355fc2e10 None admin] RBAC: Adding query filter params (group.id=168e483cdde449b4a20bcad575fadea9, role.id=0e24ae0a2cb9401e8f818402105e9fab, scope.project.id=4ec1a052ca044bdfa9052279c09cd55c) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:59:31.283820 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947e53b7-eaae-4955-90c9-31e355fc2e10 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:31.285252 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947e53b7-eaae-4955-90c9-31e355fc2e10 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:31.287826 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 222/437] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 00:59:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:59:31.289055 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2ca0b7-d1e3-467c-bfb1-6ffcc02d4dea None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:31.292008 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 216/438] 10.222.0.79 () {56 vars in 1376 bytes} [Tue Aug 30 00:59:31 2022] GET /identity/v3/role_assignments?group.id=168e483cdde449b4a20bcad575fadea9&scope.project.id=4ec1a052ca044bdfa9052279c09cd55c&role.id=0e24ae0a2cb9401e8f818402105e9fab => generated 611 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:59:31.292908 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947e53b7-eaae-4955-90c9-31e355fc2e10 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:31.370199 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:31.440721 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2ca0b7-d1e3-467c-bfb1-6ffcc02d4dea None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:31.441022 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947e53b7-eaae-4955-90c9-31e355fc2e10 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:31.485082 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6deb96-80df-4264-850b-52a842ad21d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:31.485728 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6deb96-80df-4264-850b-52a842ad21d0 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:31.485997 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6deb96-80df-4264-850b-52a842ad21d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:31.486259 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6deb96-80df-4264-850b-52a842ad21d0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:31.486763 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1145b88-3d47-4839-8aff-cb13444fc278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:31.487417 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1145b88-3d47-4839-8aff-cb13444fc278 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:31.487696 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1145b88-3d47-4839-8aff-cb13444fc278 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:31.487968 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1145b88-3d47-4839-8aff-cb13444fc278 None admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:31.488782 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1145b88-3d47-4839-8aff-cb13444fc278 None admin] RBAC: Adding query filter params (name=member) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:59:31.489323 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1145b88-3d47-4839-8aff-cb13444fc278 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:31.490673 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1145b88-3d47-4839-8aff-cb13444fc278 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:31.498281 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6deb96-80df-4264-850b-52a842ad21d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:59:31.501260 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 223/439] 10.222.0.79 () {56 vars in 1101 bytes} [Tue Aug 30 00:59:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:59:31.505072 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application [None req-4c6deb96-80df-4264-850b-52a842ad21d0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:59:31.505072 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:59:31.505072 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:59:31.505072 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:59:31.505072 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:59:31.505072 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:59:31.505072 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:59:31.505072 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:59:31.505072 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:59:31.505072 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:59:31.505072 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:59:31.505072 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:59:31.505072 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:59:31.505072 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:59:31.505072 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:59:31.505072 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:59:31.505998 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:59:31.505998 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:59:31.505998 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:59:31.505998 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:59:31.505998 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:59:31.505998 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:59:31.505998 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:59:31.505998 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:59:31.505998 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:59:31.505998 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:59:31.505998 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:59:31.505998 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application with Lock( Aug 30 00:59:31.505998 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:59:31.505998 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:59:31.505998 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:59:31.505998 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:59:31.506783 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:59:31.506783 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:59:31.506783 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:59:31.506783 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:59:31.506783 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:59:31.506783 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:59:31.506783 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:59:31.506783 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:59:31.506783 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:59:31.506783 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:59:31.506783 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:59:31.506783 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Aug 30 00:59:31.506783 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 217/440] 10.222.0.79 () {56 vars in 1096 bytes} [Tue Aug 30 00:59:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:59:31.508951 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1145b88-3d47-4839-8aff-cb13444fc278 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:31.512121 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6deb96-80df-4264-850b-52a842ad21d0 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:31.538470 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:31.639918 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6deb96-80df-4264-850b-52a842ad21d0 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:31.643168 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:31.646919 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1145b88-3d47-4839-8aff-cb13444fc278 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:31.681479 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd03e06b-5f58-418c-a1e4-19f93b5574ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:31.682382 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd03e06b-5f58-418c-a1e4-19f93b5574ef None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:31.682861 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd03e06b-5f58-418c-a1e4-19f93b5574ef None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:31.683150 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd03e06b-5f58-418c-a1e4-19f93b5574ef None admin] PATH_INFO: `/v3/roles` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:31.683893 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd03e06b-5f58-418c-a1e4-19f93b5574ef None admin] RBAC: Adding query filter params (name=admin) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:59:31.684193 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd03e06b-5f58-418c-a1e4-19f93b5574ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:31.687059 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd03e06b-5f58-418c-a1e4-19f93b5574ef None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:31.688967 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d75e84-e25e-41e6-b0d6-7ed1a05feff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:31.689788 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d75e84-e25e-41e6-b0d6-7ed1a05feff0 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:31.689987 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d75e84-e25e-41e6-b0d6-7ed1a05feff0 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:31.690260 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d75e84-e25e-41e6-b0d6-7ed1a05feff0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:31.696303 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 218/441] 10.222.0.79 () {56 vars in 1099 bytes} [Tue Aug 30 00:59:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:59:31.696953 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd03e06b-5f58-418c-a1e4-19f93b5574ef None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:31.795953 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d75e84-e25e-41e6-b0d6-7ed1a05feff0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:31.798664 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d75e84-e25e-41e6-b0d6-7ed1a05feff0 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:31.811503 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd03e06b-5f58-418c-a1e4-19f93b5574ef None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:31.832601 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:31.846221 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc73b4c5-282f-4178-97b1-71c40f574bc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:31.846848 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc73b4c5-282f-4178-97b1-71c40f574bc5 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:31.847143 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc73b4c5-282f-4178-97b1-71c40f574bc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:31.847426 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc73b4c5-282f-4178-97b1-71c40f574bc5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:31.859515 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc73b4c5-282f-4178-97b1-71c40f574bc5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:59:31.864737 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application [None req-dc73b4c5-282f-4178-97b1-71c40f574bc5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 00:59:31.864737 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:59:31.864737 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:59:31.864737 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:59:31.864737 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:59:31.864737 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:59:31.864737 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:59:31.864737 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:59:31.864737 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:59:31.864737 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:59:31.864737 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:59:31.864737 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:59:31.864737 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:59:31.864737 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:59:31.864737 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:59:31.864737 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:59:31.865612 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:59:31.865612 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:59:31.865612 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:59:31.865612 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:59:31.865612 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:59:31.865612 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:59:31.865612 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:59:31.865612 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:59:31.865612 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:59:31.865612 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:59:31.865612 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:59:31.865612 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application with Lock( Aug 30 00:59:31.865612 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:59:31.865612 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:59:31.865612 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:59:31.865612 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:59:31.866427 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:59:31.866427 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:59:31.866427 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:59:31.866427 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:59:31.866427 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:59:31.866427 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:59:31.866427 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:59:31.866427 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:59:31.866427 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:59:31.866427 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:59:31.866427 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 00:59:31.866427 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Aug 30 00:59:31.866427 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 219/442] 10.222.0.79 () {56 vars in 1114 bytes} [Tue Aug 30 00:59:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:59:31.867073 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc73b4c5-282f-4178-97b1-71c40f574bc5 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:31.895694 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:31.914265 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 224/443] 10.222.0.79 () {58 vars in 1282 bytes} [Tue Aug 30 00:59:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 00:59:31.915102 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d75e84-e25e-41e6-b0d6-7ed1a05feff0 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:31.974761 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc73b4c5-282f-4178-97b1-71c40f574bc5 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:32.009178 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226c3fbf-683e-4c0c-8051-b3d084bb0e02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:32.009818 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226c3fbf-683e-4c0c-8051-b3d084bb0e02 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:32.010094 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226c3fbf-683e-4c0c-8051-b3d084bb0e02 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:32.010366 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226c3fbf-683e-4c0c-8051-b3d084bb0e02 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:32.013928 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d75e84-e25e-41e6-b0d6-7ed1a05feff0 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:32.039135 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:32.052095 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ba1de1-d67d-49d1-8662-c5e7910265c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:32.052693 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ba1de1-d67d-49d1-8662-c5e7910265c5 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:32.052975 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ba1de1-d67d-49d1-8662-c5e7910265c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:32.053225 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ba1de1-d67d-49d1-8662-c5e7910265c5 None admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:32.053881 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ba1de1-d67d-49d1-8662-c5e7910265c5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:59:32.054180 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ba1de1-d67d-49d1-8662-c5e7910265c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:32.055568 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ba1de1-d67d-49d1-8662-c5e7910265c5 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:32.063557 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 225/444] 10.222.0.79 () {56 vars in 1111 bytes} [Tue Aug 30 00:59:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:59:32.064531 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ba1de1-d67d-49d1-8662-c5e7910265c5 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:32.095729 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226c3fbf-683e-4c0c-8051-b3d084bb0e02 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:32.097521 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226c3fbf-683e-4c0c-8051-b3d084bb0e02 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:32.125326 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:32.175355 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ba1de1-d67d-49d1-8662-c5e7910265c5 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:32.200723 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 220/445] 10.222.0.79 () {58 vars in 1282 bytes} [Tue Aug 30 00:59:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 00:59:32.201648 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226c3fbf-683e-4c0c-8051-b3d084bb0e02 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:32.212504 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8783fad4-eb57-4853-a3cf-6f4344ffebeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:32.213133 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8783fad4-eb57-4853-a3cf-6f4344ffebeb None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:32.213409 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8783fad4-eb57-4853-a3cf-6f4344ffebeb None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:32.213675 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8783fad4-eb57-4853-a3cf-6f4344ffebeb None admin] PATH_INFO: `/v3/projects/3350ee60742e414d945ce547675b0abd` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:32.214874 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8783fad4-eb57-4853-a3cf-6f4344ffebeb None admin] RBAC: Authorizing `identity:get_project(project_id=3350ee60742e414d945ce547675b0abd)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:32.216533 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8783fad4-eb57-4853-a3cf-6f4344ffebeb None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:32.218165 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 226/446] 10.222.0.79 () {56 vars in 1186 bytes} [Tue Aug 30 00:59:32 2022] GET /identity/v3/projects/3350ee60742e414d945ce547675b0abd => generated 302 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:59:32.218933 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8783fad4-eb57-4853-a3cf-6f4344ffebeb None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:32.290229 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:32.315112 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226c3fbf-683e-4c0c-8051-b3d084bb0e02 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:32.341127 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:32.342321 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8783fad4-eb57-4853-a3cf-6f4344ffebeb None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:32.353708 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abbb8c5-d3f4-49f8-acac-4d7c1e09d2ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:32.354316 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abbb8c5-d3f4-49f8-acac-4d7c1e09d2ff None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:32.354590 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abbb8c5-d3f4-49f8-acac-4d7c1e09d2ff None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:32.354852 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abbb8c5-d3f4-49f8-acac-4d7c1e09d2ff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:32.378473 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedb0bf7-61fc-4cae-acfe-84e82c1a4351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:32.379099 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedb0bf7-61fc-4cae-acfe-84e82c1a4351 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:32.379405 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedb0bf7-61fc-4cae-acfe-84e82c1a4351 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:32.379677 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedb0bf7-61fc-4cae-acfe-84e82c1a4351 None admin] PATH_INFO: `/v3/projects/7112c39aad764cbc9493ab829d1c571c` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:32.380787 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedb0bf7-61fc-4cae-acfe-84e82c1a4351 None admin] RBAC: Authorizing `identity:get_project(project_id=7112c39aad764cbc9493ab829d1c571c)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:32.382202 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedb0bf7-61fc-4cae-acfe-84e82c1a4351 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:32.383839 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 227/447] 10.222.0.79 () {56 vars in 1186 bytes} [Tue Aug 30 00:59:32 2022] GET /identity/v3/projects/7112c39aad764cbc9493ab829d1c571c => generated 344 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:59:32.384592 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedb0bf7-61fc-4cae-acfe-84e82c1a4351 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:32.429579 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abbb8c5-d3f4-49f8-acac-4d7c1e09d2ff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:32.431037 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abbb8c5-d3f4-49f8-acac-4d7c1e09d2ff None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:32.494331 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedb0bf7-61fc-4cae-acfe-84e82c1a4351 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:32.515598 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:32.529737 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676eb1cf-f2db-4027-b0cd-ee38fc3d33d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:32.530366 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676eb1cf-f2db-4027-b0cd-ee38fc3d33d0 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:32.530640 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676eb1cf-f2db-4027-b0cd-ee38fc3d33d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:32.530910 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676eb1cf-f2db-4027-b0cd-ee38fc3d33d0 None admin] PATH_INFO: `/v3/groups/168e483cdde449b4a20bcad575fadea9` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:32.531282 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 221/448] 10.222.0.79 () {58 vars in 1282 bytes} [Tue Aug 30 00:59:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 00:59:32.532129 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abbb8c5-d3f4-49f8-acac-4d7c1e09d2ff None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:32.534991 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676eb1cf-f2db-4027-b0cd-ee38fc3d33d0 None admin] RBAC: Authorizing `identity:get_group(group_id=168e483cdde449b4a20bcad575fadea9)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:32.537264 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676eb1cf-f2db-4027-b0cd-ee38fc3d33d0 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:32.538858 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 228/449] 10.222.0.79 () {56 vars in 1180 bytes} [Tue Aug 30 00:59:32 2022] GET /identity/v3/groups/168e483cdde449b4a20bcad575fadea9 => generated 226 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:59:32.539644 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676eb1cf-f2db-4027-b0cd-ee38fc3d33d0 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:32.559065 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:32.632850 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abbb8c5-d3f4-49f8-acac-4d7c1e09d2ff None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:32.642056 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676eb1cf-f2db-4027-b0cd-ee38fc3d33d0 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:32.674625 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd70d2bd-35b1-4bb4-a275-fe5d15cc170a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:32.675283 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd70d2bd-35b1-4bb4-a275-fe5d15cc170a None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:32.675557 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd70d2bd-35b1-4bb4-a275-fe5d15cc170a None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:32.675652 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5feea024-10d2-4e8e-858f-3506081ff453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:32.675822 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd70d2bd-35b1-4bb4-a275-fe5d15cc170a None admin] PATH_INFO: `/v3/groups/df6d90fa648749fa9a8f951c57c3015d` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:32.676177 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feea024-10d2-4e8e-858f-3506081ff453 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:32.676449 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feea024-10d2-4e8e-858f-3506081ff453 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:32.676713 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feea024-10d2-4e8e-858f-3506081ff453 None admin] PATH_INFO: `/v3/projects/3350ee60742e414d945ce547675b0abd` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:32.676920 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd70d2bd-35b1-4bb4-a275-fe5d15cc170a None admin] RBAC: Authorizing `identity:get_group(group_id=df6d90fa648749fa9a8f951c57c3015d)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:32.677809 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5feea024-10d2-4e8e-858f-3506081ff453 None admin] RBAC: Authorizing `identity:get_project(project_id=3350ee60742e414d945ce547675b0abd)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:32.678340 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd70d2bd-35b1-4bb4-a275-fe5d15cc170a None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:32.679295 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5feea024-10d2-4e8e-858f-3506081ff453 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:32.679906 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 222/450] 10.222.0.79 () {56 vars in 1180 bytes} [Tue Aug 30 00:59:32 2022] GET /identity/v3/groups/df6d90fa648749fa9a8f951c57c3015d => generated 229 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:59:32.680653 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd70d2bd-35b1-4bb4-a275-fe5d15cc170a None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:32.681145 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 229/451] 10.222.0.79 () {56 vars in 1186 bytes} [Tue Aug 30 00:59:32 2022] GET /identity/v3/projects/3350ee60742e414d945ce547675b0abd => generated 302 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:59:32.685798 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5feea024-10d2-4e8e-858f-3506081ff453 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:32.741748 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:32.777909 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:32.785819 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd70d2bd-35b1-4bb4-a275-fe5d15cc170a None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:32.786218 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5feea024-10d2-4e8e-858f-3506081ff453 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:32.820075 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5783d9-b8e9-4500-9156-7e6207af99e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:32.820675 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5783d9-b8e9-4500-9156-7e6207af99e7 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:32.820949 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5783d9-b8e9-4500-9156-7e6207af99e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:32.821217 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5783d9-b8e9-4500-9156-7e6207af99e7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:32.821939 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5783d9-b8e9-4500-9156-7e6207af99e7 None admin] RBAC: Adding query filter params (group.id=df6d90fa648749fa9a8f951c57c3015d, role.id=d14c3070c9184d76a7b23df69bd3db07, scope.project.id=7112c39aad764cbc9493ab829d1c571c) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:59:32.822242 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5783d9-b8e9-4500-9156-7e6207af99e7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:32.822754 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5310455-2d00-4dca-aff4-d1e5607dfa7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:32.823700 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5783d9-b8e9-4500-9156-7e6207af99e7 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:32.823808 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5310455-2d00-4dca-aff4-d1e5607dfa7e None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:32.824288 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5310455-2d00-4dca-aff4-d1e5607dfa7e None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:32.824819 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5310455-2d00-4dca-aff4-d1e5607dfa7e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:32.826181 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5310455-2d00-4dca-aff4-d1e5607dfa7e None admin] RBAC: Adding query filter params (group.id=168e483cdde449b4a20bcad575fadea9, role.id=c37945a17623465f899d4f217e7af593, scope.project.id=3350ee60742e414d945ce547675b0abd) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:59:32.826734 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5310455-2d00-4dca-aff4-d1e5607dfa7e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:32.829518 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5310455-2d00-4dca-aff4-d1e5607dfa7e None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:32.830127 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 230/452] 10.222.0.79 () {56 vars in 1376 bytes} [Tue Aug 30 00:59:32 2022] GET /identity/v3/role_assignments?group.id=df6d90fa648749fa9a8f951c57c3015d&scope.project.id=7112c39aad764cbc9493ab829d1c571c&role.id=d14c3070c9184d76a7b23df69bd3db07 => generated 611 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:59:32.830918 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5783d9-b8e9-4500-9156-7e6207af99e7 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:32.837920 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 223/453] 10.222.0.79 () {56 vars in 1376 bytes} [Tue Aug 30 00:59:32 2022] GET /identity/v3/role_assignments?group.id=168e483cdde449b4a20bcad575fadea9&scope.project.id=3350ee60742e414d945ce547675b0abd&role.id=c37945a17623465f899d4f217e7af593 => generated 611 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:59:32.961971 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5783d9-b8e9-4500-9156-7e6207af99e7 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:32.989673 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:33.007550 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7fae8e-cc3e-416e-a6ab-4f16bb349a2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:33.008183 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7fae8e-cc3e-416e-a6ab-4f16bb349a2d None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:33.008461 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7fae8e-cc3e-416e-a6ab-4f16bb349a2d None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:33.008732 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7fae8e-cc3e-416e-a6ab-4f16bb349a2d None admin] PATH_INFO: `/v3/groups/168e483cdde449b4a20bcad575fadea9` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:33.009850 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7fae8e-cc3e-416e-a6ab-4f16bb349a2d None admin] RBAC: Authorizing `identity:get_group(group_id=168e483cdde449b4a20bcad575fadea9)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:33.011314 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7fae8e-cc3e-416e-a6ab-4f16bb349a2d None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:33.013720 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 231/454] 10.222.0.79 () {56 vars in 1180 bytes} [Tue Aug 30 00:59:32 2022] GET /identity/v3/groups/168e483cdde449b4a20bcad575fadea9 => generated 226 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:59:33.019656 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5310455-2d00-4dca-aff4-d1e5607dfa7e None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:33.129372 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5310455-2d00-4dca-aff4-d1e5607dfa7e None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:33.164536 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3136b6c-3be0-4e32-b558-05d80e1af4ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:33.165135 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3136b6c-3be0-4e32-b558-05d80e1af4ad None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:33.165408 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3136b6c-3be0-4e32-b558-05d80e1af4ad None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:33.165672 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3136b6c-3be0-4e32-b558-05d80e1af4ad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:33.166393 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3136b6c-3be0-4e32-b558-05d80e1af4ad None admin] RBAC: Adding query filter params (group.id=168e483cdde449b4a20bcad575fadea9, role.id=0e24ae0a2cb9401e8f818402105e9fab, scope.project.id=3350ee60742e414d945ce547675b0abd) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:59:33.166697 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3136b6c-3be0-4e32-b558-05d80e1af4ad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:33.168154 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3136b6c-3be0-4e32-b558-05d80e1af4ad None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:33.174577 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 224/455] 10.222.0.79 () {56 vars in 1376 bytes} [Tue Aug 30 00:59:33 2022] GET /identity/v3/role_assignments?group.id=168e483cdde449b4a20bcad575fadea9&scope.project.id=3350ee60742e414d945ce547675b0abd&role.id=0e24ae0a2cb9401e8f818402105e9fab => generated 611 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:59:35.817024 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98d3190-ed13-4d38-8ba3-ef1de31ae4d5 None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:35.817548 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98d3190-ed13-4d38-8ba3-ef1de31ae4d5 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:35.817548 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98d3190-ed13-4d38-8ba3-ef1de31ae4d5 None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:35.819192 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 232/456] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 00:59:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:59:35.825012 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb78b5e0-ec0d-41ad-8a16-c4e9c2b15190 None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:35.825701 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb78b5e0-ec0d-41ad-8a16-c4e9c2b15190 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:35.825981 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb78b5e0-ec0d-41ad-8a16-c4e9c2b15190 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:35.856214 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-bb78b5e0-ec0d-41ad-8a16-c4e9c2b15190 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:59:35.857710 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-bb78b5e0-ec0d-41ad-8a16-c4e9c2b15190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:59:35.882556 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:35.901516 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aed8b7-e803-4420-bdb3-8f88a6d87e6f None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:35.902124 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aed8b7-e803-4420-bdb3-8f88a6d87e6f None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:35.902600 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aed8b7-e803-4420-bdb3-8f88a6d87e6f None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:35.904612 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 233/457] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 00:59:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:59:35.910308 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a59f89-b5e0-4b80-a634-93a0b537d992 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:35.910907 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a59f89-b5e0-4b80-a634-93a0b537d992 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:35.911418 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a59f89-b5e0-4b80-a634-93a0b537d992 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:35.943481 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-24a59f89-b5e0-4b80-a634-93a0b537d992 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:59:35.944697 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-24a59f89-b5e0-4b80-a634-93a0b537d992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:59:35.983350 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 225/458] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 00:59:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 00:59:36.023422 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 234/459] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 00:59:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 00:59:36.091408 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c76732-67fd-4e59-bd4a-259e217ca9eb None None] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:36.091908 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c76732-67fd-4e59-bd4a-259e217ca9eb None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:36.092318 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c76732-67fd-4e59-bd4a-259e217ca9eb None None] PATH_INFO: `/` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:36.093840 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 226/460] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 00:59:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:59:36.100270 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112ffdd0-cdf1-41b6-832d-6db5c8c15a45 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:36.100765 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112ffdd0-cdf1-41b6-832d-6db5c8c15a45 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:36.101183 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112ffdd0-cdf1-41b6-832d-6db5c8c15a45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:36.135477 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-112ffdd0-cdf1-41b6-832d-6db5c8c15a45 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:59:36.136958 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-112ffdd0-cdf1-41b6-832d-6db5c8c15a45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:59:36.217982 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 235/461] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 00:59:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 00:59:36.368590 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c76732-67fd-4e59-bd4a-259e217ca9eb None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:36.394465 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112ffdd0-cdf1-41b6-832d-6db5c8c15a45 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:36.451789 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:36.508875 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112ffdd0-cdf1-41b6-832d-6db5c8c15a45 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:36.516465 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c76732-67fd-4e59-bd4a-259e217ca9eb None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:36.545196 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b90a6e1-de28-4110-8496-f29799fba6e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:36.545828 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b90a6e1-de28-4110-8496-f29799fba6e4 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:36.546100 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b90a6e1-de28-4110-8496-f29799fba6e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:36.546366 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b90a6e1-de28-4110-8496-f29799fba6e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:36.557561 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b90a6e1-de28-4110-8496-f29799fba6e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:36.559006 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b90a6e1-de28-4110-8496-f29799fba6e4 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:36.560425 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f5a883-10c7-4356-b4ba-d117d75ca4a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:36.561209 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f5a883-10c7-4356-b4ba-d117d75ca4a7 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:36.561488 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f5a883-10c7-4356-b4ba-d117d75ca4a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:36.563195 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f5a883-10c7-4356-b4ba-d117d75ca4a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:36.574682 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f5a883-10c7-4356-b4ba-d117d75ca4a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:36.577055 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f5a883-10c7-4356-b4ba-d117d75ca4a7 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:36.579824 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-0b90a6e1-de28-4110-8496-f29799fba6e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:59:36.579824 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:59:36.579824 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:59:36.579824 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:59:36.579824 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:59:36.579824 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:59:36.579824 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:59:36.579824 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:59:36.579824 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:59:36.579824 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:59:36.579824 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:59:36.579824 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:59:36.579824 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:59:36.579824 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:59:36.579824 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:59:36.579824 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:59:36.581368 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:59:36.581368 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:59:36.581368 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:59:36.581368 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:59:36.581368 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:59:36.581368 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:59:36.581368 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:59:36.581368 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Aug 30 00:59:36.581368 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:59:36.581368 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:59:36.581368 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:59:36.581368 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:59:36.581368 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:59:36.581368 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:59:36.581368 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:59:36.581368 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:59:36.581368 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:59:36.582888 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:59:36.582888 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:59:36.582888 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Aug 30 00:59:36.582888 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 236/462] 10.222.0.79 () {56 vars in 1108 bytes} [Tue Aug 30 00:59:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:59:36.587159 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3859335d-b9ed-43f3-84b9-7cd0ed9d5fa1 None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:36.587803 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3859335d-b9ed-43f3-84b9-7cd0ed9d5fa1 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:36.587803 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3859335d-b9ed-43f3-84b9-7cd0ed9d5fa1 None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:36.589371 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 237/463] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 00:59:36 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:59:36.589909 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3859335d-b9ed-43f3-84b9-7cd0ed9d5fa1 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:36.602330 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application [None req-99f5a883-10c7-4356-b4ba-d117d75ca4a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:59:36.602330 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:59:36.602330 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:59:36.602330 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:59:36.602330 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:59:36.602330 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:59:36.602330 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:59:36.602330 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:59:36.602330 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:59:36.602330 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:59:36.602330 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:59:36.602330 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:59:36.602330 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:59:36.602330 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:59:36.602330 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:59:36.602330 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:59:36.603380 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:59:36.603380 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:59:36.603380 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:59:36.603380 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:59:36.603380 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:59:36.603380 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:59:36.603380 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:59:36.603380 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application with Lock( Aug 30 00:59:36.603380 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:59:36.603380 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:59:36.603380 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:59:36.603380 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:59:36.603380 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:59:36.603380 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:59:36.603380 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:59:36.603380 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:59:36.603380 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:59:36.604283 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:59:36.604283 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:59:36.604283 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Aug 30 00:59:36.604283 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 227/464] 10.222.0.79 () {56 vars in 1108 bytes} [Tue Aug 30 00:59:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:59:36.609447 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f5a883-10c7-4356-b4ba-d117d75ca4a7 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:36.610840 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:36.709369 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:36.714320 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3859335d-b9ed-43f3-84b9-7cd0ed9d5fa1 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:36.729963 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f5a883-10c7-4356-b4ba-d117d75ca4a7 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:36.753928 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2a933a-2212-44e7-879d-c43a27c8b2a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:36.754710 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2a933a-2212-44e7-879d-c43a27c8b2a7 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:36.755011 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2a933a-2212-44e7-879d-c43a27c8b2a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:36.755315 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2a933a-2212-44e7-879d-c43a27c8b2a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:36.766709 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2a933a-2212-44e7-879d-c43a27c8b2a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:36.768200 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2a933a-2212-44e7-879d-c43a27c8b2a7 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:36.768717 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099973de-757f-44fb-a519-d8daa156e703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:36.769408 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099973de-757f-44fb-a519-d8daa156e703 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:36.769686 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099973de-757f-44fb-a519-d8daa156e703 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:36.770079 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099973de-757f-44fb-a519-d8daa156e703 None admin] PATH_INFO: `/v3/domains` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:36.770737 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099973de-757f-44fb-a519-d8daa156e703 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:59:36.771031 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099973de-757f-44fb-a519-d8daa156e703 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:36.772416 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099973de-757f-44fb-a519-d8daa156e703 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:36.790941 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 228/465] 10.222.0.79 () {56 vars in 1109 bytes} [Tue Aug 30 00:59:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:59:36.790941 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3146f64-55a5-4239-8c4e-105c8cb0d535 None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:36.790941 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3146f64-55a5-4239-8c4e-105c8cb0d535 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:36.791493 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-bb2a933a-2212-44e7-879d-c43a27c8b2a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:59:36.791493 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:59:36.791493 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:59:36.791493 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:59:36.791493 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:59:36.791493 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:59:36.791493 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:59:36.791493 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:59:36.791493 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:59:36.791493 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:59:36.791493 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:59:36.791493 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:59:36.791493 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:59:36.791493 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:59:36.791493 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:59:36.791493 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:59:36.792306 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:59:36.792306 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:59:36.792306 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:59:36.792306 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:59:36.792306 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:59:36.792306 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:59:36.792306 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:59:36.792306 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Aug 30 00:59:36.792306 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:59:36.792306 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:59:36.792306 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:59:36.792306 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:59:36.792306 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:59:36.792306 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:59:36.792306 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:59:36.792306 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:59:36.792306 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:59:36.793162 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:59:36.793162 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:59:36.793162 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Aug 30 00:59:36.793323 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3146f64-55a5-4239-8c4e-105c8cb0d535 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:36.794163 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 238/466] 10.222.0.79 () {56 vars in 1108 bytes} [Tue Aug 30 00:59:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:59:36.794974 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2a933a-2212-44e7-879d-c43a27c8b2a7 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:36.814177 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-d3146f64-55a5-4239-8c4e-105c8cb0d535 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:59:36.815417 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-d3146f64-55a5-4239-8c4e-105c8cb0d535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:59:36.889624 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:36.899950 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 229/467] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 00:59:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:59:36.908334 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3146f64-55a5-4239-8c4e-105c8cb0d535 None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:36.921805 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2a933a-2212-44e7-879d-c43a27c8b2a7 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:36.972745 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c246911b-2e53-4c3a-974b-755de22aaa56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:36.973257 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c246911b-2e53-4c3a-974b-755de22aaa56 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:36.973532 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c246911b-2e53-4c3a-974b-755de22aaa56 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:36.973800 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c246911b-2e53-4c3a-974b-755de22aaa56 None admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:36.974442 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c246911b-2e53-4c3a-974b-755de22aaa56 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:59:36.974738 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c246911b-2e53-4c3a-974b-755de22aaa56 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:36.976125 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c246911b-2e53-4c3a-974b-755de22aaa56 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:36.995588 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 239/468] 10.222.0.79 () {56 vars in 1109 bytes} [Tue Aug 30 00:59:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:59:36.996540 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c246911b-2e53-4c3a-974b-755de22aaa56 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:37.013140 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:37.042271 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3146f64-55a5-4239-8c4e-105c8cb0d535 None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:37.084434 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239171e8-0111-45e2-9318-aec4c38a301b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:37.085849 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239171e8-0111-45e2-9318-aec4c38a301b None admin] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:37.086567 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239171e8-0111-45e2-9318-aec4c38a301b None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:37.087039 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239171e8-0111-45e2-9318-aec4c38a301b None admin] PATH_INFO: `/v3/users` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:37.088243 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239171e8-0111-45e2-9318-aec4c38a301b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:37.090340 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239171e8-0111-45e2-9318-aec4c38a301b None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:37.105262 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c246911b-2e53-4c3a-974b-755de22aaa56 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:37.124306 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 230/469] 10.222.0.79 () {60 vars in 1132 bytes} [Tue Aug 30 00:59:36 2022] POST /identity/v3/users => generated 248 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:59:37.125491 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239171e8-0111-45e2-9318-aec4c38a301b None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:37.182439 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d6d8b7-6c85-484f-828d-a64d6e1be604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:37.183173 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d6d8b7-6c85-484f-828d-a64d6e1be604 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:37.183522 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d6d8b7-6c85-484f-828d-a64d6e1be604 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:37.183861 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d6d8b7-6c85-484f-828d-a64d6e1be604 None admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:37.185111 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d6d8b7-6c85-484f-828d-a64d6e1be604 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:59:37.185906 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d6d8b7-6c85-484f-828d-a64d6e1be604 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:37.192726 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d6d8b7-6c85-484f-828d-a64d6e1be604 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:37.195273 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:37.209108 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 240/470] 10.222.0.79 () {56 vars in 1109 bytes} [Tue Aug 30 00:59:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:59:37.214872 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d6d8b7-6c85-484f-828d-a64d6e1be604 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:37.287874 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239171e8-0111-45e2-9318-aec4c38a301b None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:37.329892 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:37.334870 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e88d12-fec1-4d87-b29f-accad19c9a75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:37.335526 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e88d12-fec1-4d87-b29f-accad19c9a75 None admin] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:37.335804 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e88d12-fec1-4d87-b29f-accad19c9a75 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:37.336063 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e88d12-fec1-4d87-b29f-accad19c9a75 None admin] PATH_INFO: `/v3/users` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:37.336715 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e88d12-fec1-4d87-b29f-accad19c9a75 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:37.338254 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e88d12-fec1-4d87-b29f-accad19c9a75 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:37.362542 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 231/471] 10.222.0.79 () {60 vars in 1132 bytes} [Tue Aug 30 00:59:37 2022] POST /identity/v3/users => generated 248 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:59:37.363781 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e88d12-fec1-4d87-b29f-accad19c9a75 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:37.370598 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d6d8b7-6c85-484f-828d-a64d6e1be604 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:37.423006 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907f72db-82cf-407e-b182-4bf91318386f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:37.423704 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907f72db-82cf-407e-b182-4bf91318386f None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:37.423984 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907f72db-82cf-407e-b182-4bf91318386f None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:37.424258 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907f72db-82cf-407e-b182-4bf91318386f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:37.439474 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907f72db-82cf-407e-b182-4bf91318386f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:37.441003 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907f72db-82cf-407e-b182-4bf91318386f None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:37.461466 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-907f72db-82cf-407e-b182-4bf91318386f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:59:37.461466 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:59:37.461466 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:59:37.461466 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:59:37.461466 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:59:37.461466 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:59:37.461466 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:59:37.461466 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:59:37.461466 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:59:37.461466 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:59:37.461466 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:59:37.461466 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:59:37.461466 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:59:37.461466 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:59:37.461466 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:59:37.461466 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:59:37.462448 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:59:37.462448 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:59:37.462448 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:59:37.462448 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:59:37.462448 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:59:37.462448 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:59:37.462448 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:59:37.462448 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Aug 30 00:59:37.462448 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:59:37.462448 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:59:37.462448 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:59:37.462448 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:59:37.462448 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:59:37.462448 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:59:37.462448 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:59:37.462448 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:59:37.462448 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:59:37.463340 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:59:37.463340 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:59:37.463340 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Aug 30 00:59:37.463340 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 241/472] 10.222.0.79 () {56 vars in 1108 bytes} [Tue Aug 30 00:59:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:59:37.464358 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53e1b85-f677-4e23-9d21-b1976428dc96 None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:37.464639 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53e1b85-f677-4e23-9d21-b1976428dc96 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:37.464908 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53e1b85-f677-4e23-9d21-b1976428dc96 None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:37.466871 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 242/473] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 00:59:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:59:37.468788 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53e1b85-f677-4e23-9d21-b1976428dc96 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:37.527255 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e88d12-fec1-4d87-b29f-accad19c9a75 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:37.535752 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:37.574567 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffe8535-22bc-4ea6-a8a7-8c4d8f89e24a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:37.576055 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffe8535-22bc-4ea6-a8a7-8c4d8f89e24a None admin] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:37.576055 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffe8535-22bc-4ea6-a8a7-8c4d8f89e24a None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:37.576055 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffe8535-22bc-4ea6-a8a7-8c4d8f89e24a None admin] PATH_INFO: `/v3/users` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:37.576643 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffe8535-22bc-4ea6-a8a7-8c4d8f89e24a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:37.578633 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffe8535-22bc-4ea6-a8a7-8c4d8f89e24a None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:37.605706 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 232/474] 10.222.0.79 () {60 vars in 1132 bytes} [Tue Aug 30 00:59:37 2022] POST /identity/v3/users => generated 246 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:59:37.607622 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ea19a7-5cea-4b60-b9fd-c66bf3c6f9a0 None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:37.607906 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ea19a7-5cea-4b60-b9fd-c66bf3c6f9a0 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:37.608225 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ea19a7-5cea-4b60-b9fd-c66bf3c6f9a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:37.628618 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53e1b85-f677-4e23-9d21-b1976428dc96 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:37.630172 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-10ea19a7-5cea-4b60-b9fd-c66bf3c6f9a0 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:59:37.631397 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-10ea19a7-5cea-4b60-b9fd-c66bf3c6f9a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:59:37.673855 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9955c6df-4aac-47ad-9ab1-52127ac05cef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:37.674447 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9955c6df-4aac-47ad-9ab1-52127ac05cef None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:37.674710 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9955c6df-4aac-47ad-9ab1-52127ac05cef None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:37.674981 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9955c6df-4aac-47ad-9ab1-52127ac05cef None admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:37.675743 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9955c6df-4aac-47ad-9ab1-52127ac05cef None admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:59:37.676042 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9955c6df-4aac-47ad-9ab1-52127ac05cef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:37.678138 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9955c6df-4aac-47ad-9ab1-52127ac05cef None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:37.693067 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 243/475] 10.222.0.79 () {56 vars in 1109 bytes} [Tue Aug 30 00:59:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:59:37.693432 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:37.704631 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9955c6df-4aac-47ad-9ab1-52127ac05cef None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:37.739493 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 233/476] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 00:59:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:59:37.866982 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9955c6df-4aac-47ad-9ab1-52127ac05cef None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:37.907419 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e21908-51e2-4b37-b34c-7334ed603d55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:37.908396 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e21908-51e2-4b37-b34c-7334ed603d55 None admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:37.908868 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e21908-51e2-4b37-b34c-7334ed603d55 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:37.909366 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e21908-51e2-4b37-b34c-7334ed603d55 None admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:37.910260 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e21908-51e2-4b37-b34c-7334ed603d55 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:37.912024 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e21908-51e2-4b37-b34c-7334ed603d55 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:37.940124 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 244/477] 10.222.0.79 () {60 vars in 1132 bytes} [Tue Aug 30 00:59:37 2022] POST /identity/v3/users => generated 249 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:59:38.078149 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ea19a7-5cea-4b60-b9fd-c66bf3c6f9a0 None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:38.219977 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:38.242769 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ea19a7-5cea-4b60-b9fd-c66bf3c6f9a0 None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:38.282307 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b3f4e4-c3c7-48ad-bbf2-8375fdc823ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:38.282916 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b3f4e4-c3c7-48ad-bbf2-8375fdc823ff None admin] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:38.283213 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b3f4e4-c3c7-48ad-bbf2-8375fdc823ff None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:38.283482 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b3f4e4-c3c7-48ad-bbf2-8375fdc823ff None admin] PATH_INFO: `/v3/roles` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:38.284153 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b3f4e4-c3c7-48ad-bbf2-8375fdc823ff None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:38.285514 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b3f4e4-c3c7-48ad-bbf2-8375fdc823ff None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:38.297052 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.sql.core [None req-c4b3f4e4-c3c7-48ad-bbf2-8375fdc823ff None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 30 00:59:38.297052 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 30 00:59:38.297052 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [parameters: {'id': 'bfb77f7c7208478d81e4ca43cc831e28', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 30 00:59:38.297052 dv-cinder-819667-6-smb devstack@keystone.service[81998]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81998) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 30 00:59:38.314613 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application [None req-c4b3f4e4-c3c7-48ad-bbf2-8375fdc823ff None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 30 00:59:38.314613 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:59:38.314613 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 30 00:59:38.314613 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 30 00:59:38.314613 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 30 00:59:38.314613 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 30 00:59:38.314613 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 30 00:59:38.314613 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application result = self._query(query) Aug 30 00:59:38.314613 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 30 00:59:38.314613 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application conn.query(q) Aug 30 00:59:38.314613 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 30 00:59:38.314613 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 30 00:59:38.314613 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 30 00:59:38.314613 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application result.read() Aug 30 00:59:38.314613 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 30 00:59:38.315550 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 30 00:59:38.315550 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 30 00:59:38.315550 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 30 00:59:38.315550 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 30 00:59:38.315550 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 30 00:59:38.315550 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 30 00:59:38.315550 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 30 00:59:38.315550 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 30 00:59:38.315550 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Aug 30 00:59:38.315550 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 30 00:59:38.315550 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Aug 30 00:59:38.315550 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:59:38.315550 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 30 00:59:38.315550 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 30 00:59:38.315550 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 30 00:59:38.315550 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return ref.to_dict() Aug 30 00:59:38.315550 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 30 00:59:38.315550 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application next(self.gen) Aug 30 00:59:38.316459 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 30 00:59:38.316459 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application yield resource Aug 30 00:59:38.316459 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 30 00:59:38.316459 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application next(self.gen) Aug 30 00:59:38.316459 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 30 00:59:38.316459 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application self.session.rollback() Aug 30 00:59:38.316459 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 00:59:38.316459 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application self.force_reraise() Aug 30 00:59:38.316459 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 00:59:38.316459 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application raise self.value Aug 30 00:59:38.316459 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 30 00:59:38.316459 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 30 00:59:38.316459 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 30 00:59:38.316459 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application session.commit() Aug 30 00:59:38.316459 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 30 00:59:38.316459 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 30 00:59:38.316459 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 30 00:59:38.317557 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application self._prepare_impl() Aug 30 00:59:38.317557 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 30 00:59:38.317557 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application self.session.flush() Aug 30 00:59:38.317557 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 30 00:59:38.317557 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application self._flush(objects) Aug 30 00:59:38.317557 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 30 00:59:38.317557 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 30 00:59:38.317557 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 30 00:59:38.317557 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application compat.raise_( Aug 30 00:59:38.317557 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 30 00:59:38.317557 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application raise exception Aug 30 00:59:38.317557 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 30 00:59:38.317557 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application flush_context.execute() Aug 30 00:59:38.317557 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 30 00:59:38.317557 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application rec.execute(self) Aug 30 00:59:38.317557 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 30 00:59:38.317557 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 30 00:59:38.318424 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 30 00:59:38.318424 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 30 00:59:38.318424 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 30 00:59:38.318424 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 30 00:59:38.318424 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 30 00:59:38.318424 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 30 00:59:38.318424 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 30 00:59:38.318424 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 30 00:59:38.318424 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 30 00:59:38.318424 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 30 00:59:38.318424 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 30 00:59:38.318424 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 30 00:59:38.318424 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 30 00:59:38.318424 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 30 00:59:38.318424 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 30 00:59:38.318424 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application raise exception Aug 30 00:59:38.320287 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 30 00:59:38.320287 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 30 00:59:38.320287 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 30 00:59:38.320287 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 30 00:59:38.320287 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 30 00:59:38.320287 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application result = self._query(query) Aug 30 00:59:38.320287 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 30 00:59:38.320287 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application conn.query(q) Aug 30 00:59:38.320287 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 30 00:59:38.320287 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 30 00:59:38.320287 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 30 00:59:38.320287 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application result.read() Aug 30 00:59:38.320287 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 30 00:59:38.320287 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 30 00:59:38.320287 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 30 00:59:38.320287 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 30 00:59:38.324949 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 30 00:59:38.324949 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 30 00:59:38.324949 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 30 00:59:38.324949 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 30 00:59:38.324949 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 30 00:59:38.324949 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 30 00:59:38.324949 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application [parameters: {'id': 'bfb77f7c7208478d81e4ca43cc831e28', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 30 00:59:38.324949 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 30 00:59:38.324949 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Aug 30 00:59:38.324949 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 00:59:38.324949 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Aug 30 00:59:38.324949 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:59:38.324949 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:59:38.324949 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:59:38.324949 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:59:38.324949 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:59:38.328958 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:59:38.328958 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:59:38.328958 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:59:38.328958 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:59:38.328958 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:59:38.328958 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:59:38.328958 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 30 00:59:38.328958 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 30 00:59:38.328958 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:59:38.328958 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:59:38.328958 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 30 00:59:38.328958 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 30 00:59:38.328958 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 30 00:59:38.328958 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 30 00:59:38.328958 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 30 00:59:38.328958 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Aug 30 00:59:38.331425 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 234/478] 10.222.0.79 () {60 vars in 1131 bytes} [Tue Aug 30 00:59:38 2022] POST /identity/v3/roles => generated 144 bytes in 238 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:59:38.331558 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e21908-51e2-4b37-b34c-7334ed603d55 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:38.374872 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:38.445360 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e21908-51e2-4b37-b34c-7334ed603d55 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:38.492245 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b967550b-e3b9-4e7d-9029-6e28e8254d1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:38.492888 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b967550b-e3b9-4e7d-9029-6e28e8254d1e None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:38.493168 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b967550b-e3b9-4e7d-9029-6e28e8254d1e None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:38.493447 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b967550b-e3b9-4e7d-9029-6e28e8254d1e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:38.511637 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b967550b-e3b9-4e7d-9029-6e28e8254d1e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:59:38.517375 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-b967550b-e3b9-4e7d-9029-6e28e8254d1e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 00:59:38.517375 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:59:38.517375 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:59:38.517375 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:59:38.517375 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:59:38.517375 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:59:38.517375 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:59:38.517375 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:59:38.517375 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:59:38.517375 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:59:38.517375 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:59:38.517375 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:59:38.517375 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:59:38.517375 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:59:38.517375 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:59:38.517375 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:59:38.518318 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:59:38.518318 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:59:38.518318 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:59:38.518318 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:59:38.518318 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:59:38.518318 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:59:38.518318 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:59:38.518318 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:59:38.518318 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:59:38.518318 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:59:38.518318 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:59:38.518318 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Aug 30 00:59:38.518318 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:59:38.518318 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:59:38.518318 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:59:38.518318 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:59:38.519090 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:59:38.519090 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:59:38.519090 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:59:38.519090 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:59:38.519090 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:59:38.519090 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:59:38.519090 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:59:38.519090 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:59:38.519090 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:59:38.519090 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:59:38.519090 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 00:59:38.519090 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Aug 30 00:59:38.519090 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 245/479] 10.222.0.79 () {56 vars in 1114 bytes} [Tue Aug 30 00:59:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:59:38.524483 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b3f4e4-c3c7-48ad-bbf2-8375fdc823ff None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:38.713632 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b3f4e4-c3c7-48ad-bbf2-8375fdc823ff None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:38.761050 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a66bc61-2730-4d82-9447-4f33952e186e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:38.761574 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a66bc61-2730-4d82-9447-4f33952e186e None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:38.761852 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a66bc61-2730-4d82-9447-4f33952e186e None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:38.762122 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a66bc61-2730-4d82-9447-4f33952e186e None admin] PATH_INFO: `/v3/roles` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:38.763748 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a66bc61-2730-4d82-9447-4f33952e186e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:59:38.764050 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a66bc61-2730-4d82-9447-4f33952e186e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:38.765416 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a66bc61-2730-4d82-9447-4f33952e186e None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:38.779764 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 235/480] 10.222.0.79 () {56 vars in 1111 bytes} [Tue Aug 30 00:59:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:59:39.548691 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59d339a-a3c1-4017-a912-6ffd397735eb None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:39.549182 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59d339a-a3c1-4017-a912-6ffd397735eb None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:39.549182 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59d339a-a3c1-4017-a912-6ffd397735eb None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:39.550765 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 246/481] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 00:59:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:59:39.556026 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eed0955-3612-4f22-b1da-eab7c01d7dbb None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:39.556489 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eed0955-3612-4f22-b1da-eab7c01d7dbb None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:39.556573 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eed0955-3612-4f22-b1da-eab7c01d7dbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:39.577823 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-2eed0955-3612-4f22-b1da-eab7c01d7dbb None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:59:39.579025 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-2eed0955-3612-4f22-b1da-eab7c01d7dbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:59:39.606451 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:39.689255 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 236/482] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 00:59:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:59:39.734210 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61ef516-ff2d-421c-90ce-ca5087a4bf34 None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:39.734535 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61ef516-ff2d-421c-90ce-ca5087a4bf34 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:39.734756 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61ef516-ff2d-421c-90ce-ca5087a4bf34 None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:39.736389 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 247/483] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 00:59:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:59:39.741772 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148b07ee-dfb9-42f3-9c78-77ab309e0a4d None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:39.742064 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148b07ee-dfb9-42f3-9c78-77ab309e0a4d None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:39.742342 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148b07ee-dfb9-42f3-9c78-77ab309e0a4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:39.770900 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-148b07ee-dfb9-42f3-9c78-77ab309e0a4d None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:59:39.772129 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-148b07ee-dfb9-42f3-9c78-77ab309e0a4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:59:39.852749 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 237/484] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 00:59:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:59:40.147996 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61ef516-ff2d-421c-90ce-ca5087a4bf34 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:40.167553 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148b07ee-dfb9-42f3-9c78-77ab309e0a4d None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:40.300218 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61ef516-ff2d-421c-90ce-ca5087a4bf34 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:40.303639 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:40.312966 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:40.340465 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dd550d-2f47-4a01-bc59-78b7646254be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:40.341851 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dd550d-2f47-4a01-bc59-78b7646254be None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:40.342402 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dd550d-2f47-4a01-bc59-78b7646254be None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:40.342915 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dd550d-2f47-4a01-bc59-78b7646254be None admin] PATH_INFO: `/v3/roles/service` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:40.357520 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dd550d-2f47-4a01-bc59-78b7646254be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:59:40.362884 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148b07ee-dfb9-42f3-9c78-77ab309e0a4d None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:40.364113 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-c8dd550d-2f47-4a01-bc59-78b7646254be None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 00:59:40.364113 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:59:40.364113 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:59:40.364113 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:59:40.364113 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:59:40.364113 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:59:40.364113 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:59:40.364113 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:59:40.364113 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:59:40.364113 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:59:40.364113 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:59:40.364113 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:59:40.364113 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:59:40.364113 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:59:40.364113 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:59:40.364113 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:59:40.365000 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:59:40.365000 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:59:40.365000 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:59:40.365000 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:59:40.365000 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:59:40.365000 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:59:40.365000 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:59:40.365000 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:59:40.365000 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:59:40.365000 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:59:40.365000 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:59:40.365000 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Aug 30 00:59:40.365000 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:59:40.365000 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:59:40.365000 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:59:40.365000 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:59:40.365811 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:59:40.365811 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:59:40.365811 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:59:40.365811 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:59:40.365811 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:59:40.365811 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:59:40.365811 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:59:40.365811 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:59:40.365811 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:59:40.365811 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:59:40.365811 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 00:59:40.365811 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Aug 30 00:59:40.369088 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 248/485] 10.222.0.79 () {56 vars in 1102 bytes} [Tue Aug 30 00:59:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:59:40.371085 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673f9674-cb33-4406-86ad-ade8a91830d7 None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:40.371541 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673f9674-cb33-4406-86ad-ade8a91830d7 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:40.372479 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673f9674-cb33-4406-86ad-ade8a91830d7 None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:40.374982 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 249/486] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 00:59:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:59:40.376059 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673f9674-cb33-4406-86ad-ade8a91830d7 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:40.409318 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5925b741-b596-4bbc-959c-542ab2f28ce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:40.410113 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5925b741-b596-4bbc-959c-542ab2f28ce4 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:40.410488 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5925b741-b596-4bbc-959c-542ab2f28ce4 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:40.410853 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5925b741-b596-4bbc-959c-542ab2f28ce4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:40.424653 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5925b741-b596-4bbc-959c-542ab2f28ce4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:59:40.429900 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application [None req-5925b741-b596-4bbc-959c-542ab2f28ce4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 00:59:40.429900 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:59:40.429900 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:59:40.429900 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:59:40.429900 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:59:40.429900 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:59:40.429900 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:59:40.429900 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:59:40.429900 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:59:40.429900 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:59:40.429900 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:59:40.429900 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:59:40.429900 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:59:40.429900 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:59:40.429900 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:59:40.429900 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:59:40.431030 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:59:40.431030 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:59:40.431030 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:59:40.431030 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:59:40.431030 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:59:40.431030 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:59:40.431030 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:59:40.431030 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:59:40.431030 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:59:40.431030 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:59:40.431030 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:59:40.431030 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application with Lock( Aug 30 00:59:40.431030 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:59:40.431030 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:59:40.431030 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:59:40.431030 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:59:40.432058 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:59:40.432058 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:59:40.432058 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:59:40.432058 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:59:40.432058 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:59:40.432058 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:59:40.432058 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:59:40.432058 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:59:40.432058 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:59:40.432058 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:59:40.432058 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 00:59:40.432058 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Aug 30 00:59:40.439033 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 238/487] 10.222.0.79 () {56 vars in 1102 bytes} [Tue Aug 30 00:59:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 00:59:40.440832 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e3aecb-2f63-437b-a724-22b04db9b246 None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:40.441215 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e3aecb-2f63-437b-a724-22b04db9b246 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:40.442207 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e3aecb-2f63-437b-a724-22b04db9b246 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:40.463529 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-e9e3aecb-2f63-437b-a724-22b04db9b246 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:59:40.464891 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-e9e3aecb-2f63-437b-a724-22b04db9b246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:59:40.516140 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673f9674-cb33-4406-86ad-ade8a91830d7 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:40.559246 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 239/488] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 00:59:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:59:40.561076 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e3aecb-2f63-437b-a724-22b04db9b246 None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:40.564655 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a467329-36fc-48e6-93e9-c683100fba19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:40.565720 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a467329-36fc-48e6-93e9-c683100fba19 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:40.566150 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a467329-36fc-48e6-93e9-c683100fba19 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:40.566794 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a467329-36fc-48e6-93e9-c683100fba19 None admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:40.567628 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a467329-36fc-48e6-93e9-c683100fba19 None admin] RBAC: Adding query filter params (name=service) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:59:40.568070 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a467329-36fc-48e6-93e9-c683100fba19 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:40.570546 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a467329-36fc-48e6-93e9-c683100fba19 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:40.581146 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 250/489] 10.222.0.79 () {56 vars in 1103 bytes} [Tue Aug 30 00:59:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:59:40.587467 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a467329-36fc-48e6-93e9-c683100fba19 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:40.616362 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:40.649840 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:40.688268 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e3aecb-2f63-437b-a724-22b04db9b246 None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:40.698256 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a467329-36fc-48e6-93e9-c683100fba19 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:40.734614 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665178bf-f4ff-4ce1-b1a2-98cd40a224df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:40.735622 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665178bf-f4ff-4ce1-b1a2-98cd40a224df None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:40.736212 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665178bf-f4ff-4ce1-b1a2-98cd40a224df None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:40.736775 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665178bf-f4ff-4ce1-b1a2-98cd40a224df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:40.739984 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b79693a-c3e4-4bc3-a9d9-08d3ffefc714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:40.740586 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b79693a-c3e4-4bc3-a9d9-08d3ffefc714 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:40.740871 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b79693a-c3e4-4bc3-a9d9-08d3ffefc714 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:40.741195 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b79693a-c3e4-4bc3-a9d9-08d3ffefc714 None admin] PATH_INFO: `/v3/roles` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:40.741874 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b79693a-c3e4-4bc3-a9d9-08d3ffefc714 None admin] RBAC: Adding query filter params (name=service) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:59:40.742233 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b79693a-c3e4-4bc3-a9d9-08d3ffefc714 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:40.743664 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b79693a-c3e4-4bc3-a9d9-08d3ffefc714 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:40.750713 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665178bf-f4ff-4ce1-b1a2-98cd40a224df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:40.752487 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665178bf-f4ff-4ce1-b1a2-98cd40a224df None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:40.756432 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 240/490] 10.222.0.79 () {56 vars in 1103 bytes} [Tue Aug 30 00:59:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:59:40.757762 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caedf72a-72e7-4d00-a8d1-2bd791dd25ae None None] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:40.758194 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caedf72a-72e7-4d00-a8d1-2bd791dd25ae None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:40.758606 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caedf72a-72e7-4d00-a8d1-2bd791dd25ae None None] PATH_INFO: `/` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:40.766556 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 241/491] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 00:59:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:59:40.767514 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caedf72a-72e7-4d00-a8d1-2bd791dd25ae None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:40.770554 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-665178bf-f4ff-4ce1-b1a2-98cd40a224df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:59:40.770554 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:59:40.770554 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:59:40.770554 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:59:40.770554 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:59:40.770554 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:59:40.770554 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:59:40.770554 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:59:40.770554 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:59:40.770554 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:59:40.770554 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:59:40.770554 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:59:40.770554 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:59:40.770554 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:59:40.770554 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:59:40.770554 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:59:40.771497 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:59:40.771497 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:59:40.771497 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:59:40.771497 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:59:40.771497 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:59:40.771497 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:59:40.771497 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:59:40.771497 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Aug 30 00:59:40.771497 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:59:40.771497 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:59:40.771497 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:59:40.771497 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:59:40.771497 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:59:40.771497 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:59:40.771497 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:59:40.771497 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:59:40.771497 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:59:40.772371 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:59:40.772371 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:59:40.772371 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Aug 30 00:59:40.774360 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 251/492] 10.222.0.79 () {56 vars in 1108 bytes} [Tue Aug 30 00:59:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:59:40.775767 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73392fe0-f95e-445e-b4a7-2e7f53475c36 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:40.776291 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73392fe0-f95e-445e-b4a7-2e7f53475c36 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:40.776881 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73392fe0-f95e-445e-b4a7-2e7f53475c36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:40.796861 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-73392fe0-f95e-445e-b4a7-2e7f53475c36 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:59:40.798391 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-73392fe0-f95e-445e-b4a7-2e7f53475c36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:59:40.875070 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 252/493] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 00:59:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:59:40.876386 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73392fe0-f95e-445e-b4a7-2e7f53475c36 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:40.885413 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:40.900705 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caedf72a-72e7-4d00-a8d1-2bd791dd25ae None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:40.937907 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:40.947537 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4c61b8-c739-440d-a0e0-827974aa48ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:40.948100 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4c61b8-c739-440d-a0e0-827974aa48ef None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:40.948378 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4c61b8-c739-440d-a0e0-827974aa48ef None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:40.948650 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4c61b8-c739-440d-a0e0-827974aa48ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:40.961494 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4c61b8-c739-440d-a0e0-827974aa48ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:40.962968 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4c61b8-c739-440d-a0e0-827974aa48ef None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:40.979239 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application [None req-bc4c61b8-c739-440d-a0e0-827974aa48ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:59:40.979239 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:59:40.979239 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:59:40.979239 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:59:40.979239 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:59:40.979239 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:59:40.979239 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:59:40.979239 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:59:40.979239 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:59:40.979239 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:59:40.979239 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:59:40.979239 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:59:40.979239 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:59:40.979239 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:59:40.979239 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:59:40.979239 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:59:40.980251 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:59:40.980251 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:59:40.980251 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:59:40.980251 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:59:40.980251 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:59:40.980251 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:59:40.980251 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:59:40.980251 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application with Lock( Aug 30 00:59:40.980251 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:59:40.980251 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:59:40.980251 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:59:40.980251 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:59:40.980251 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:59:40.980251 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:59:40.980251 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:59:40.980251 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:59:40.980251 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:59:40.981096 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:59:40.981096 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:59:40.981096 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Aug 30 00:59:40.981096 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 242/494] 10.222.0.79 () {56 vars in 1108 bytes} [Tue Aug 30 00:59:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:59:40.981972 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4c61b8-c739-440d-a0e0-827974aa48ef None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:40.996534 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73392fe0-f95e-445e-b4a7-2e7f53475c36 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:41.035721 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e05dca8-2f20-4fc2-9d13-4fe4d1e15110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:41.036715 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e05dca8-2f20-4fc2-9d13-4fe4d1e15110 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:41.037189 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e05dca8-2f20-4fc2-9d13-4fe4d1e15110 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:41.037650 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e05dca8-2f20-4fc2-9d13-4fe4d1e15110 None admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:41.038488 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e05dca8-2f20-4fc2-9d13-4fe4d1e15110 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:59:41.039035 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e05dca8-2f20-4fc2-9d13-4fe4d1e15110 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:41.040643 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e05dca8-2f20-4fc2-9d13-4fe4d1e15110 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:41.054672 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 253/495] 10.222.0.79 () {56 vars in 1109 bytes} [Tue Aug 30 00:59:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:59:41.055931 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e05dca8-2f20-4fc2-9d13-4fe4d1e15110 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:41.110094 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4c61b8-c739-440d-a0e0-827974aa48ef None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:41.127519 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:41.147171 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19f523d-d83a-4cae-9763-301d347f77be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:41.147744 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19f523d-d83a-4cae-9763-301d347f77be None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:41.148024 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19f523d-d83a-4cae-9763-301d347f77be None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:41.148299 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19f523d-d83a-4cae-9763-301d347f77be None admin] PATH_INFO: `/v3/roles/service` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:41.160946 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19f523d-d83a-4cae-9763-301d347f77be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:59:41.166635 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application [None req-c19f523d-d83a-4cae-9763-301d347f77be None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 00:59:41.166635 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:59:41.166635 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:59:41.166635 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:59:41.166635 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:59:41.166635 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:59:41.166635 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:59:41.166635 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:59:41.166635 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:59:41.166635 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:59:41.166635 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:59:41.166635 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:59:41.166635 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:59:41.166635 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:59:41.166635 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:59:41.166635 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:59:41.167626 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:59:41.167626 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:59:41.167626 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:59:41.167626 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:59:41.167626 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:59:41.167626 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:59:41.167626 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:59:41.167626 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:59:41.167626 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:59:41.167626 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:59:41.167626 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:59:41.167626 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application with Lock( Aug 30 00:59:41.167626 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:59:41.167626 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:59:41.167626 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:59:41.167626 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:59:41.168427 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:59:41.168427 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:59:41.168427 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:59:41.168427 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:59:41.168427 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:59:41.168427 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:59:41.168427 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:59:41.168427 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:59:41.168427 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:59:41.168427 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:59:41.168427 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 00:59:41.168427 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Aug 30 00:59:41.168427 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 243/496] 10.222.0.79 () {56 vars in 1102 bytes} [Tue Aug 30 00:59:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:59:41.169274 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19f523d-d83a-4cae-9763-301d347f77be None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:41.177281 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e05dca8-2f20-4fc2-9d13-4fe4d1e15110 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:41.221945 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d11c0d2-d54e-4c52-bcdf-30a557b35655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:41.222588 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d11c0d2-d54e-4c52-bcdf-30a557b35655 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:41.222942 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d11c0d2-d54e-4c52-bcdf-30a557b35655 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:41.223425 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d11c0d2-d54e-4c52-bcdf-30a557b35655 None admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:41.224046 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d11c0d2-d54e-4c52-bcdf-30a557b35655 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:59:41.224347 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d11c0d2-d54e-4c52-bcdf-30a557b35655 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:41.225206 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:41.225946 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d11c0d2-d54e-4c52-bcdf-30a557b35655 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:41.245584 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 254/497] 10.222.0.79 () {56 vars in 1109 bytes} [Tue Aug 30 00:59:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:59:41.246793 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d11c0d2-d54e-4c52-bcdf-30a557b35655 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:41.300697 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19f523d-d83a-4cae-9763-301d347f77be None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:41.348936 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50549478-87c0-4ec4-8516-80c59efb1b62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:41.349676 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50549478-87c0-4ec4-8516-80c59efb1b62 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:41.349962 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50549478-87c0-4ec4-8516-80c59efb1b62 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:41.350237 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50549478-87c0-4ec4-8516-80c59efb1b62 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:41.359271 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50549478-87c0-4ec4-8516-80c59efb1b62 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:41.360733 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50549478-87c0-4ec4-8516-80c59efb1b62 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:41.362692 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d11c0d2-d54e-4c52-bcdf-30a557b35655 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:41.374798 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application [None req-50549478-87c0-4ec4-8516-80c59efb1b62 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 30 00:59:41.374798 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:59:41.374798 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:59:41.374798 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:59:41.374798 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:59:41.374798 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:59:41.374798 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:59:41.374798 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:59:41.374798 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:59:41.374798 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:59:41.374798 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:59:41.374798 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:59:41.374798 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 00:59:41.374798 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 00:59:41.374798 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 00:59:41.374798 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 00:59:41.376028 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:59:41.376028 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:59:41.376028 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 00:59:41.376028 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:59:41.376028 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 00:59:41.376028 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:59:41.376028 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:59:41.376028 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:59:41.376028 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:59:41.376028 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:59:41.376028 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:59:41.376028 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application with Lock( Aug 30 00:59:41.376028 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:59:41.376028 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:59:41.376028 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:59:41.376028 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:59:41.376028 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:59:41.376028 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:59:41.377079 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:59:41.377079 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:59:41.377079 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 00:59:41.377079 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 00:59:41.377079 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 00:59:41.377079 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 00:59:41.377079 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 00:59:41.377079 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 00:59:41.377079 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 30 00:59:41.377079 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Aug 30 00:59:41.377079 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 244/498] 10.222.0.79 () {56 vars in 1099 bytes} [Tue Aug 30 00:59:41 2022] GET /identity/v3/users/glance => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:59:41.379246 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50549478-87c0-4ec4-8516-80c59efb1b62 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:41.396151 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:41.408906 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a842f96-ee7d-4396-ab76-8441dda23ee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:41.409614 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a842f96-ee7d-4396-ab76-8441dda23ee0 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:41.409954 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a842f96-ee7d-4396-ab76-8441dda23ee0 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:41.410290 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a842f96-ee7d-4396-ab76-8441dda23ee0 None admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:41.411025 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a842f96-ee7d-4396-ab76-8441dda23ee0 None admin] RBAC: Adding query filter params (name=service) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:59:41.411442 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a842f96-ee7d-4396-ab76-8441dda23ee0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:41.412890 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a842f96-ee7d-4396-ab76-8441dda23ee0 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:41.421672 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 255/499] 10.222.0.79 () {56 vars in 1103 bytes} [Tue Aug 30 00:59:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:59:41.422495 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a842f96-ee7d-4396-ab76-8441dda23ee0 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:41.497705 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50549478-87c0-4ec4-8516-80c59efb1b62 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:41.499383 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:41.527723 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a842f96-ee7d-4396-ab76-8441dda23ee0 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:41.536129 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9cdd59-00fe-4361-a48a-36960abf1f1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:41.536780 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9cdd59-00fe-4361-a48a-36960abf1f1f None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:41.537066 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9cdd59-00fe-4361-a48a-36960abf1f1f None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:41.537328 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9cdd59-00fe-4361-a48a-36960abf1f1f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:41.548323 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9cdd59-00fe-4361-a48a-36960abf1f1f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:59:41.553660 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application [None req-ec9cdd59-00fe-4361-a48a-36960abf1f1f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 00:59:41.553660 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:59:41.553660 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:59:41.553660 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:59:41.553660 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:59:41.553660 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:59:41.553660 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:59:41.553660 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:59:41.553660 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:59:41.553660 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:59:41.553660 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:59:41.553660 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:59:41.553660 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:59:41.553660 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:59:41.553660 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:59:41.553660 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:59:41.554929 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:59:41.554929 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:59:41.554929 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:59:41.554929 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:59:41.554929 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:59:41.554929 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:59:41.554929 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:59:41.554929 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:59:41.554929 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:59:41.554929 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:59:41.554929 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:59:41.554929 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application with Lock( Aug 30 00:59:41.554929 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:59:41.554929 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:59:41.554929 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:59:41.554929 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:59:41.555918 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:59:41.555918 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:59:41.555918 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:59:41.555918 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:59:41.555918 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:59:41.555918 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:59:41.555918 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:59:41.555918 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:59:41.555918 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:59:41.555918 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:59:41.555918 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 00:59:41.555918 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Aug 30 00:59:41.555918 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 245/500] 10.222.0.79 () {56 vars in 1102 bytes} [Tue Aug 30 00:59:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:59:41.555918 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9cdd59-00fe-4361-a48a-36960abf1f1f None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:41.571088 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57cdfb7-a50e-4cc2-9d19-2d25b94cd8cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:41.571750 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57cdfb7-a50e-4cc2-9d19-2d25b94cd8cd None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:41.572030 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57cdfb7-a50e-4cc2-9d19-2d25b94cd8cd None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:41.572300 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57cdfb7-a50e-4cc2-9d19-2d25b94cd8cd None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:41.580318 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57cdfb7-a50e-4cc2-9d19-2d25b94cd8cd None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:41.582325 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57cdfb7-a50e-4cc2-9d19-2d25b94cd8cd None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:41.595497 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-c57cdfb7-a50e-4cc2-9d19-2d25b94cd8cd None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 30 00:59:41.595497 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:59:41.595497 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:59:41.595497 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:59:41.595497 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:59:41.595497 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:59:41.595497 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:59:41.595497 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:59:41.595497 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:59:41.595497 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:59:41.595497 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:59:41.595497 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:59:41.595497 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 00:59:41.595497 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 00:59:41.595497 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 00:59:41.595497 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 00:59:41.596481 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:59:41.596481 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:59:41.596481 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 00:59:41.596481 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:59:41.596481 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 00:59:41.596481 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:59:41.596481 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:59:41.596481 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:59:41.596481 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:59:41.596481 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:59:41.596481 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:59:41.596481 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Aug 30 00:59:41.596481 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:59:41.596481 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:59:41.596481 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:59:41.596481 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:59:41.596481 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:59:41.596481 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:59:41.597400 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:59:41.597400 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:59:41.597400 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 00:59:41.597400 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 00:59:41.597400 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 00:59:41.597400 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 00:59:41.597400 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 00:59:41.597400 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 00:59:41.597400 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 30 00:59:41.597400 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Aug 30 00:59:41.597400 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 256/501] 10.222.0.79 () {56 vars in 1099 bytes} [Tue Aug 30 00:59:41 2022] GET /identity/v3/users/cinder => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:59:41.597971 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ab7af7-6c4d-4fc9-bc44-fbe5f3691def None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:41.598319 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ab7af7-6c4d-4fc9-bc44-fbe5f3691def None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:41.598452 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ab7af7-6c4d-4fc9-bc44-fbe5f3691def None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:41.599692 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 257/502] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 00:59:41 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:59:41.600391 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ab7af7-6c4d-4fc9-bc44-fbe5f3691def None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:41.656669 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:41.675181 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9cdd59-00fe-4361-a48a-36960abf1f1f None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:41.710463 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e10f2e-a00d-49bc-8359-22028e1140c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:41.711082 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e10f2e-a00d-49bc-8359-22028e1140c0 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:41.711409 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e10f2e-a00d-49bc-8359-22028e1140c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:41.711686 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e10f2e-a00d-49bc-8359-22028e1140c0 None admin] PATH_INFO: `/v3/users` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:41.712431 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e10f2e-a00d-49bc-8359-22028e1140c0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:59:41.712736 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e10f2e-a00d-49bc-8359-22028e1140c0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:41.713758 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ab7af7-6c4d-4fc9-bc44-fbe5f3691def None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:41.714252 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e10f2e-a00d-49bc-8359-22028e1140c0 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:41.751926 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dab2c6-c1b5-40af-b6ae-700c856d37fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:41.752473 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dab2c6-c1b5-40af-b6ae-700c856d37fa None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:41.752745 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dab2c6-c1b5-40af-b6ae-700c856d37fa None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:41.753011 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dab2c6-c1b5-40af-b6ae-700c856d37fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:41.758148 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 246/503] 10.222.0.79 () {56 vars in 1137 bytes} [Tue Aug 30 00:59:41 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:59:41.759238 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e10f2e-a00d-49bc-8359-22028e1140c0 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:41.766373 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dab2c6-c1b5-40af-b6ae-700c856d37fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:41.767903 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dab2c6-c1b5-40af-b6ae-700c856d37fa None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:41.784259 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-f4dab2c6-c1b5-40af-b6ae-700c856d37fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:59:41.784259 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:59:41.784259 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:59:41.784259 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:59:41.784259 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:59:41.784259 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:59:41.784259 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:59:41.784259 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:59:41.784259 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:59:41.784259 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:59:41.784259 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:59:41.784259 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:59:41.784259 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:59:41.784259 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:59:41.784259 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:59:41.784259 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:59:41.785268 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:59:41.785268 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:59:41.785268 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:59:41.785268 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:59:41.785268 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:59:41.785268 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:59:41.785268 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:59:41.785268 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Aug 30 00:59:41.785268 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:59:41.785268 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:59:41.785268 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:59:41.785268 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:59:41.785268 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:59:41.785268 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:59:41.785268 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:59:41.785268 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:59:41.785268 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:59:41.786109 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:59:41.786109 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:59:41.786109 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Aug 30 00:59:41.786282 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:41.786352 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 258/504] 10.222.0.79 () {56 vars in 1108 bytes} [Tue Aug 30 00:59:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:59:41.786879 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dab2c6-c1b5-40af-b6ae-700c856d37fa None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:41.877613 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e10f2e-a00d-49bc-8359-22028e1140c0 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:41.895454 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:41.899374 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dab2c6-c1b5-40af-b6ae-700c856d37fa None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:41.917048 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9fc89d-4f6e-412e-a114-43f9de81c89a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:41.917683 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9fc89d-4f6e-412e-a114-43f9de81c89a None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:41.917960 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9fc89d-4f6e-412e-a114-43f9de81c89a None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:41.918229 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9fc89d-4f6e-412e-a114-43f9de81c89a None admin] PATH_INFO: `/v3/roles` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:41.919618 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9fc89d-4f6e-412e-a114-43f9de81c89a None admin] RBAC: Adding query filter params (name=service) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:59:41.920025 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9fc89d-4f6e-412e-a114-43f9de81c89a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:41.921458 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9fc89d-4f6e-412e-a114-43f9de81c89a None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:41.933391 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 247/505] 10.222.0.79 () {56 vars in 1103 bytes} [Tue Aug 30 00:59:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:59:41.934738 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4060dd85-58c8-4afd-93d4-91e1fc273517 None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:41.935296 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4060dd85-58c8-4afd-93d4-91e1fc273517 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:41.935296 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4060dd85-58c8-4afd-93d4-91e1fc273517 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:41.937712 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89865748-310a-47fe-9ded-065f0efcc88d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:41.938447 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89865748-310a-47fe-9ded-065f0efcc88d None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:41.938663 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89865748-310a-47fe-9ded-065f0efcc88d None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:41.939062 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89865748-310a-47fe-9ded-065f0efcc88d None admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:41.939728 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89865748-310a-47fe-9ded-065f0efcc88d None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:59:41.940028 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89865748-310a-47fe-9ded-065f0efcc88d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:41.941451 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89865748-310a-47fe-9ded-065f0efcc88d None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:41.955745 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-4060dd85-58c8-4afd-93d4-91e1fc273517 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:59:41.956951 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-4060dd85-58c8-4afd-93d4-91e1fc273517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:59:41.981567 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 259/506] 10.222.0.79 () {56 vars in 1137 bytes} [Tue Aug 30 00:59:41 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:59:41.982557 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89865748-310a-47fe-9ded-065f0efcc88d None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:42.039443 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 248/507] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 00:59:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:59:42.040996 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4060dd85-58c8-4afd-93d4-91e1fc273517 None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:42.067561 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:42.130221 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89865748-310a-47fe-9ded-065f0efcc88d None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:42.182823 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d10a24-e2b0-41ee-a4a6-1b421defb6ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:42.183342 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d10a24-e2b0-41ee-a4a6-1b421defb6ba None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:42.183624 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d10a24-e2b0-41ee-a4a6-1b421defb6ba None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:42.183895 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d10a24-e2b0-41ee-a4a6-1b421defb6ba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:42.198284 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4060dd85-58c8-4afd-93d4-91e1fc273517 None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:42.219111 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:42.246144 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae52eb2-d2a8-4c9a-86c0-ac8e18233cf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:42.246759 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae52eb2-d2a8-4c9a-86c0-ac8e18233cf1 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:42.248403 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae52eb2-d2a8-4c9a-86c0-ac8e18233cf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:42.248687 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae52eb2-d2a8-4c9a-86c0-ac8e18233cf1 None admin] PATH_INFO: `/v3/domains` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:42.249865 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae52eb2-d2a8-4c9a-86c0-ac8e18233cf1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:59:42.249865 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae52eb2-d2a8-4c9a-86c0-ac8e18233cf1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:42.251159 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae52eb2-d2a8-4c9a-86c0-ac8e18233cf1 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:42.264150 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 249/508] 10.222.0.79 () {56 vars in 1109 bytes} [Tue Aug 30 00:59:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:59:42.266193 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae52eb2-d2a8-4c9a-86c0-ac8e18233cf1 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:42.295667 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d10a24-e2b0-41ee-a4a6-1b421defb6ba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:42.297079 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d10a24-e2b0-41ee-a4a6-1b421defb6ba None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:42.364330 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:42.403064 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae52eb2-d2a8-4c9a-86c0-ac8e18233cf1 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:42.429757 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 260/509] 10.222.0.79 () {58 vars in 1282 bytes} [Tue Aug 30 00:59:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 00:59:42.431647 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d10a24-e2b0-41ee-a4a6-1b421defb6ba None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:42.445170 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de379de-eee4-4398-94c7-208290d735ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:42.445806 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de379de-eee4-4398-94c7-208290d735ef None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:42.446080 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de379de-eee4-4398-94c7-208290d735ef None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:42.446347 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de379de-eee4-4398-94c7-208290d735ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:42.458561 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de379de-eee4-4398-94c7-208290d735ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:42.460058 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de379de-eee4-4398-94c7-208290d735ef None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:42.475915 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application [None req-6de379de-eee4-4398-94c7-208290d735ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:59:42.475915 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:59:42.475915 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:59:42.475915 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:59:42.475915 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:59:42.475915 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:59:42.475915 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:59:42.475915 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:59:42.475915 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:59:42.475915 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:59:42.475915 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:59:42.475915 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:59:42.475915 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:59:42.475915 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:59:42.475915 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:59:42.475915 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:59:42.477078 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:59:42.477078 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:59:42.477078 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:59:42.477078 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:59:42.477078 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:59:42.477078 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:59:42.477078 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:59:42.477078 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application with Lock( Aug 30 00:59:42.477078 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:59:42.477078 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:59:42.477078 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:59:42.477078 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:59:42.477078 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:59:42.477078 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:59:42.477078 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:59:42.477078 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:59:42.477078 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:59:42.477941 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:59:42.477941 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:59:42.477941 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Aug 30 00:59:42.482608 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 250/510] 10.222.0.79 () {56 vars in 1108 bytes} [Tue Aug 30 00:59:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:59:42.483278 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de379de-eee4-4398-94c7-208290d735ef None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:42.506914 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:42.562287 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d10a24-e2b0-41ee-a4a6-1b421defb6ba None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:42.602805 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0022b374-11cb-4c1b-8f9e-2035d9cdf54d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:42.603482 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0022b374-11cb-4c1b-8f9e-2035d9cdf54d None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:42.603710 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0022b374-11cb-4c1b-8f9e-2035d9cdf54d None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:42.604012 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0022b374-11cb-4c1b-8f9e-2035d9cdf54d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:42.612322 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de379de-eee4-4398-94c7-208290d735ef None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:42.642674 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:42.656708 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc35ce9-36e1-4439-a911-85b1df97f3b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:42.657717 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc35ce9-36e1-4439-a911-85b1df97f3b9 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:42.658179 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc35ce9-36e1-4439-a911-85b1df97f3b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:42.658637 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc35ce9-36e1-4439-a911-85b1df97f3b9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:42.667615 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc35ce9-36e1-4439-a911-85b1df97f3b9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:42.669093 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc35ce9-36e1-4439-a911-85b1df97f3b9 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:42.681503 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application [None req-9fc35ce9-36e1-4439-a911-85b1df97f3b9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 30 00:59:42.681503 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:59:42.681503 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:59:42.681503 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:59:42.681503 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:59:42.681503 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:59:42.681503 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:59:42.681503 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:59:42.681503 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:59:42.681503 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:59:42.681503 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:59:42.681503 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:59:42.681503 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 00:59:42.681503 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 00:59:42.681503 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 00:59:42.681503 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 00:59:42.682877 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:59:42.682877 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:59:42.682877 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 00:59:42.682877 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:59:42.682877 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 00:59:42.682877 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:59:42.682877 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:59:42.682877 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:59:42.682877 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:59:42.682877 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:59:42.682877 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:59:42.682877 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application with Lock( Aug 30 00:59:42.682877 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:59:42.682877 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:59:42.682877 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:59:42.682877 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:59:42.682877 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:59:42.682877 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:59:42.684337 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:59:42.684337 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:59:42.684337 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 00:59:42.684337 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 00:59:42.684337 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 00:59:42.684337 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 00:59:42.684337 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 00:59:42.684337 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 00:59:42.684337 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 30 00:59:42.684337 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Aug 30 00:59:42.685513 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0022b374-11cb-4c1b-8f9e-2035d9cdf54d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:42.685589 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 251/511] 10.222.0.79 () {56 vars in 1093 bytes} [Tue Aug 30 00:59:42 2022] GET /identity/v3/users/nova => generated 82 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:59:42.685589 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc35ce9-36e1-4439-a911-85b1df97f3b9 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:42.685715 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0022b374-11cb-4c1b-8f9e-2035d9cdf54d None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:42.742888 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:42.794791 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 261/512] 10.222.0.79 () {58 vars in 1282 bytes} [Tue Aug 30 00:59:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 00:59:42.795247 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc35ce9-36e1-4439-a911-85b1df97f3b9 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:42.796020 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0022b374-11cb-4c1b-8f9e-2035d9cdf54d None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:42.836205 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad22732-fc2c-46cf-86ca-e379f0699c41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:42.836805 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad22732-fc2c-46cf-86ca-e379f0699c41 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:42.837080 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad22732-fc2c-46cf-86ca-e379f0699c41 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:42.837349 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad22732-fc2c-46cf-86ca-e379f0699c41 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:42.849168 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad22732-fc2c-46cf-86ca-e379f0699c41 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:42.850642 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad22732-fc2c-46cf-86ca-e379f0699c41 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:42.865899 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application [None req-fad22732-fc2c-46cf-86ca-e379f0699c41 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:59:42.865899 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:59:42.865899 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:59:42.865899 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:59:42.865899 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:59:42.865899 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:59:42.865899 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:59:42.865899 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:59:42.865899 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:59:42.865899 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:59:42.865899 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:59:42.865899 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:59:42.865899 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:59:42.865899 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:59:42.865899 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:59:42.865899 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:59:42.866876 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:59:42.866876 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:59:42.866876 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:59:42.866876 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:59:42.866876 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:59:42.866876 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:59:42.866876 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:59:42.866876 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application with Lock( Aug 30 00:59:42.866876 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:59:42.866876 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:59:42.866876 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:59:42.866876 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:59:42.866876 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:59:42.866876 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:59:42.866876 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:59:42.866876 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:59:42.866876 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:59:42.867980 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:59:42.867980 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:59:42.867980 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Aug 30 00:59:42.867980 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 252/513] 10.222.0.79 () {56 vars in 1108 bytes} [Tue Aug 30 00:59:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:59:42.867980 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad22732-fc2c-46cf-86ca-e379f0699c41 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:42.913152 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0022b374-11cb-4c1b-8f9e-2035d9cdf54d None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:42.916588 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:42.957229 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bac7aa7-ad34-44c2-8063-225fb774464d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:42.957877 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bac7aa7-ad34-44c2-8063-225fb774464d None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:42.958140 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bac7aa7-ad34-44c2-8063-225fb774464d None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:42.958612 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bac7aa7-ad34-44c2-8063-225fb774464d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:42.974492 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bac7aa7-ad34-44c2-8063-225fb774464d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:42.976006 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bac7aa7-ad34-44c2-8063-225fb774464d None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:42.991751 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-7bac7aa7-ad34-44c2-8063-225fb774464d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:59:42.991751 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:59:42.991751 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:59:42.991751 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:59:42.991751 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:59:42.991751 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:59:42.991751 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:59:42.991751 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:59:42.991751 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:59:42.991751 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:59:42.991751 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:59:42.991751 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:59:42.991751 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:59:42.991751 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:59:42.991751 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:59:42.991751 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:59:42.992700 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:59:42.992700 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:59:42.992700 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:59:42.992700 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:59:42.992700 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:59:42.992700 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:59:42.992700 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:59:42.992700 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Aug 30 00:59:42.992700 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:59:42.992700 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:59:42.992700 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:59:42.992700 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:59:42.992700 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:59:42.992700 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:59:42.992700 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:59:42.992700 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:59:42.992700 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:59:42.993529 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:59:42.993529 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:59:42.993529 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Aug 30 00:59:42.993687 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad22732-fc2c-46cf-86ca-e379f0699c41 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:42.993763 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 262/514] 10.222.0.79 () {56 vars in 1108 bytes} [Tue Aug 30 00:59:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:59:42.993763 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bac7aa7-ad34-44c2-8063-225fb774464d None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:43.013280 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:43.031185 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb9eeae-e314-4855-b33f-448dc06e5c46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:43.031790 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb9eeae-e314-4855-b33f-448dc06e5c46 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:43.032063 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb9eeae-e314-4855-b33f-448dc06e5c46 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:43.032331 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb9eeae-e314-4855-b33f-448dc06e5c46 None admin] PATH_INFO: `/v3/domains` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:43.032962 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb9eeae-e314-4855-b33f-448dc06e5c46 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:59:43.033255 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb9eeae-e314-4855-b33f-448dc06e5c46 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:43.034607 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb9eeae-e314-4855-b33f-448dc06e5c46 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:43.046736 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 253/515] 10.222.0.79 () {56 vars in 1109 bytes} [Tue Aug 30 00:59:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:59:43.047567 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb9eeae-e314-4855-b33f-448dc06e5c46 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:43.111563 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bac7aa7-ad34-44c2-8063-225fb774464d None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:43.145008 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e5e969-ee1e-49cc-94f3-928baa7da51f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:43.145609 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e5e969-ee1e-49cc-94f3-928baa7da51f None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:43.145881 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e5e969-ee1e-49cc-94f3-928baa7da51f None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:43.146211 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e5e969-ee1e-49cc-94f3-928baa7da51f None admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:43.146945 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e5e969-ee1e-49cc-94f3-928baa7da51f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:59:43.147273 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e5e969-ee1e-49cc-94f3-928baa7da51f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:43.148693 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e5e969-ee1e-49cc-94f3-928baa7da51f None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:43.149941 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:43.157030 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb9eeae-e314-4855-b33f-448dc06e5c46 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:43.170404 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 263/516] 10.222.0.79 () {56 vars in 1133 bytes} [Tue Aug 30 00:59:42 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:59:43.171293 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e5e969-ee1e-49cc-94f3-928baa7da51f None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:43.196765 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8418fb90-1df9-4ad4-9559-7f8072fe6929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:43.197645 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8418fb90-1df9-4ad4-9559-7f8072fe6929 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:43.197918 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8418fb90-1df9-4ad4-9559-7f8072fe6929 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:43.198184 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8418fb90-1df9-4ad4-9559-7f8072fe6929 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:43.208564 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8418fb90-1df9-4ad4-9559-7f8072fe6929 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:43.210005 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8418fb90-1df9-4ad4-9559-7f8072fe6929 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:43.225395 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application [None req-8418fb90-1df9-4ad4-9559-7f8072fe6929 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:59:43.225395 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:59:43.225395 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:59:43.225395 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:59:43.225395 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:59:43.225395 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:59:43.225395 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:59:43.225395 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:59:43.225395 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:59:43.225395 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:59:43.225395 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:59:43.225395 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:59:43.225395 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:59:43.225395 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:59:43.225395 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:59:43.225395 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:59:43.226407 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:59:43.226407 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:59:43.226407 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:59:43.226407 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:59:43.226407 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:59:43.226407 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:59:43.226407 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:59:43.226407 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application with Lock( Aug 30 00:59:43.226407 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:59:43.226407 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:59:43.226407 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:59:43.226407 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:59:43.226407 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:59:43.226407 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:59:43.226407 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:59:43.226407 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:59:43.226407 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:59:43.227293 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:59:43.227293 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:59:43.227293 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Aug 30 00:59:43.227293 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 254/517] 10.222.0.79 () {56 vars in 1108 bytes} [Tue Aug 30 00:59:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:59:43.227676 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8418fb90-1df9-4ad4-9559-7f8072fe6929 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:43.244064 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:43.280071 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e5e969-ee1e-49cc-94f3-928baa7da51f None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:43.314267 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7818ff0-2a38-4f7b-aa77-3742bd4189f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:43.314985 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7818ff0-2a38-4f7b-aa77-3742bd4189f6 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:43.315354 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7818ff0-2a38-4f7b-aa77-3742bd4189f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:43.315630 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7818ff0-2a38-4f7b-aa77-3742bd4189f6 None admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:43.316266 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7818ff0-2a38-4f7b-aa77-3742bd4189f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:59:43.316562 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7818ff0-2a38-4f7b-aa77-3742bd4189f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:43.318188 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7818ff0-2a38-4f7b-aa77-3742bd4189f6 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:43.329603 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 264/518] 10.222.0.79 () {56 vars in 1109 bytes} [Tue Aug 30 00:59:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:59:43.330138 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8418fb90-1df9-4ad4-9559-7f8072fe6929 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:43.330336 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7818ff0-2a38-4f7b-aa77-3742bd4189f6 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:43.366885 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81ecbd1-2b80-4616-9cc0-1892d0ba2ffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:43.367463 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81ecbd1-2b80-4616-9cc0-1892d0ba2ffe None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:43.367745 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81ecbd1-2b80-4616-9cc0-1892d0ba2ffe None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:43.368020 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81ecbd1-2b80-4616-9cc0-1892d0ba2ffe None admin] PATH_INFO: `/v3/domains` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:43.368666 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81ecbd1-2b80-4616-9cc0-1892d0ba2ffe None admin] RBAC: Adding query filter params (name=Default) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:59:43.368967 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81ecbd1-2b80-4616-9cc0-1892d0ba2ffe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:43.370344 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81ecbd1-2b80-4616-9cc0-1892d0ba2ffe None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:43.383716 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 255/519] 10.222.0.79 () {56 vars in 1109 bytes} [Tue Aug 30 00:59:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:59:43.384816 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81ecbd1-2b80-4616-9cc0-1892d0ba2ffe None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:43.395972 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:43.437815 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7818ff0-2a38-4f7b-aa77-3742bd4189f6 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:43.469691 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:43.479002 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d6d019-cf74-4e09-8f61-32709c106195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:43.479652 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d6d019-cf74-4e09-8f61-32709c106195 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:43.479924 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d6d019-cf74-4e09-8f61-32709c106195 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:43.480187 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d6d019-cf74-4e09-8f61-32709c106195 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:43.488682 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d6d019-cf74-4e09-8f61-32709c106195 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:43.490126 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d6d019-cf74-4e09-8f61-32709c106195 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:43.490756 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81ecbd1-2b80-4616-9cc0-1892d0ba2ffe None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:43.503020 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-39d6d019-cf74-4e09-8f61-32709c106195 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 30 00:59:43.503020 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:59:43.503020 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:59:43.503020 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:59:43.503020 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:59:43.503020 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:59:43.503020 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:59:43.503020 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:59:43.503020 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:59:43.503020 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:59:43.503020 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:59:43.503020 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:59:43.503020 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 00:59:43.503020 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 00:59:43.503020 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 00:59:43.503020 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 00:59:43.504197 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:59:43.504197 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:59:43.504197 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 00:59:43.504197 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:59:43.504197 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 00:59:43.504197 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:59:43.504197 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:59:43.504197 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:59:43.504197 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:59:43.504197 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:59:43.504197 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:59:43.504197 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Aug 30 00:59:43.504197 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:59:43.504197 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:59:43.504197 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:59:43.504197 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:59:43.504197 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:59:43.504197 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:59:43.505267 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:59:43.505267 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:59:43.505267 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 00:59:43.505267 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 00:59:43.505267 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 00:59:43.505267 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 00:59:43.505267 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 00:59:43.505267 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 00:59:43.505267 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 30 00:59:43.505267 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Aug 30 00:59:43.506169 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 265/520] 10.222.0.79 () {56 vars in 1102 bytes} [Tue Aug 30 00:59:43 2022] GET /identity/v3/users/neutron => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:59:43.507078 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d6d019-cf74-4e09-8f61-32709c106195 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:43.529055 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643db769-ccb0-4214-8587-019f5d0f154a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:43.529647 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643db769-ccb0-4214-8587-019f5d0f154a None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:43.529925 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643db769-ccb0-4214-8587-019f5d0f154a None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:43.530190 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643db769-ccb0-4214-8587-019f5d0f154a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:43.603264 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643db769-ccb0-4214-8587-019f5d0f154a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:43.604846 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643db769-ccb0-4214-8587-019f5d0f154a None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:43.612896 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d6d019-cf74-4e09-8f61-32709c106195 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:43.616051 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:43.650247 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1465e4-3d1e-4609-bcf1-8a1f937d5a7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:43.650791 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1465e4-3d1e-4609-bcf1-8a1f937d5a7b None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:43.651057 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1465e4-3d1e-4609-bcf1-8a1f937d5a7b None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:43.651367 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1465e4-3d1e-4609-bcf1-8a1f937d5a7b None admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:43.652025 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1465e4-3d1e-4609-bcf1-8a1f937d5a7b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:59:43.652326 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1465e4-3d1e-4609-bcf1-8a1f937d5a7b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:43.653775 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1465e4-3d1e-4609-bcf1-8a1f937d5a7b None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:43.666341 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 266/521] 10.222.0.79 () {56 vars in 1109 bytes} [Tue Aug 30 00:59:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:59:43.667016 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1465e4-3d1e-4609-bcf1-8a1f937d5a7b None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:43.717333 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:43.718950 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 256/522] 10.222.0.79 () {58 vars in 1282 bytes} [Tue Aug 30 00:59:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 00:59:43.719943 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643db769-ccb0-4214-8587-019f5d0f154a None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:43.775577 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1465e4-3d1e-4609-bcf1-8a1f937d5a7b None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:43.818942 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32eb5d0c-cf57-4197-af9f-3737b09650a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:43.819584 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eb5d0c-cf57-4197-af9f-3737b09650a0 None admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:43.819865 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eb5d0c-cf57-4197-af9f-3737b09650a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:43.820134 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eb5d0c-cf57-4197-af9f-3737b09650a0 None admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:43.820781 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32eb5d0c-cf57-4197-af9f-3737b09650a0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:43.822213 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32eb5d0c-cf57-4197-af9f-3737b09650a0 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:43.829697 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643db769-ccb0-4214-8587-019f5d0f154a None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:43.840529 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:43.846725 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 267/523] 10.222.0.79 () {60 vars in 1132 bytes} [Tue Aug 30 00:59:43 2022] POST /identity/v3/users => generated 247 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:59:43.847805 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32eb5d0c-cf57-4197-af9f-3737b09650a0 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:43.873106 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dc0700-30be-4419-b7cf-566b4e1b8fbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:43.874170 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dc0700-30be-4419-b7cf-566b4e1b8fbc None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:43.874807 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dc0700-30be-4419-b7cf-566b4e1b8fbc None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:43.875316 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dc0700-30be-4419-b7cf-566b4e1b8fbc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:43.883311 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dc0700-30be-4419-b7cf-566b4e1b8fbc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:43.885134 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dc0700-30be-4419-b7cf-566b4e1b8fbc None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:43.898397 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application [None req-26dc0700-30be-4419-b7cf-566b4e1b8fbc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:59:43.898397 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:59:43.898397 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:59:43.898397 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:59:43.898397 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:59:43.898397 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:59:43.898397 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:59:43.898397 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:59:43.898397 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:59:43.898397 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:59:43.898397 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:59:43.898397 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:59:43.898397 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 00:59:43.898397 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 00:59:43.898397 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 00:59:43.899606 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 00:59:43.899606 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:59:43.899606 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:59:43.899606 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:59:43.899606 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:59:43.899606 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:59:43.899606 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:59:43.899606 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:59:43.899606 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application with Lock( Aug 30 00:59:43.899606 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:59:43.899606 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:59:43.899606 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:59:43.899606 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:59:43.899606 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:59:43.899606 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:59:43.899606 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:59:43.899606 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:59:43.900798 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 00:59:43.900798 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 00:59:43.900798 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 00:59:43.900798 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 00:59:43.900798 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 00:59:43.900798 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 00:59:43.900798 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:59:43.900798 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Aug 30 00:59:43.902083 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 257/524] 10.222.0.79 () {56 vars in 1111 bytes} [Tue Aug 30 00:59:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:59:43.904860 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dc0700-30be-4419-b7cf-566b4e1b8fbc None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:43.989230 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32eb5d0c-cf57-4197-af9f-3737b09650a0 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:43.991928 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:44.038244 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f137896b-6c07-4d8a-a14c-232781b583f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:44.038560 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dc0700-30be-4419-b7cf-566b4e1b8fbc None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:44.038661 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f137896b-6c07-4d8a-a14c-232781b583f5 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:44.038823 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f137896b-6c07-4d8a-a14c-232781b583f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:44.039102 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f137896b-6c07-4d8a-a14c-232781b583f5 None admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:44.039996 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f137896b-6c07-4d8a-a14c-232781b583f5 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:59:44.040194 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f137896b-6c07-4d8a-a14c-232781b583f5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:44.041640 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f137896b-6c07-4d8a-a14c-232781b583f5 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:44.061096 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 268/525] 10.222.0.79 () {56 vars in 1139 bytes} [Tue Aug 30 00:59:43 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:59:44.062045 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f137896b-6c07-4d8a-a14c-232781b583f5 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:44.082508 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df155d29-32b6-49a7-b1a1-576264b4792f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:44.083270 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df155d29-32b6-49a7-b1a1-576264b4792f None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:44.083724 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df155d29-32b6-49a7-b1a1-576264b4792f None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:44.084058 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df155d29-32b6-49a7-b1a1-576264b4792f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:44.092663 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df155d29-32b6-49a7-b1a1-576264b4792f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:44.094451 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df155d29-32b6-49a7-b1a1-576264b4792f None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:44.107868 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application [None req-df155d29-32b6-49a7-b1a1-576264b4792f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:59:44.107868 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:59:44.107868 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:59:44.107868 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:59:44.107868 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:59:44.107868 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:59:44.107868 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:59:44.107868 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:59:44.107868 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:59:44.107868 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:59:44.107868 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:59:44.107868 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:59:44.107868 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 00:59:44.107868 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 00:59:44.107868 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 00:59:44.109030 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 00:59:44.109030 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:59:44.109030 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:59:44.109030 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:59:44.109030 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:59:44.109030 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:59:44.109030 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:59:44.109030 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:59:44.109030 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application with Lock( Aug 30 00:59:44.109030 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:59:44.109030 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:59:44.109030 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:59:44.109030 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:59:44.109030 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:59:44.109030 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:59:44.109030 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:59:44.109030 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:59:44.109945 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 00:59:44.109945 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 00:59:44.109945 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 00:59:44.109945 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 00:59:44.109945 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 00:59:44.109945 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 00:59:44.109945 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:59:44.109945 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Aug 30 00:59:44.109945 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 258/526] 10.222.0.79 () {56 vars in 1111 bytes} [Tue Aug 30 00:59:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:59:44.110398 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df155d29-32b6-49a7-b1a1-576264b4792f None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:44.150017 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:44.175520 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f137896b-6c07-4d8a-a14c-232781b583f5 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:44.213513 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71873267-e5f8-42ff-ae3d-0aaf456a428c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:44.214154 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71873267-e5f8-42ff-ae3d-0aaf456a428c None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:44.214431 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71873267-e5f8-42ff-ae3d-0aaf456a428c None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:44.214703 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71873267-e5f8-42ff-ae3d-0aaf456a428c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:44.225182 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71873267-e5f8-42ff-ae3d-0aaf456a428c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:44.226629 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71873267-e5f8-42ff-ae3d-0aaf456a428c None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:44.241330 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df155d29-32b6-49a7-b1a1-576264b4792f None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:44.246601 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-71873267-e5f8-42ff-ae3d-0aaf456a428c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:59:44.246601 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:59:44.246601 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:59:44.246601 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:59:44.246601 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:59:44.246601 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:59:44.246601 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:59:44.246601 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:59:44.246601 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:59:44.246601 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:59:44.246601 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:59:44.246601 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:59:44.246601 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:59:44.246601 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:59:44.246601 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:59:44.246601 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:59:44.249083 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:59:44.249083 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:59:44.249083 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:59:44.249083 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:59:44.249083 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:59:44.249083 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:59:44.249083 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:59:44.249083 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Aug 30 00:59:44.249083 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:59:44.249083 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:59:44.249083 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:59:44.249083 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:59:44.249083 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:59:44.249083 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:59:44.249083 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:59:44.249083 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:59:44.249083 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:59:44.250138 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:59:44.250138 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:59:44.250138 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Aug 30 00:59:44.250818 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 269/527] 10.222.0.79 () {56 vars in 1108 bytes} [Tue Aug 30 00:59:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:59:44.251551 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71873267-e5f8-42ff-ae3d-0aaf456a428c None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:44.269573 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:44.283732 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2337fd8d-27d1-4664-afbd-dee4b19d7084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:44.284436 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2337fd8d-27d1-4664-afbd-dee4b19d7084 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:44.284784 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2337fd8d-27d1-4664-afbd-dee4b19d7084 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:44.285126 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2337fd8d-27d1-4664-afbd-dee4b19d7084 None admin] PATH_INFO: `/v3/projects` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:44.285880 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2337fd8d-27d1-4664-afbd-dee4b19d7084 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:59:44.286244 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2337fd8d-27d1-4664-afbd-dee4b19d7084 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:44.288586 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2337fd8d-27d1-4664-afbd-dee4b19d7084 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:44.307972 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 259/528] 10.222.0.79 () {56 vars in 1148 bytes} [Tue Aug 30 00:59:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:59:44.309177 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2337fd8d-27d1-4664-afbd-dee4b19d7084 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:44.371475 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71873267-e5f8-42ff-ae3d-0aaf456a428c None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:44.407878 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:44.411618 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00350cd5-b736-4801-bbd9-2813ac03b220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:44.412284 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00350cd5-b736-4801-bbd9-2813ac03b220 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:44.412566 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00350cd5-b736-4801-bbd9-2813ac03b220 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:44.412877 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00350cd5-b736-4801-bbd9-2813ac03b220 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:44.423674 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2337fd8d-27d1-4664-afbd-dee4b19d7084 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:44.464011 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbe9fa0-a4e0-456b-9bc2-6c34394b11e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:44.465446 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbe9fa0-a4e0-456b-9bc2-6c34394b11e1 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:44.466679 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbe9fa0-a4e0-456b-9bc2-6c34394b11e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:44.467465 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbe9fa0-a4e0-456b-9bc2-6c34394b11e1 None admin] PATH_INFO: `/v3/projects` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:44.468496 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbe9fa0-a4e0-456b-9bc2-6c34394b11e1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:59:44.469360 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbe9fa0-a4e0-456b-9bc2-6c34394b11e1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:44.471428 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbe9fa0-a4e0-456b-9bc2-6c34394b11e1 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:44.489159 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 260/529] 10.222.0.79 () {56 vars in 1148 bytes} [Tue Aug 30 00:59:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:59:44.489159 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbe9fa0-a4e0-456b-9bc2-6c34394b11e1 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:44.498978 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00350cd5-b736-4801-bbd9-2813ac03b220 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:44.500667 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00350cd5-b736-4801-bbd9-2813ac03b220 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:44.519399 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:44.601920 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbe9fa0-a4e0-456b-9bc2-6c34394b11e1 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:44.625670 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 270/530] 10.222.0.79 () {58 vars in 1282 bytes} [Tue Aug 30 00:59:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 00:59:44.625670 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00350cd5-b736-4801-bbd9-2813ac03b220 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:44.644464 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c492178d-a91f-4a73-ae50-21840019ac0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:44.645231 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c492178d-a91f-4a73-ae50-21840019ac0e None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:44.645582 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c492178d-a91f-4a73-ae50-21840019ac0e None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:44.645923 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c492178d-a91f-4a73-ae50-21840019ac0e None admin] PATH_INFO: `/v3/domains` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:44.646652 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c492178d-a91f-4a73-ae50-21840019ac0e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:59:44.647024 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c492178d-a91f-4a73-ae50-21840019ac0e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:44.648531 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c492178d-a91f-4a73-ae50-21840019ac0e None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:44.665819 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 261/531] 10.222.0.79 () {56 vars in 1109 bytes} [Tue Aug 30 00:59:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:59:44.665819 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c492178d-a91f-4a73-ae50-21840019ac0e None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:44.679836 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:44.737153 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00350cd5-b736-4801-bbd9-2813ac03b220 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:44.752819 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:44.777438 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13389d74-58fc-464a-a104-47f78e8c7783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:44.778062 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13389d74-58fc-464a-a104-47f78e8c7783 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:44.778375 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13389d74-58fc-464a-a104-47f78e8c7783 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:44.778652 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13389d74-58fc-464a-a104-47f78e8c7783 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:44.779520 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13389d74-58fc-464a-a104-47f78e8c7783 None admin] RBAC: Adding query filter params (role.id=687d3359d6b2413b84ca5a54d30d5488, scope.project.id=0eec3a73673e45dc881de586b9b0fbbb, user.id=5e37a5c33c064c488fd4667170f7703a) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:59:44.779830 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13389d74-58fc-464a-a104-47f78e8c7783 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:44.781301 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13389d74-58fc-464a-a104-47f78e8c7783 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:44.785528 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c492178d-a91f-4a73-ae50-21840019ac0e None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:44.787278 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 271/532] 10.222.0.79 () {56 vars in 1374 bytes} [Tue Aug 30 00:59:44 2022] GET /identity/v3/role_assignments?user.id=5e37a5c33c064c488fd4667170f7703a&scope.project.id=0eec3a73673e45dc881de586b9b0fbbb&role.id=687d3359d6b2413b84ca5a54d30d5488 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:59:44.797326 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13389d74-58fc-464a-a104-47f78e8c7783 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:44.828048 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c873bd4-c758-440a-abe3-83184f974859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:44.828821 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c873bd4-c758-440a-abe3-83184f974859 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:44.829179 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c873bd4-c758-440a-abe3-83184f974859 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:44.829559 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c873bd4-c758-440a-abe3-83184f974859 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:44.830426 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c873bd4-c758-440a-abe3-83184f974859 None admin] RBAC: Adding query filter params (role.id=687d3359d6b2413b84ca5a54d30d5488, scope.project.id=0eec3a73673e45dc881de586b9b0fbbb, user.id=7f827c7670b74d938ffe066ced88d1c2) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:59:44.830828 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c873bd4-c758-440a-abe3-83184f974859 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:44.832451 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c873bd4-c758-440a-abe3-83184f974859 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:44.839448 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 262/533] 10.222.0.79 () {56 vars in 1374 bytes} [Tue Aug 30 00:59:44 2022] GET /identity/v3/role_assignments?user.id=7f827c7670b74d938ffe066ced88d1c2&scope.project.id=0eec3a73673e45dc881de586b9b0fbbb&role.id=687d3359d6b2413b84ca5a54d30d5488 => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:59:44.840578 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c873bd4-c758-440a-abe3-83184f974859 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:44.957774 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:44.971559 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13389d74-58fc-464a-a104-47f78e8c7783 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:45.025292 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c873bd4-c758-440a-abe3-83184f974859 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:45.030836 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404f0653-76ed-4862-9316-fa28ea319573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:45.032491 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404f0653-76ed-4862-9316-fa28ea319573 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:45.032776 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404f0653-76ed-4862-9316-fa28ea319573 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:45.033051 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404f0653-76ed-4862-9316-fa28ea319573 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:45.056099 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404f0653-76ed-4862-9316-fa28ea319573 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:45.057562 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404f0653-76ed-4862-9316-fa28ea319573 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:45.083079 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-404f0653-76ed-4862-9316-fa28ea319573 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:59:45.083079 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:59:45.083079 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:59:45.083079 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:59:45.083079 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:59:45.083079 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:59:45.083079 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:59:45.083079 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:59:45.083079 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:59:45.083079 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:59:45.083079 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:59:45.083079 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:59:45.083079 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:59:45.083079 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:59:45.083079 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:59:45.083079 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:59:45.084327 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:59:45.084327 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:59:45.084327 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:59:45.084327 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:59:45.084327 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:59:45.084327 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:59:45.084327 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:59:45.084327 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Aug 30 00:59:45.084327 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:59:45.084327 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:59:45.084327 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:59:45.084327 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:59:45.084327 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:59:45.084327 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:59:45.084327 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:59:45.084327 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:59:45.084327 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:59:45.085372 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:59:45.085372 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:59:45.085372 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Aug 30 00:59:45.085372 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 272/534] 10.222.0.79 () {56 vars in 1108 bytes} [Tue Aug 30 00:59:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:59:45.096399 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404f0653-76ed-4862-9316-fa28ea319573 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:45.097371 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7813e4-3488-4a0f-9a85-95c75c1dea15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:45.098004 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7813e4-3488-4a0f-9a85-95c75c1dea15 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:45.098283 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7813e4-3488-4a0f-9a85-95c75c1dea15 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:45.098555 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7813e4-3488-4a0f-9a85-95c75c1dea15 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:45.114480 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7813e4-3488-4a0f-9a85-95c75c1dea15 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:45.115989 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7813e4-3488-4a0f-9a85-95c75c1dea15 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:45.130048 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application [None req-cb7813e4-3488-4a0f-9a85-95c75c1dea15 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:59:45.130048 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:59:45.130048 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:59:45.130048 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:59:45.130048 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:59:45.130048 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:59:45.130048 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:59:45.130048 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:59:45.130048 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:59:45.130048 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:59:45.130048 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:59:45.130048 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:59:45.130048 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 00:59:45.130048 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 00:59:45.130048 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 00:59:45.131145 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 00:59:45.131145 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:59:45.131145 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:59:45.131145 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:59:45.131145 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:59:45.131145 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:59:45.131145 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:59:45.131145 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:59:45.131145 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application with Lock( Aug 30 00:59:45.131145 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:59:45.131145 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:59:45.131145 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:59:45.131145 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:59:45.131145 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:59:45.131145 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:59:45.131145 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:59:45.131145 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:59:45.132188 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 00:59:45.132188 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 00:59:45.132188 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 00:59:45.132188 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 00:59:45.132188 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 00:59:45.132188 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 00:59:45.132188 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:59:45.132188 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Aug 30 00:59:45.141066 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 263/535] 10.222.0.79 () {56 vars in 1111 bytes} [Tue Aug 30 00:59:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:59:45.141968 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7813e4-3488-4a0f-9a85-95c75c1dea15 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:45.158374 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:45.309214 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404f0653-76ed-4862-9316-fa28ea319573 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:45.328077 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7813e4-3488-4a0f-9a85-95c75c1dea15 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:45.360840 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:45.369481 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fd5c2b-837a-4ab1-9ece-4b6c02e676d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:45.371112 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fd5c2b-837a-4ab1-9ece-4b6c02e676d4 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:45.371112 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fd5c2b-837a-4ab1-9ece-4b6c02e676d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:45.371112 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fd5c2b-837a-4ab1-9ece-4b6c02e676d4 None admin] PATH_INFO: `/v3/projects` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:45.371429 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fd5c2b-837a-4ab1-9ece-4b6c02e676d4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:59:45.371731 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fd5c2b-837a-4ab1-9ece-4b6c02e676d4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:45.373411 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fd5c2b-837a-4ab1-9ece-4b6c02e676d4 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:45.395967 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c369e359-0d06-436c-b5da-595b29c2477e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:45.396576 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c369e359-0d06-436c-b5da-595b29c2477e None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:45.396854 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c369e359-0d06-436c-b5da-595b29c2477e None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:45.397126 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c369e359-0d06-436c-b5da-595b29c2477e None admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:45.397770 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c369e359-0d06-436c-b5da-595b29c2477e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:59:45.398071 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c369e359-0d06-436c-b5da-595b29c2477e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:45.399453 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c369e359-0d06-436c-b5da-595b29c2477e None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:45.401200 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 264/536] 10.222.0.79 () {56 vars in 1148 bytes} [Tue Aug 30 00:59:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:59:45.408106 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fd5c2b-837a-4ab1-9ece-4b6c02e676d4 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:45.429401 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 273/537] 10.222.0.79 () {56 vars in 1109 bytes} [Tue Aug 30 00:59:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:59:45.435676 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c369e359-0d06-436c-b5da-595b29c2477e None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:45.573827 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fd5c2b-837a-4ab1-9ece-4b6c02e676d4 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:45.630479 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29338d42-f743-474b-a496-67723f51cbf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:45.631177 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:45.631630 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29338d42-f743-474b-a496-67723f51cbf8 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:45.631827 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29338d42-f743-474b-a496-67723f51cbf8 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:45.632034 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29338d42-f743-474b-a496-67723f51cbf8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:45.632831 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29338d42-f743-474b-a496-67723f51cbf8 None admin] RBAC: Adding query filter params (role.id=687d3359d6b2413b84ca5a54d30d5488, scope.project.id=0eec3a73673e45dc881de586b9b0fbbb, user.id=6480b2f14c37474c89df9fba48f7cd91) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:59:45.633140 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29338d42-f743-474b-a496-67723f51cbf8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:45.634584 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29338d42-f743-474b-a496-67723f51cbf8 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:45.646378 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 265/538] 10.222.0.79 () {56 vars in 1374 bytes} [Tue Aug 30 00:59:45 2022] GET /identity/v3/role_assignments?user.id=6480b2f14c37474c89df9fba48f7cd91&scope.project.id=0eec3a73673e45dc881de586b9b0fbbb&role.id=687d3359d6b2413b84ca5a54d30d5488 => generated 259 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:59:45.655613 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c369e359-0d06-436c-b5da-595b29c2477e None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:45.718393 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f8239c-576c-487c-9a17-f8602da7fc54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:45.719030 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f8239c-576c-487c-9a17-f8602da7fc54 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:45.719341 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f8239c-576c-487c-9a17-f8602da7fc54 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:45.719593 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f8239c-576c-487c-9a17-f8602da7fc54 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:45.733963 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f8239c-576c-487c-9a17-f8602da7fc54 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:45.735465 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f8239c-576c-487c-9a17-f8602da7fc54 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:45.754054 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-70f8239c-576c-487c-9a17-f8602da7fc54 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:59:45.754054 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:59:45.754054 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:59:45.754054 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:59:45.754054 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:59:45.754054 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:59:45.754054 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:59:45.754054 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:59:45.754054 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:59:45.754054 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:59:45.754054 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:59:45.754054 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:59:45.754054 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 00:59:45.754054 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 00:59:45.754054 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 00:59:45.754999 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 00:59:45.754999 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:59:45.754999 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:59:45.754999 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:59:45.754999 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:59:45.754999 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:59:45.754999 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:59:45.754999 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:59:45.754999 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Aug 30 00:59:45.754999 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:59:45.754999 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:59:45.754999 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:59:45.754999 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:59:45.754999 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:59:45.754999 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:59:45.754999 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:59:45.754999 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:59:45.755864 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 00:59:45.755864 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 00:59:45.755864 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 00:59:45.755864 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 00:59:45.755864 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 00:59:45.755864 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 00:59:45.755864 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:59:45.755864 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Aug 30 00:59:45.755864 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 274/539] 10.222.0.79 () {56 vars in 1111 bytes} [Tue Aug 30 00:59:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:59:45.761101 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29338d42-f743-474b-a496-67723f51cbf8 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:45.822919 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:45.885862 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29338d42-f743-474b-a496-67723f51cbf8 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:45.901716 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1acf634-a494-43c6-90fe-891003bf4faf None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:45.902012 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1acf634-a494-43c6-90fe-891003bf4faf None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:45.902254 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1acf634-a494-43c6-90fe-891003bf4faf None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:45.903651 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 275/540] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 00:59:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 00:59:45.909153 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b26128-fb2f-4506-971d-0f3f4eeaf08e None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:45.909437 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b26128-fb2f-4506-971d-0f3f4eeaf08e None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:45.909716 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b26128-fb2f-4506-971d-0f3f4eeaf08e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:45.932219 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad25e2f8-4527-49cb-be78-5184559dd439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:45.933006 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad25e2f8-4527-49cb-be78-5184559dd439 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:45.933278 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad25e2f8-4527-49cb-be78-5184559dd439 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:45.933603 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad25e2f8-4527-49cb-be78-5184559dd439 None admin] PATH_INFO: `/v3/projects` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:45.934320 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad25e2f8-4527-49cb-be78-5184559dd439 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:59:45.936896 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad25e2f8-4527-49cb-be78-5184559dd439 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:45.939791 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad25e2f8-4527-49cb-be78-5184559dd439 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:45.948245 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-51b26128-fb2f-4506-971d-0f3f4eeaf08e None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:59:45.949463 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-51b26128-fb2f-4506-971d-0f3f4eeaf08e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:59:45.959286 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 266/541] 10.222.0.79 () {56 vars in 1148 bytes} [Tue Aug 30 00:59:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:59:45.971359 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad25e2f8-4527-49cb-be78-5184559dd439 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:46.034090 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 276/542] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 00:59:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:59:46.112917 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad25e2f8-4527-49cb-be78-5184559dd439 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:46.141746 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:46.153781 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2b7ecf-6e4d-4799-8ce1-f1880e4aec00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:46.154532 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2b7ecf-6e4d-4799-8ce1-f1880e4aec00 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:46.154815 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2b7ecf-6e4d-4799-8ce1-f1880e4aec00 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:46.155078 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2b7ecf-6e4d-4799-8ce1-f1880e4aec00 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:46.155864 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2b7ecf-6e4d-4799-8ce1-f1880e4aec00 None admin] RBAC: Adding query filter params (role.id=687d3359d6b2413b84ca5a54d30d5488, scope.project.id=0eec3a73673e45dc881de586b9b0fbbb, user.id=16e6a0ca26fc4ef892c188ad89a1e132) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:59:46.156172 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2b7ecf-6e4d-4799-8ce1-f1880e4aec00 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:46.157680 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2b7ecf-6e4d-4799-8ce1-f1880e4aec00 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:46.164490 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 267/543] 10.222.0.79 () {56 vars in 1374 bytes} [Tue Aug 30 00:59:45 2022] GET /identity/v3/role_assignments?user.id=16e6a0ca26fc4ef892c188ad89a1e132&scope.project.id=0eec3a73673e45dc881de586b9b0fbbb&role.id=687d3359d6b2413b84ca5a54d30d5488 => generated 259 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:59:46.465447 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b26128-fb2f-4506-971d-0f3f4eeaf08e None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:46.580594 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:46.615358 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b26128-fb2f-4506-971d-0f3f4eeaf08e None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:46.679871 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf7568d-1a52-4bb4-aa74-ad9201e7c188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:46.680527 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf7568d-1a52-4bb4-aa74-ad9201e7c188 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:46.680785 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf7568d-1a52-4bb4-aa74-ad9201e7c188 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:46.681056 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf7568d-1a52-4bb4-aa74-ad9201e7c188 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:46.695275 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf7568d-1a52-4bb4-aa74-ad9201e7c188 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:59:46.700625 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-bbf7568d-1a52-4bb4-aa74-ad9201e7c188 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 00:59:46.700625 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:59:46.700625 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:59:46.700625 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:59:46.700625 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:59:46.700625 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:59:46.700625 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:59:46.700625 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:59:46.700625 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:59:46.700625 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:59:46.700625 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:59:46.700625 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:59:46.700625 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:59:46.700625 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:59:46.700625 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:59:46.700625 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:59:46.701491 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:59:46.701491 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:59:46.701491 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:59:46.701491 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:59:46.701491 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:59:46.701491 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:59:46.701491 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:59:46.701491 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:59:46.701491 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:59:46.701491 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:59:46.701491 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:59:46.701491 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Aug 30 00:59:46.701491 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:59:46.701491 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:59:46.701491 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:59:46.701491 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:59:46.702679 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:59:46.702679 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:59:46.702679 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:59:46.702679 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:59:46.702679 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:59:46.702679 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:59:46.702679 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:59:46.702679 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:59:46.702679 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:59:46.702679 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:59:46.702679 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 00:59:46.702679 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Aug 30 00:59:46.702679 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 277/544] 10.222.0.79 () {56 vars in 1102 bytes} [Tue Aug 30 00:59:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:59:46.707796 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2b7ecf-6e4d-4799-8ce1-f1880e4aec00 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:46.853429 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2b7ecf-6e4d-4799-8ce1-f1880e4aec00 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:46.900939 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2c87a0-b620-4c07-849d-9f99d1d0b914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:46.901559 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2c87a0-b620-4c07-849d-9f99d1d0b914 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:46.901838 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2c87a0-b620-4c07-849d-9f99d1d0b914 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:46.902109 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2c87a0-b620-4c07-849d-9f99d1d0b914 None admin] PATH_INFO: `/v3/roles` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:46.902784 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2c87a0-b620-4c07-849d-9f99d1d0b914 None admin] RBAC: Adding query filter params (name=service) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:59:46.903896 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2c87a0-b620-4c07-849d-9f99d1d0b914 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:46.905089 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2c87a0-b620-4c07-849d-9f99d1d0b914 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:46.914475 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 268/545] 10.222.0.79 () {56 vars in 1103 bytes} [Tue Aug 30 00:59:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:59:46.920822 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf7568d-1a52-4bb4-aa74-ad9201e7c188 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:47.083962 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb1bcaf-bb25-4517-8a67-6071ff891c36 None None] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:47.084329 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb1bcaf-bb25-4517-8a67-6071ff891c36 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:47.084518 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb1bcaf-bb25-4517-8a67-6071ff891c36 None None] PATH_INFO: `/` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:47.086131 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 269/546] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 00:59:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:59:47.092263 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e9afe1-9cfe-4dec-a093-86016ac909cd None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:47.092544 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e9afe1-9cfe-4dec-a093-86016ac909cd None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:47.092822 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e9afe1-9cfe-4dec-a093-86016ac909cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:47.100220 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf7568d-1a52-4bb4-aa74-ad9201e7c188 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:47.131320 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-28e9afe1-9cfe-4dec-a093-86016ac909cd None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:59:47.132459 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-28e9afe1-9cfe-4dec-a093-86016ac909cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:59:47.138576 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b773ff-66e7-43fe-9dcb-05e58e389928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:47.139244 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b773ff-66e7-43fe-9dcb-05e58e389928 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:47.139526 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b773ff-66e7-43fe-9dcb-05e58e389928 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:47.139799 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b773ff-66e7-43fe-9dcb-05e58e389928 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:47.148897 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:47.156607 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b773ff-66e7-43fe-9dcb-05e58e389928 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:47.158226 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b773ff-66e7-43fe-9dcb-05e58e389928 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:47.184557 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-b3b773ff-66e7-43fe-9dcb-05e58e389928 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:59:47.184557 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:59:47.184557 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:59:47.184557 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:59:47.184557 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:59:47.184557 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:59:47.184557 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:59:47.184557 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:59:47.184557 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:59:47.184557 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:59:47.184557 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:59:47.184557 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:59:47.184557 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:59:47.184557 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:59:47.184557 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:59:47.184557 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:59:47.185499 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:59:47.185499 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:59:47.185499 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:59:47.185499 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:59:47.185499 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:59:47.185499 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:59:47.185499 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:59:47.185499 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Aug 30 00:59:47.185499 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:59:47.185499 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:59:47.185499 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:59:47.185499 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:59:47.185499 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:59:47.185499 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:59:47.185499 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:59:47.185499 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:59:47.185499 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:59:47.186419 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:59:47.186419 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:59:47.186419 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Aug 30 00:59:47.188322 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 278/547] 10.222.0.79 () {56 vars in 1108 bytes} [Tue Aug 30 00:59:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:59:47.194738 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b773ff-66e7-43fe-9dcb-05e58e389928 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:47.207516 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:47.272068 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 270/548] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 00:59:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:59:47.273601 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6796c56f-4d20-4ca0-a789-7065ec0ec30f None None] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:47.273891 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6796c56f-4d20-4ca0-a789-7065ec0ec30f None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:47.274159 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6796c56f-4d20-4ca0-a789-7065ec0ec30f None None] PATH_INFO: `/` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:47.275585 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 271/549] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 00:59:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:59:47.282597 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276651f9-9a34-4f82-8616-468de0fb4317 None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:47.283016 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276651f9-9a34-4f82-8616-468de0fb4317 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:47.283429 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276651f9-9a34-4f82-8616-468de0fb4317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:47.304339 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-276651f9-9a34-4f82-8616-468de0fb4317 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:59:47.305583 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-276651f9-9a34-4f82-8616-468de0fb4317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:59:47.368295 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b773ff-66e7-43fe-9dcb-05e58e389928 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:47.444681 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 272/550] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 00:59:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:59:47.447592 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c0614a-49d5-4620-968f-ec406bfa38ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:47.448208 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c0614a-49d5-4620-968f-ec406bfa38ed None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:47.448488 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c0614a-49d5-4620-968f-ec406bfa38ed None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:47.448803 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c0614a-49d5-4620-968f-ec406bfa38ed None admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:47.449467 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c0614a-49d5-4620-968f-ec406bfa38ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:59:47.449769 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c0614a-49d5-4620-968f-ec406bfa38ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:47.451839 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c0614a-49d5-4620-968f-ec406bfa38ed None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:47.464918 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 279/551] 10.222.0.79 () {56 vars in 1109 bytes} [Tue Aug 30 00:59:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:59:47.471407 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276651f9-9a34-4f82-8616-468de0fb4317 None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:47.577780 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276651f9-9a34-4f82-8616-468de0fb4317 None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:47.579383 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:47.602516 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c0614a-49d5-4620-968f-ec406bfa38ed None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:47.624178 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a99068-137b-43e5-bade-78d2fc00701b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:47.624867 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a99068-137b-43e5-bade-78d2fc00701b None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:47.625241 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a99068-137b-43e5-bade-78d2fc00701b None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:47.625510 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a99068-137b-43e5-bade-78d2fc00701b None admin] PATH_INFO: `/v3/users/swift` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:47.639358 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a99068-137b-43e5-bade-78d2fc00701b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:47.640861 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a99068-137b-43e5-bade-78d2fc00701b None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:47.660421 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application [None req-b2a99068-137b-43e5-bade-78d2fc00701b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 30 00:59:47.660421 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:59:47.660421 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:59:47.660421 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:59:47.660421 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:59:47.660421 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:59:47.660421 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:59:47.660421 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:59:47.660421 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:59:47.660421 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:59:47.660421 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:59:47.660421 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:59:47.660421 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 00:59:47.660421 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 00:59:47.660421 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 00:59:47.660421 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 00:59:47.661581 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:59:47.661581 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:59:47.661581 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 00:59:47.661581 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:59:47.661581 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 00:59:47.661581 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:59:47.661581 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:59:47.661581 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:59:47.661581 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:59:47.661581 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:59:47.661581 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:59:47.661581 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application with Lock( Aug 30 00:59:47.661581 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:59:47.661581 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:59:47.661581 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:59:47.661581 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:59:47.661581 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:59:47.661581 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:59:47.662477 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:59:47.662477 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:59:47.662477 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 00:59:47.662477 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 00:59:47.662477 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 00:59:47.662477 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 00:59:47.662477 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 00:59:47.662477 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 00:59:47.662477 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 30 00:59:47.662477 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Aug 30 00:59:47.662477 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 273/552] 10.222.0.79 () {56 vars in 1096 bytes} [Tue Aug 30 00:59:47 2022] GET /identity/v3/users/swift => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:59:47.667407 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a99068-137b-43e5-bade-78d2fc00701b None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:47.672857 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:47.779937 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c0614a-49d5-4620-968f-ec406bfa38ed None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:47.830815 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6315abe-6513-47ea-aa6d-fddff4378cca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:47.831979 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6315abe-6513-47ea-aa6d-fddff4378cca None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:47.832571 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6315abe-6513-47ea-aa6d-fddff4378cca None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:47.833042 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6315abe-6513-47ea-aa6d-fddff4378cca None admin] PATH_INFO: `/v3/roles/service` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:47.845242 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6315abe-6513-47ea-aa6d-fddff4378cca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:59:47.850934 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-c6315abe-6513-47ea-aa6d-fddff4378cca None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 00:59:47.850934 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:59:47.850934 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:59:47.850934 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:59:47.850934 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:59:47.850934 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:59:47.850934 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:59:47.850934 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:59:47.850934 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:59:47.850934 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:59:47.850934 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:59:47.850934 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:59:47.850934 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:59:47.850934 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:59:47.850934 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:59:47.850934 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:59:47.852006 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:59:47.852006 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:59:47.852006 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:59:47.852006 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:59:47.852006 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:59:47.852006 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:59:47.852006 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:59:47.852006 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:59:47.852006 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:59:47.852006 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:59:47.852006 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:59:47.852006 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Aug 30 00:59:47.852006 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:59:47.852006 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:59:47.852006 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:59:47.852006 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:59:47.852901 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:59:47.852901 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:59:47.852901 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:59:47.852901 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:59:47.852901 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:59:47.852901 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:59:47.852901 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:59:47.852901 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:59:47.852901 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:59:47.852901 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:59:47.852901 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 00:59:47.852901 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Aug 30 00:59:47.853547 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a99068-137b-43e5-bade-78d2fc00701b None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:47.855881 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 280/553] 10.222.0.79 () {56 vars in 1102 bytes} [Tue Aug 30 00:59:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:59:47.857218 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6315abe-6513-47ea-aa6d-fddff4378cca None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:47.904586 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888cf967-82ab-4d3d-a954-59340ecdb2c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:47.905213 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888cf967-82ab-4d3d-a954-59340ecdb2c6 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:47.906181 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888cf967-82ab-4d3d-a954-59340ecdb2c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:47.906472 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888cf967-82ab-4d3d-a954-59340ecdb2c6 None admin] PATH_INFO: `/v3/users` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:47.907265 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888cf967-82ab-4d3d-a954-59340ecdb2c6 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:59:47.907575 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888cf967-82ab-4d3d-a954-59340ecdb2c6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:47.909078 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888cf967-82ab-4d3d-a954-59340ecdb2c6 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:47.939211 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 274/554] 10.222.0.79 () {56 vars in 1135 bytes} [Tue Aug 30 00:59:47 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:59:47.940463 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888cf967-82ab-4d3d-a954-59340ecdb2c6 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:47.964543 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:47.985956 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6315abe-6513-47ea-aa6d-fddff4378cca None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:48.002118 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:48.036710 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0549bd25-792c-4721-b66b-779e426e23f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:48.037265 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0549bd25-792c-4721-b66b-779e426e23f4 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:48.037545 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0549bd25-792c-4721-b66b-779e426e23f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:48.037819 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0549bd25-792c-4721-b66b-779e426e23f4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:48.052454 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0549bd25-792c-4721-b66b-779e426e23f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:59:48.055988 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888cf967-82ab-4d3d-a954-59340ecdb2c6 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:48.058469 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-0549bd25-792c-4721-b66b-779e426e23f4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 00:59:48.058469 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:59:48.058469 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:59:48.058469 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:59:48.058469 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:59:48.058469 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:59:48.058469 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:59:48.058469 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:59:48.058469 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:59:48.058469 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:59:48.058469 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:59:48.058469 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:59:48.058469 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:59:48.058469 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:59:48.058469 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:59:48.058469 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:59:48.060219 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:59:48.060219 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:59:48.060219 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:59:48.060219 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:59:48.060219 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:59:48.060219 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:59:48.060219 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:59:48.060219 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:59:48.060219 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:59:48.060219 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:59:48.060219 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:59:48.060219 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Aug 30 00:59:48.060219 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:59:48.060219 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:59:48.060219 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:59:48.060219 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:59:48.061086 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:59:48.061086 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:59:48.061086 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:59:48.061086 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:59:48.061086 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:59:48.061086 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:59:48.061086 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:59:48.061086 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:59:48.061086 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:59:48.061086 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:59:48.061086 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 00:59:48.061086 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Aug 30 00:59:48.063204 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 281/555] 10.222.0.79 () {56 vars in 1102 bytes} [Tue Aug 30 00:59:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:59:48.064340 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0549bd25-792c-4721-b66b-779e426e23f4 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:48.103009 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e1462d-e45d-44a1-ba66-e4a51bf4d273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:48.104143 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e1462d-e45d-44a1-ba66-e4a51bf4d273 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:48.104713 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e1462d-e45d-44a1-ba66-e4a51bf4d273 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:48.105185 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e1462d-e45d-44a1-ba66-e4a51bf4d273 None admin] PATH_INFO: `/v3/roles` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:48.106059 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e1462d-e45d-44a1-ba66-e4a51bf4d273 None admin] RBAC: Adding query filter params (name=service) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:59:48.107082 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e1462d-e45d-44a1-ba66-e4a51bf4d273 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:48.108908 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e1462d-e45d-44a1-ba66-e4a51bf4d273 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:48.121796 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 275/556] 10.222.0.79 () {56 vars in 1103 bytes} [Tue Aug 30 00:59:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:59:48.123651 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e1462d-e45d-44a1-ba66-e4a51bf4d273 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:48.190575 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0549bd25-792c-4721-b66b-779e426e23f4 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:48.214267 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:48.232298 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb313e1a-4f61-41bd-ae70-f3fa4e55a254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:48.233134 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb313e1a-4f61-41bd-ae70-f3fa4e55a254 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:48.233414 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb313e1a-4f61-41bd-ae70-f3fa4e55a254 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:48.233689 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb313e1a-4f61-41bd-ae70-f3fa4e55a254 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:48.244177 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e1462d-e45d-44a1-ba66-e4a51bf4d273 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:48.277215 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:48.285019 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ea7375-c13f-47f1-87d4-215de75a023c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:48.285718 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ea7375-c13f-47f1-87d4-215de75a023c None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:48.286004 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ea7375-c13f-47f1-87d4-215de75a023c None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:48.286274 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ea7375-c13f-47f1-87d4-215de75a023c None admin] PATH_INFO: `/v3/roles` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:48.287012 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ea7375-c13f-47f1-87d4-215de75a023c None admin] RBAC: Adding query filter params (name=service) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:59:48.287290 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ea7375-c13f-47f1-87d4-215de75a023c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:48.288687 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ea7375-c13f-47f1-87d4-215de75a023c None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:48.298609 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 276/557] 10.222.0.79 () {56 vars in 1103 bytes} [Tue Aug 30 00:59:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:59:48.299502 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ea7375-c13f-47f1-87d4-215de75a023c None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:48.318428 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb313e1a-4f61-41bd-ae70-f3fa4e55a254 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:48.320293 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb313e1a-4f61-41bd-ae70-f3fa4e55a254 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:48.412547 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ea7375-c13f-47f1-87d4-215de75a023c None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:48.435349 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 282/558] 10.222.0.79 () {58 vars in 1282 bytes} [Tue Aug 30 00:59:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 00:59:48.436672 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e6b88b-754d-4439-a616-7720fb3bd507 None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:48.436959 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e6b88b-754d-4439-a616-7720fb3bd507 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:48.437229 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e6b88b-754d-4439-a616-7720fb3bd507 None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:48.438591 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 283/559] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 00:59:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:59:48.443547 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e6b88b-754d-4439-a616-7720fb3bd507 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:48.454775 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02081ee7-12ff-4271-a116-b15d52f414e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:48.455430 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02081ee7-12ff-4271-a116-b15d52f414e9 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:48.455721 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02081ee7-12ff-4271-a116-b15d52f414e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:48.455973 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02081ee7-12ff-4271-a116-b15d52f414e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:48.467628 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02081ee7-12ff-4271-a116-b15d52f414e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:48.469069 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02081ee7-12ff-4271-a116-b15d52f414e9 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:48.471704 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:48.485386 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application [None req-02081ee7-12ff-4271-a116-b15d52f414e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:59:48.485386 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:59:48.485386 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:59:48.485386 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:59:48.485386 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:59:48.485386 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:59:48.485386 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:59:48.485386 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:59:48.485386 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:59:48.485386 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:59:48.485386 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:59:48.485386 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:59:48.485386 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:59:48.485386 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:59:48.485386 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:59:48.485386 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:59:48.486364 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:59:48.486364 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:59:48.486364 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:59:48.486364 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:59:48.486364 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:59:48.486364 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:59:48.486364 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:59:48.486364 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application with Lock( Aug 30 00:59:48.486364 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:59:48.486364 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:59:48.486364 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:59:48.486364 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:59:48.486364 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:59:48.486364 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:59:48.486364 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:59:48.486364 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:59:48.486364 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:59:48.487994 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:59:48.487994 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:59:48.487994 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Aug 30 00:59:48.487994 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 277/560] 10.222.0.79 () {56 vars in 1108 bytes} [Tue Aug 30 00:59:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:59:48.487994 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02081ee7-12ff-4271-a116-b15d52f414e9 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:48.525094 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:48.563543 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e6b88b-754d-4439-a616-7720fb3bd507 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:48.601964 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3204521-9070-49f9-81b5-4ebbccdce703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:48.602538 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3204521-9070-49f9-81b5-4ebbccdce703 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:48.602814 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3204521-9070-49f9-81b5-4ebbccdce703 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:48.603077 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3204521-9070-49f9-81b5-4ebbccdce703 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:48.611094 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02081ee7-12ff-4271-a116-b15d52f414e9 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:48.614141 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3204521-9070-49f9-81b5-4ebbccdce703 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:48.615613 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3204521-9070-49f9-81b5-4ebbccdce703 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:48.631056 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-b3204521-9070-49f9-81b5-4ebbccdce703 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:59:48.631056 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:59:48.631056 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:59:48.631056 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:59:48.631056 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:59:48.631056 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:59:48.631056 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:59:48.631056 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:59:48.631056 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:59:48.631056 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:59:48.631056 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:59:48.631056 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:59:48.631056 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:59:48.631056 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:59:48.631056 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:59:48.631056 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:59:48.632092 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:59:48.632092 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:59:48.632092 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:59:48.632092 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:59:48.632092 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:59:48.632092 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:59:48.632092 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:59:48.632092 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Aug 30 00:59:48.632092 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:59:48.632092 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:59:48.632092 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:59:48.632092 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:59:48.632092 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:59:48.632092 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:59:48.632092 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:59:48.632092 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:59:48.632092 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:59:48.633034 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:59:48.633034 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:59:48.633034 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Aug 30 00:59:48.636980 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 284/561] 10.222.0.79 () {56 vars in 1108 bytes} [Tue Aug 30 00:59:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:59:48.638388 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d19770-c8bb-4e6b-a058-bb244abe74b6 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:48.638666 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d19770-c8bb-4e6b-a058-bb244abe74b6 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:48.638931 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d19770-c8bb-4e6b-a058-bb244abe74b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:48.651597 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa067d91-f032-42c9-b696-ab42e4a3f0ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:48.652223 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa067d91-f032-42c9-b696-ab42e4a3f0ba None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:48.652518 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa067d91-f032-42c9-b696-ab42e4a3f0ba None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:48.652796 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa067d91-f032-42c9-b696-ab42e4a3f0ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:48.660593 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-58d19770-c8bb-4e6b-a058-bb244abe74b6 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:59:48.661784 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-58d19770-c8bb-4e6b-a058-bb244abe74b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:59:48.666269 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa067d91-f032-42c9-b696-ab42e4a3f0ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:48.667752 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa067d91-f032-42c9-b696-ab42e4a3f0ba None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:48.683468 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application [None req-aa067d91-f032-42c9-b696-ab42e4a3f0ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:59:48.683468 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:59:48.683468 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:59:48.683468 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:59:48.683468 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:59:48.683468 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:59:48.683468 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:59:48.683468 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:59:48.683468 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:59:48.683468 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:59:48.683468 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:59:48.683468 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:59:48.683468 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:59:48.683468 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:59:48.683468 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:59:48.683468 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:59:48.684760 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:59:48.684760 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:59:48.684760 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:59:48.684760 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:59:48.684760 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:59:48.684760 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:59:48.684760 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:59:48.684760 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application with Lock( Aug 30 00:59:48.684760 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:59:48.684760 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:59:48.684760 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:59:48.684760 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:59:48.684760 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:59:48.684760 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:59:48.684760 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:59:48.684760 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:59:48.684760 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:59:48.685679 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:59:48.685679 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:59:48.685679 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Aug 30 00:59:48.685679 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 278/562] 10.222.0.79 () {56 vars in 1108 bytes} [Tue Aug 30 00:59:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:59:48.685679 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa067d91-f032-42c9-b696-ab42e4a3f0ba None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:48.739290 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:48.739510 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 285/563] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 00:59:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:59:48.744068 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d19770-c8bb-4e6b-a058-bb244abe74b6 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:48.798397 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa067d91-f032-42c9-b696-ab42e4a3f0ba None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:48.800507 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:48.835016 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bc1806-5696-48b2-8c77-5d0b7433ebc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:48.835637 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bc1806-5696-48b2-8c77-5d0b7433ebc5 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:48.835913 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bc1806-5696-48b2-8c77-5d0b7433ebc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:48.836181 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bc1806-5696-48b2-8c77-5d0b7433ebc5 None admin] PATH_INFO: `/v3/domains` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:48.836829 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bc1806-5696-48b2-8c77-5d0b7433ebc5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:59:48.837136 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bc1806-5696-48b2-8c77-5d0b7433ebc5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:48.838514 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bc1806-5696-48b2-8c77-5d0b7433ebc5 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:48.857768 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 279/564] 10.222.0.79 () {56 vars in 1109 bytes} [Tue Aug 30 00:59:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:59:48.857768 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bc1806-5696-48b2-8c77-5d0b7433ebc5 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:48.858469 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d19770-c8bb-4e6b-a058-bb244abe74b6 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:48.895475 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b650435b-9f75-4da4-b288-9f3185bdbaa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:48.896192 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b650435b-9f75-4da4-b288-9f3185bdbaa2 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:48.896464 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b650435b-9f75-4da4-b288-9f3185bdbaa2 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:48.896726 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b650435b-9f75-4da4-b288-9f3185bdbaa2 None admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:48.897365 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b650435b-9f75-4da4-b288-9f3185bdbaa2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:59:48.897659 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b650435b-9f75-4da4-b288-9f3185bdbaa2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:48.899010 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b650435b-9f75-4da4-b288-9f3185bdbaa2 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:48.915561 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 286/565] 10.222.0.79 () {56 vars in 1109 bytes} [Tue Aug 30 00:59:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:59:48.917282 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f75fab-eb53-4692-bdea-f958bbd9f6ed None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:48.917566 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f75fab-eb53-4692-bdea-f958bbd9f6ed None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:48.917839 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f75fab-eb53-4692-bdea-f958bbd9f6ed None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:48.919281 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 287/566] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 00:59:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:59:48.920178 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f75fab-eb53-4692-bdea-f958bbd9f6ed None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:48.973780 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bc1806-5696-48b2-8c77-5d0b7433ebc5 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:48.985057 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:49.013362 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5dc9ab-95f3-4683-b953-2c1d574aaebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:49.013986 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5dc9ab-95f3-4683-b953-2c1d574aaebb None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:49.014257 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5dc9ab-95f3-4683-b953-2c1d574aaebb None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:49.014521 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5dc9ab-95f3-4683-b953-2c1d574aaebb None admin] PATH_INFO: `/v3/domains` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:49.015199 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5dc9ab-95f3-4683-b953-2c1d574aaebb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:59:49.015500 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5dc9ab-95f3-4683-b953-2c1d574aaebb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:49.016863 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5dc9ab-95f3-4683-b953-2c1d574aaebb None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:49.029076 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 280/567] 10.222.0.79 () {56 vars in 1109 bytes} [Tue Aug 30 00:59:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:59:49.029901 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5dc9ab-95f3-4683-b953-2c1d574aaebb None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:49.035033 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f75fab-eb53-4692-bdea-f958bbd9f6ed None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:49.048963 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:49.077286 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5859f0a4-b903-4d5a-820c-71275e310ee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:49.077914 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5859f0a4-b903-4d5a-820c-71275e310ee6 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:49.078185 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5859f0a4-b903-4d5a-820c-71275e310ee6 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:49.078448 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5859f0a4-b903-4d5a-820c-71275e310ee6 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:49.085730 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5859f0a4-b903-4d5a-820c-71275e310ee6 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:49.087118 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5859f0a4-b903-4d5a-820c-71275e310ee6 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:49.100927 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-5859f0a4-b903-4d5a-820c-71275e310ee6 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 30 00:59:49.100927 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:59:49.100927 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:59:49.100927 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:59:49.100927 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:59:49.100927 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:59:49.100927 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:59:49.100927 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:59:49.100927 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:59:49.100927 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:59:49.100927 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:59:49.100927 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:59:49.100927 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 00:59:49.100927 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 00:59:49.100927 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 00:59:49.100927 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 00:59:49.102151 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:59:49.102151 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:59:49.102151 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 00:59:49.102151 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:59:49.102151 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 00:59:49.102151 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:59:49.102151 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:59:49.102151 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:59:49.102151 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:59:49.102151 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:59:49.102151 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:59:49.102151 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Aug 30 00:59:49.102151 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:59:49.102151 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:59:49.102151 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:59:49.102151 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:59:49.102151 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:59:49.102151 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:59:49.103369 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:59:49.103369 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:59:49.103369 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 00:59:49.103369 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 00:59:49.103369 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 00:59:49.103369 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 00:59:49.103369 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 00:59:49.103369 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 00:59:49.103369 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 30 00:59:49.103369 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Aug 30 00:59:49.103369 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 288/568] 10.222.0.79 () {56 vars in 1099 bytes} [Tue Aug 30 00:59:48 2022] GET /identity/v3/users/cinder => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:59:49.103369 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be4023c-e871-461b-9486-122d4dfe27c2 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:49.104198 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be4023c-e871-461b-9486-122d4dfe27c2 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:49.104198 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be4023c-e871-461b-9486-122d4dfe27c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:49.121430 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-4be4023c-e871-461b-9486-122d4dfe27c2 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:59:49.123118 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-4be4023c-e871-461b-9486-122d4dfe27c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:59:49.135898 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5dc9ab-95f3-4683-b953-2c1d574aaebb None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:49.170542 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5600abfd-f2e7-4516-a053-e76b82ed466f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:49.171189 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5600abfd-f2e7-4516-a053-e76b82ed466f None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:49.171472 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5600abfd-f2e7-4516-a053-e76b82ed466f None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:49.171737 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5600abfd-f2e7-4516-a053-e76b82ed466f None admin] PATH_INFO: `/v3/users/glance` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:49.179364 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5600abfd-f2e7-4516-a053-e76b82ed466f None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:49.180793 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5600abfd-f2e7-4516-a053-e76b82ed466f None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:49.192329 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 289/569] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 00:59:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:59:49.192639 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application [None req-5600abfd-f2e7-4516-a053-e76b82ed466f None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 30 00:59:49.192639 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:59:49.192639 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:59:49.192639 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:59:49.192639 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:59:49.192639 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:59:49.192639 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:59:49.192639 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:59:49.192639 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:59:49.192639 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:59:49.192639 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:59:49.192639 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:59:49.192639 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 00:59:49.192639 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 00:59:49.192639 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 00:59:49.192639 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 00:59:49.193619 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:59:49.193619 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:59:49.193619 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 00:59:49.193619 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:59:49.193619 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 00:59:49.193619 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:59:49.193619 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:59:49.193619 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:59:49.193619 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:59:49.193619 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:59:49.193619 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:59:49.193619 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application with Lock( Aug 30 00:59:49.193619 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:59:49.193619 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:59:49.193619 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:59:49.193619 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:59:49.193619 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:59:49.193619 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:59:49.194565 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:59:49.194565 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:59:49.194565 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 00:59:49.194565 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 00:59:49.194565 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 00:59:49.194565 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 00:59:49.194565 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 00:59:49.194565 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 00:59:49.194565 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 30 00:59:49.194565 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Aug 30 00:59:49.195090 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be4023c-e871-461b-9486-122d4dfe27c2 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:49.195212 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 281/570] 10.222.0.79 () {56 vars in 1099 bytes} [Tue Aug 30 00:59:49 2022] GET /identity/v3/users/glance => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:59:49.195212 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5600abfd-f2e7-4516-a053-e76b82ed466f None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:49.224432 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:49.313581 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5600abfd-f2e7-4516-a053-e76b82ed466f None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:49.317379 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be4023c-e871-461b-9486-122d4dfe27c2 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:49.319499 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:49.351961 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c218f47-fa28-4d49-ac7d-251f97f0e6f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:49.352505 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c218f47-fa28-4d49-ac7d-251f97f0e6f4 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:49.352786 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c218f47-fa28-4d49-ac7d-251f97f0e6f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:49.353059 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c218f47-fa28-4d49-ac7d-251f97f0e6f4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:49.356513 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c325a1-eadd-45c1-a76e-2fd04f82c6f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:49.357423 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c325a1-eadd-45c1-a76e-2fd04f82c6f2 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:49.357906 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c325a1-eadd-45c1-a76e-2fd04f82c6f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:49.358377 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c325a1-eadd-45c1-a76e-2fd04f82c6f2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:49.360269 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c218f47-fa28-4d49-ac7d-251f97f0e6f4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:49.361703 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c218f47-fa28-4d49-ac7d-251f97f0e6f4 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:49.369524 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c325a1-eadd-45c1-a76e-2fd04f82c6f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:59:49.374176 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application [None req-0c218f47-fa28-4d49-ac7d-251f97f0e6f4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:59:49.374176 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:59:49.374176 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:59:49.374176 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:59:49.374176 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:59:49.374176 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:59:49.374176 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:59:49.374176 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:59:49.374176 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:59:49.374176 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:59:49.374176 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:59:49.374176 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:59:49.374176 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 00:59:49.374176 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 00:59:49.374176 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 00:59:49.375050 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 00:59:49.375050 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:59:49.375050 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:59:49.375050 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:59:49.375050 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:59:49.375050 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:59:49.375050 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:59:49.375050 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:59:49.375050 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application with Lock( Aug 30 00:59:49.375050 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:59:49.375050 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:59:49.375050 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:59:49.375050 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:59:49.375050 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:59:49.375050 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:59:49.375050 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:59:49.375050 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:59:49.376093 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 00:59:49.376093 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 00:59:49.376093 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 00:59:49.376093 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 00:59:49.376093 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 00:59:49.376093 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 00:59:49.376093 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:59:49.376093 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Aug 30 00:59:49.378149 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-66c325a1-eadd-45c1-a76e-2fd04f82c6f2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 00:59:49.378149 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:59:49.378149 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:59:49.378149 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:59:49.378149 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:59:49.378149 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:59:49.378149 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:59:49.378149 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:59:49.378149 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:59:49.378149 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:59:49.378149 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:59:49.378149 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:59:49.378149 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:59:49.378149 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:59:49.378149 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:59:49.378149 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:59:49.379264 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:59:49.379264 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:59:49.379264 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:59:49.379264 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:59:49.379264 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:59:49.379264 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:59:49.379264 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:59:49.379264 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:59:49.379264 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:59:49.379264 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:59:49.379264 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:59:49.379264 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Aug 30 00:59:49.379264 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:59:49.379264 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:59:49.379264 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:59:49.379264 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:59:49.380173 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:59:49.380173 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:59:49.380173 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:59:49.380173 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:59:49.380173 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:59:49.380173 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:59:49.380173 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:59:49.380173 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:59:49.380173 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:59:49.380173 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:59:49.380173 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 00:59:49.380173 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Aug 30 00:59:49.380932 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 282/571] 10.222.0.79 () {56 vars in 1111 bytes} [Tue Aug 30 00:59:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:59:49.381023 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c218f47-fa28-4d49-ac7d-251f97f0e6f4 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:49.382573 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 290/572] 10.222.0.79 () {56 vars in 1102 bytes} [Tue Aug 30 00:59:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:59:49.383545 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c325a1-eadd-45c1-a76e-2fd04f82c6f2 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:49.484464 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:49.491952 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c325a1-eadd-45c1-a76e-2fd04f82c6f2 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:49.498225 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c218f47-fa28-4d49-ac7d-251f97f0e6f4 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:49.527286 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732dec24-deb7-4599-bbe8-e668a932ad51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:49.527922 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732dec24-deb7-4599-bbe8-e668a932ad51 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:49.528212 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732dec24-deb7-4599-bbe8-e668a932ad51 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:49.528481 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732dec24-deb7-4599-bbe8-e668a932ad51 None admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:49.529257 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732dec24-deb7-4599-bbe8-e668a932ad51 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:59:49.529601 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732dec24-deb7-4599-bbe8-e668a932ad51 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:49.531047 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732dec24-deb7-4599-bbe8-e668a932ad51 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:49.536563 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d787678-dbd3-4031-8e70-ce263934d832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:49.537171 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d787678-dbd3-4031-8e70-ce263934d832 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:49.537542 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d787678-dbd3-4031-8e70-ce263934d832 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:49.537820 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d787678-dbd3-4031-8e70-ce263934d832 None admin] PATH_INFO: `/v3/users` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:49.538545 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d787678-dbd3-4031-8e70-ce263934d832 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:59:49.538907 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d787678-dbd3-4031-8e70-ce263934d832 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:49.540384 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d787678-dbd3-4031-8e70-ce263934d832 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:49.548901 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 291/573] 10.222.0.79 () {56 vars in 1137 bytes} [Tue Aug 30 00:59:49 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:59:49.549736 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732dec24-deb7-4599-bbe8-e668a932ad51 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:49.558716 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 283/574] 10.222.0.79 () {56 vars in 1137 bytes} [Tue Aug 30 00:59:49 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:59:49.560201 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d787678-dbd3-4031-8e70-ce263934d832 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:49.575946 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:49.654939 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732dec24-deb7-4599-bbe8-e668a932ad51 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:49.665212 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d787678-dbd3-4031-8e70-ce263934d832 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:49.690036 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af76fa5-9d3d-43f6-a55b-d8ec7f59a4c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:49.690644 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af76fa5-9d3d-43f6-a55b-d8ec7f59a4c4 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:49.690922 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af76fa5-9d3d-43f6-a55b-d8ec7f59a4c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:49.691245 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af76fa5-9d3d-43f6-a55b-d8ec7f59a4c4 None admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:49.692194 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af76fa5-9d3d-43f6-a55b-d8ec7f59a4c4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:59:49.692498 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af76fa5-9d3d-43f6-a55b-d8ec7f59a4c4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:49.693926 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af76fa5-9d3d-43f6-a55b-d8ec7f59a4c4 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:49.701161 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c77cc65-12a7-46af-972c-25ee78eff7ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:49.701767 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c77cc65-12a7-46af-972c-25ee78eff7ce None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:49.702045 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c77cc65-12a7-46af-972c-25ee78eff7ce None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:49.702322 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c77cc65-12a7-46af-972c-25ee78eff7ce None admin] PATH_INFO: `/v3/roles` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:49.702988 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c77cc65-12a7-46af-972c-25ee78eff7ce None admin] RBAC: Adding query filter params (name=service) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:59:49.703328 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c77cc65-12a7-46af-972c-25ee78eff7ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:49.704696 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c77cc65-12a7-46af-972c-25ee78eff7ce None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:49.711728 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 292/575] 10.222.0.79 () {56 vars in 1148 bytes} [Tue Aug 30 00:59:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:59:49.712597 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af76fa5-9d3d-43f6-a55b-d8ec7f59a4c4 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:49.717298 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 284/576] 10.222.0.79 () {56 vars in 1103 bytes} [Tue Aug 30 00:59:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:59:49.717298 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c77cc65-12a7-46af-972c-25ee78eff7ce None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:49.725556 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:49.797781 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:49.816364 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c77cc65-12a7-46af-972c-25ee78eff7ce None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:49.816577 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af76fa5-9d3d-43f6-a55b-d8ec7f59a4c4 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:49.850993 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6b8d04-a81b-4c72-9385-79e5d9f52991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:49.851239 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0957f688-79a4-42fd-9e0c-e34314d0a81c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:49.851647 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6b8d04-a81b-4c72-9385-79e5d9f52991 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:49.851836 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0957f688-79a4-42fd-9e0c-e34314d0a81c None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:49.851975 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6b8d04-a81b-4c72-9385-79e5d9f52991 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:49.852108 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0957f688-79a4-42fd-9e0c-e34314d0a81c None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:49.852202 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6b8d04-a81b-4c72-9385-79e5d9f52991 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:49.852372 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0957f688-79a4-42fd-9e0c-e34314d0a81c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:49.862868 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6b8d04-a81b-4c72-9385-79e5d9f52991 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:59:49.863562 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0957f688-79a4-42fd-9e0c-e34314d0a81c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:49.864994 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0957f688-79a4-42fd-9e0c-e34314d0a81c None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:49.867651 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-ab6b8d04-a81b-4c72-9385-79e5d9f52991 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 00:59:49.867651 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:59:49.867651 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:59:49.867651 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:59:49.867651 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:59:49.867651 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:59:49.867651 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:59:49.867651 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:59:49.867651 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:59:49.867651 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:59:49.867651 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:59:49.867651 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:59:49.867651 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:59:49.867651 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:59:49.867651 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:59:49.867651 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:59:49.868591 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:59:49.868591 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:59:49.868591 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:59:49.868591 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:59:49.868591 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:59:49.868591 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:59:49.868591 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:59:49.868591 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:59:49.868591 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:59:49.868591 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:59:49.868591 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:59:49.868591 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Aug 30 00:59:49.868591 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:59:49.868591 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:59:49.868591 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:59:49.868591 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:59:49.869419 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:59:49.869419 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:59:49.869419 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:59:49.869419 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:59:49.869419 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:59:49.869419 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:59:49.869419 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:59:49.869419 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:59:49.869419 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:59:49.869419 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:59:49.869419 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 00:59:49.869419 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Aug 30 00:59:49.869419 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 293/577] 10.222.0.79 () {56 vars in 1102 bytes} [Tue Aug 30 00:59:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:59:49.870100 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6b8d04-a81b-4c72-9385-79e5d9f52991 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:49.883828 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application [None req-0957f688-79a4-42fd-9e0c-e34314d0a81c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:59:49.883828 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:59:49.883828 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:59:49.883828 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:59:49.883828 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:59:49.883828 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:59:49.883828 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:59:49.883828 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:59:49.883828 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:59:49.883828 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:59:49.883828 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:59:49.883828 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:59:49.883828 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:59:49.883828 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:59:49.883828 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:59:49.883828 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:59:49.884817 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:59:49.884817 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:59:49.884817 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:59:49.884817 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:59:49.884817 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:59:49.884817 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:59:49.884817 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:59:49.884817 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application with Lock( Aug 30 00:59:49.884817 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:59:49.884817 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:59:49.884817 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:59:49.884817 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:59:49.884817 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:59:49.884817 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:59:49.884817 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:59:49.884817 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:59:49.884817 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:59:49.885708 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:59:49.885708 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:59:49.885708 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Aug 30 00:59:49.885708 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 285/578] 10.222.0.79 () {56 vars in 1108 bytes} [Tue Aug 30 00:59:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:59:49.885708 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0957f688-79a4-42fd-9e0c-e34314d0a81c None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:49.948579 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:49.976983 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6b8d04-a81b-4c72-9385-79e5d9f52991 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:49.991077 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0957f688-79a4-42fd-9e0c-e34314d0a81c None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:50.012229 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7d4bf9-dd62-4172-8bbd-8086d7343bf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:50.012885 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7d4bf9-dd62-4172-8bbd-8086d7343bf3 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:50.013157 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7d4bf9-dd62-4172-8bbd-8086d7343bf3 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:50.013425 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7d4bf9-dd62-4172-8bbd-8086d7343bf3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:50.021591 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:50.023906 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7d4bf9-dd62-4172-8bbd-8086d7343bf3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:50.025393 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595c54fe-6a5d-4bab-9e72-bdd6220d6678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:50.025524 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7d4bf9-dd62-4172-8bbd-8086d7343bf3 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:50.026026 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595c54fe-6a5d-4bab-9e72-bdd6220d6678 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:50.026283 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595c54fe-6a5d-4bab-9e72-bdd6220d6678 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:50.026567 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595c54fe-6a5d-4bab-9e72-bdd6220d6678 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:50.027383 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595c54fe-6a5d-4bab-9e72-bdd6220d6678 None admin] RBAC: Adding query filter params (role.id=687d3359d6b2413b84ca5a54d30d5488, scope.project.id=0eec3a73673e45dc881de586b9b0fbbb, user.id=dd556fa6ba464928b1e067325792a523) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:59:50.027644 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595c54fe-6a5d-4bab-9e72-bdd6220d6678 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:50.029566 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595c54fe-6a5d-4bab-9e72-bdd6220d6678 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:50.047217 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 286/579] 10.222.0.79 () {56 vars in 1374 bytes} [Tue Aug 30 00:59:49 2022] GET /identity/v3/role_assignments?user.id=dd556fa6ba464928b1e067325792a523&scope.project.id=0eec3a73673e45dc881de586b9b0fbbb&role.id=687d3359d6b2413b84ca5a54d30d5488 => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:59:50.047217 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595c54fe-6a5d-4bab-9e72-bdd6220d6678 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:50.047554 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-1e7d4bf9-dd62-4172-8bbd-8086d7343bf3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:59:50.047554 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:59:50.047554 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:59:50.047554 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:59:50.047554 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:59:50.047554 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:59:50.047554 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:59:50.047554 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:59:50.047554 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:59:50.047554 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:59:50.047554 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:59:50.047554 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:59:50.047554 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:59:50.047554 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:59:50.047554 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:59:50.047554 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:59:50.048434 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:59:50.048434 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:59:50.048434 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:59:50.048434 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:59:50.048434 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:59:50.048434 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:59:50.048434 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:59:50.048434 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Aug 30 00:59:50.048434 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:59:50.048434 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:59:50.048434 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:59:50.048434 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:59:50.048434 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:59:50.048434 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:59:50.048434 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:59:50.048434 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:59:50.048434 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:59:50.049430 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:59:50.049430 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:59:50.049430 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Aug 30 00:59:50.049430 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 294/580] 10.222.0.79 () {56 vars in 1108 bytes} [Tue Aug 30 00:59:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:59:50.049430 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7d4bf9-dd62-4172-8bbd-8086d7343bf3 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:50.169925 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7d4bf9-dd62-4172-8bbd-8086d7343bf3 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:50.170435 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595c54fe-6a5d-4bab-9e72-bdd6220d6678 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:50.206279 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:50.207226 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606b6e23-9059-42fa-8d5f-f73f5d6868a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:50.207921 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606b6e23-9059-42fa-8d5f-f73f5d6868a2 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:50.208266 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606b6e23-9059-42fa-8d5f-f73f5d6868a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:50.208594 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606b6e23-9059-42fa-8d5f-f73f5d6868a2 None admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:50.209336 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606b6e23-9059-42fa-8d5f-f73f5d6868a2 None admin] RBAC: Adding query filter params (name=service) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:59:50.209756 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606b6e23-9059-42fa-8d5f-f73f5d6868a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:50.211275 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606b6e23-9059-42fa-8d5f-f73f5d6868a2 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:50.220954 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 295/581] 10.222.0.79 () {56 vars in 1103 bytes} [Tue Aug 30 00:59:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:59:50.221879 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606b6e23-9059-42fa-8d5f-f73f5d6868a2 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:50.228016 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a541d8f-6574-40c7-a622-7f9db6040333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:50.231643 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a541d8f-6574-40c7-a622-7f9db6040333 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:50.231643 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a541d8f-6574-40c7-a622-7f9db6040333 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:50.231643 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a541d8f-6574-40c7-a622-7f9db6040333 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:50.246053 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a541d8f-6574-40c7-a622-7f9db6040333 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:50.247578 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a541d8f-6574-40c7-a622-7f9db6040333 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:50.263675 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application [None req-9a541d8f-6574-40c7-a622-7f9db6040333 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:59:50.263675 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:59:50.263675 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:59:50.263675 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:59:50.263675 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:59:50.263675 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:59:50.263675 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:59:50.263675 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:59:50.263675 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:59:50.263675 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:59:50.263675 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:59:50.263675 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:59:50.263675 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:59:50.263675 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:59:50.263675 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:59:50.263675 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:59:50.264688 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:59:50.264688 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:59:50.264688 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:59:50.264688 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:59:50.264688 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:59:50.264688 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:59:50.264688 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:59:50.264688 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application with Lock( Aug 30 00:59:50.264688 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:59:50.264688 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:59:50.264688 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:59:50.264688 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:59:50.264688 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:59:50.264688 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:59:50.264688 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:59:50.264688 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:59:50.264688 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:59:50.265609 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:59:50.265609 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:59:50.265609 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Aug 30 00:59:50.267087 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 287/582] 10.222.0.79 () {56 vars in 1108 bytes} [Tue Aug 30 00:59:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:59:50.268084 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a541d8f-6574-40c7-a622-7f9db6040333 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:50.290707 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:50.342170 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606b6e23-9059-42fa-8d5f-f73f5d6868a2 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:50.381643 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd4e6b9-f02c-40b8-af39-c7970e525650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:50.382250 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd4e6b9-f02c-40b8-af39-c7970e525650 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:50.382529 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd4e6b9-f02c-40b8-af39-c7970e525650 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:50.382801 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd4e6b9-f02c-40b8-af39-c7970e525650 None admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:50.383487 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd4e6b9-f02c-40b8-af39-c7970e525650 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:59:50.383790 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd4e6b9-f02c-40b8-af39-c7970e525650 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:50.385158 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd4e6b9-f02c-40b8-af39-c7970e525650 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:50.385348 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a541d8f-6574-40c7-a622-7f9db6040333 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:50.401842 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 296/583] 10.222.0.79 () {56 vars in 1109 bytes} [Tue Aug 30 00:59:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:59:50.401842 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd4e6b9-f02c-40b8-af39-c7970e525650 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:50.431535 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c06d9d4-4482-4fda-a40e-a05f7f248186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:50.432151 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c06d9d4-4482-4fda-a40e-a05f7f248186 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:50.432427 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c06d9d4-4482-4fda-a40e-a05f7f248186 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:50.432696 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c06d9d4-4482-4fda-a40e-a05f7f248186 None admin] PATH_INFO: `/v3/domains` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:50.433341 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c06d9d4-4482-4fda-a40e-a05f7f248186 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:59:50.433639 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c06d9d4-4482-4fda-a40e-a05f7f248186 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:50.435674 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c06d9d4-4482-4fda-a40e-a05f7f248186 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:50.449461 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 288/584] 10.222.0.79 () {56 vars in 1109 bytes} [Tue Aug 30 00:59:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:59:50.452635 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c06d9d4-4482-4fda-a40e-a05f7f248186 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:50.491495 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:50.544451 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd4e6b9-f02c-40b8-af39-c7970e525650 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:50.559929 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:50.573541 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c06d9d4-4482-4fda-a40e-a05f7f248186 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:50.596414 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc2a011-8730-4f6b-97b8-97b13c1c5d55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:50.597187 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc2a011-8730-4f6b-97b8-97b13c1c5d55 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:50.597539 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc2a011-8730-4f6b-97b8-97b13c1c5d55 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:50.597886 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc2a011-8730-4f6b-97b8-97b13c1c5d55 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:50.609109 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc2a011-8730-4f6b-97b8-97b13c1c5d55 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:50.610683 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc2a011-8730-4f6b-97b8-97b13c1c5d55 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:50.610791 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8937666b-16c0-41c8-aee2-3daaa4ae7fe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:50.611411 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8937666b-16c0-41c8-aee2-3daaa4ae7fe9 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:50.611769 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8937666b-16c0-41c8-aee2-3daaa4ae7fe9 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:50.612091 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8937666b-16c0-41c8-aee2-3daaa4ae7fe9 None admin] PATH_INFO: `/v3/domains` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:50.612736 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8937666b-16c0-41c8-aee2-3daaa4ae7fe9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:59:50.613055 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8937666b-16c0-41c8-aee2-3daaa4ae7fe9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:50.614381 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8937666b-16c0-41c8-aee2-3daaa4ae7fe9 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:50.630648 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 289/585] 10.222.0.79 () {56 vars in 1109 bytes} [Tue Aug 30 00:59:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:59:50.630843 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-efc2a011-8730-4f6b-97b8-97b13c1c5d55 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:59:50.630843 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:59:50.630843 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:59:50.630843 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:59:50.630843 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:59:50.630843 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:59:50.630843 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:59:50.630843 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:59:50.630843 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:59:50.630843 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:59:50.630843 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:59:50.630843 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:59:50.630843 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:59:50.630843 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:59:50.630843 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:59:50.630843 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:59:50.632091 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:59:50.632091 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:59:50.632091 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:59:50.632091 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:59:50.632091 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:59:50.632091 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:59:50.632091 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:59:50.632091 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Aug 30 00:59:50.632091 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:59:50.632091 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:59:50.632091 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:59:50.632091 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:59:50.632091 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:59:50.632091 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:59:50.632091 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:59:50.632091 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:59:50.632091 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:59:50.633082 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:59:50.633082 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:59:50.633082 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Aug 30 00:59:50.633302 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8937666b-16c0-41c8-aee2-3daaa4ae7fe9 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:50.633386 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 297/586] 10.222.0.79 () {56 vars in 1108 bytes} [Tue Aug 30 00:59:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:59:50.633558 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc2a011-8730-4f6b-97b8-97b13c1c5d55 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:50.747790 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc2a011-8730-4f6b-97b8-97b13c1c5d55 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:50.748710 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:50.755913 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8937666b-16c0-41c8-aee2-3daaa4ae7fe9 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:50.783227 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9206651d-5b93-4711-ab6c-e517f3e73696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:50.783866 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9206651d-5b93-4711-ab6c-e517f3e73696 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:50.784142 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9206651d-5b93-4711-ab6c-e517f3e73696 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:50.784415 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9206651d-5b93-4711-ab6c-e517f3e73696 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:50.791430 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9206651d-5b93-4711-ab6c-e517f3e73696 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:50.792892 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9206651d-5b93-4711-ab6c-e517f3e73696 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:50.796290 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea293bf-603f-4f84-8c4c-b433995ab2c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:50.797030 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea293bf-603f-4f84-8c4c-b433995ab2c9 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:50.797404 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea293bf-603f-4f84-8c4c-b433995ab2c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:50.797768 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea293bf-603f-4f84-8c4c-b433995ab2c9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:50.804501 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-9206651d-5b93-4711-ab6c-e517f3e73696 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:59:50.804501 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:59:50.804501 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:59:50.804501 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:59:50.804501 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:59:50.804501 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:59:50.804501 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:59:50.804501 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:59:50.804501 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:59:50.804501 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:59:50.804501 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:59:50.804501 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:59:50.804501 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 00:59:50.804501 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 00:59:50.804501 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 00:59:50.805581 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 00:59:50.805581 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:59:50.805581 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:59:50.805581 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:59:50.805581 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:59:50.805581 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:59:50.805581 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:59:50.805581 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:59:50.805581 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Aug 30 00:59:50.805581 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:59:50.805581 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:59:50.805581 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:59:50.805581 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:59:50.805581 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:59:50.805581 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:59:50.805581 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:59:50.805581 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:59:50.812231 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 00:59:50.812231 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 00:59:50.812231 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 00:59:50.812231 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 00:59:50.812231 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 00:59:50.812231 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 00:59:50.812231 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:59:50.812231 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Aug 30 00:59:50.812763 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea293bf-603f-4f84-8c4c-b433995ab2c9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:50.812848 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 298/587] 10.222.0.79 () {56 vars in 1111 bytes} [Tue Aug 30 00:59:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:59:50.812848 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9206651d-5b93-4711-ab6c-e517f3e73696 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:50.813012 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea293bf-603f-4f84-8c4c-b433995ab2c9 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:50.826812 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application [None req-8ea293bf-603f-4f84-8c4c-b433995ab2c9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:59:50.826812 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:59:50.826812 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:59:50.826812 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:59:50.826812 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:59:50.826812 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:59:50.826812 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:59:50.826812 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:59:50.826812 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:59:50.826812 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:59:50.826812 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:59:50.826812 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:59:50.826812 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 00:59:50.826812 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 00:59:50.826812 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 00:59:50.827967 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 00:59:50.827967 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:59:50.827967 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:59:50.827967 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:59:50.827967 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:59:50.827967 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:59:50.827967 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:59:50.827967 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:59:50.827967 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application with Lock( Aug 30 00:59:50.827967 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:59:50.827967 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:59:50.827967 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:59:50.827967 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:59:50.827967 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:59:50.827967 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:59:50.827967 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:59:50.827967 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:59:50.829050 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 00:59:50.829050 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 00:59:50.829050 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 00:59:50.829050 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 00:59:50.829050 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 00:59:50.829050 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 00:59:50.829050 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:59:50.829050 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Aug 30 00:59:50.833282 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 290/588] 10.222.0.79 () {56 vars in 1111 bytes} [Tue Aug 30 00:59:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:59:50.834455 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea293bf-603f-4f84-8c4c-b433995ab2c9 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:50.843217 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:50.928944 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9206651d-5b93-4711-ab6c-e517f3e73696 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:50.947873 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea293bf-603f-4f84-8c4c-b433995ab2c9 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:50.965350 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4531a8f3-9feb-43c5-b816-be6245ad9ec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:50.966168 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4531a8f3-9feb-43c5-b816-be6245ad9ec1 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:50.966548 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4531a8f3-9feb-43c5-b816-be6245ad9ec1 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:50.966927 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4531a8f3-9feb-43c5-b816-be6245ad9ec1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:50.974691 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4531a8f3-9feb-43c5-b816-be6245ad9ec1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:50.976162 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4531a8f3-9feb-43c5-b816-be6245ad9ec1 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:50.986659 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67df2f4-3315-464b-b2a0-b69e2697f3f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:50.987301 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67df2f4-3315-464b-b2a0-b69e2697f3f5 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:50.987581 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67df2f4-3315-464b-b2a0-b69e2697f3f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:50.987849 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67df2f4-3315-464b-b2a0-b69e2697f3f5 None admin] PATH_INFO: `/v3/domains` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:50.987945 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-4531a8f3-9feb-43c5-b816-be6245ad9ec1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 30 00:59:50.987945 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:59:50.987945 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:59:50.987945 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:59:50.987945 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:59:50.987945 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:59:50.987945 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:59:50.987945 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:59:50.987945 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:59:50.987945 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:59:50.987945 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:59:50.987945 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:59:50.987945 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 00:59:50.987945 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 00:59:50.987945 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 00:59:50.987945 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 00:59:50.988806 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:59:50.988806 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:59:50.988806 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 00:59:50.988806 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:59:50.988806 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 00:59:50.988806 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:59:50.988806 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:59:50.988806 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:59:50.988806 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:59:50.988806 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:59:50.988806 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:59:50.988806 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Aug 30 00:59:50.988806 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:59:50.988806 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:59:50.988806 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:59:50.988806 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:59:50.988806 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:59:50.988806 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:59:50.991958 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:59:50.991958 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:59:50.991958 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 00:59:50.991958 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 00:59:50.991958 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 00:59:50.991958 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 00:59:50.991958 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 00:59:50.991958 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 00:59:50.991958 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 30 00:59:50.991958 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Aug 30 00:59:50.992492 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67df2f4-3315-464b-b2a0-b69e2697f3f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:59:50.992492 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67df2f4-3315-464b-b2a0-b69e2697f3f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:50.992492 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67df2f4-3315-464b-b2a0-b69e2697f3f5 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:50.994226 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 299/589] 10.222.0.79 () {56 vars in 1093 bytes} [Tue Aug 30 00:59:50 2022] GET /identity/v3/users/nova => generated 82 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:59:50.994704 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4531a8f3-9feb-43c5-b816-be6245ad9ec1 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:51.006072 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 291/590] 10.222.0.79 () {56 vars in 1109 bytes} [Tue Aug 30 00:59:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:59:51.010954 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67df2f4-3315-464b-b2a0-b69e2697f3f5 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:51.031667 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:51.098112 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:51.118295 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4531a8f3-9feb-43c5-b816-be6245ad9ec1 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:51.132821 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67df2f4-3315-464b-b2a0-b69e2697f3f5 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:51.156396 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6424a35b-2b6a-4d23-b68b-c8578e5760f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:51.157183 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6424a35b-2b6a-4d23-b68b-c8578e5760f4 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:51.157457 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6424a35b-2b6a-4d23-b68b-c8578e5760f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:51.157725 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6424a35b-2b6a-4d23-b68b-c8578e5760f4 None admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:51.158418 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6424a35b-2b6a-4d23-b68b-c8578e5760f4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:59:51.158714 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6424a35b-2b6a-4d23-b68b-c8578e5760f4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:51.160162 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6424a35b-2b6a-4d23-b68b-c8578e5760f4 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:51.171595 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ccc256-480e-48ca-bfd0-8dbe39c6f188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:51.172200 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ccc256-480e-48ca-bfd0-8dbe39c6f188 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:51.172473 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ccc256-480e-48ca-bfd0-8dbe39c6f188 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:51.172739 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ccc256-480e-48ca-bfd0-8dbe39c6f188 None admin] PATH_INFO: `/v3/projects` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:51.178242 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 300/591] 10.222.0.79 () {56 vars in 1148 bytes} [Tue Aug 30 00:59:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:59:51.178408 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ccc256-480e-48ca-bfd0-8dbe39c6f188 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:59:51.178408 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ccc256-480e-48ca-bfd0-8dbe39c6f188 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:51.178571 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6424a35b-2b6a-4d23-b68b-c8578e5760f4 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:51.178662 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ccc256-480e-48ca-bfd0-8dbe39c6f188 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:51.190990 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 292/592] 10.222.0.79 () {56 vars in 1148 bytes} [Tue Aug 30 00:59:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:59:51.192243 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ccc256-480e-48ca-bfd0-8dbe39c6f188 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:51.284992 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:51.297282 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6424a35b-2b6a-4d23-b68b-c8578e5760f4 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:51.312831 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ccc256-480e-48ca-bfd0-8dbe39c6f188 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:51.337658 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcc37ba-edb6-4a62-86b6-f7127a3567b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:51.338365 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcc37ba-edb6-4a62-86b6-f7127a3567b5 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:51.338711 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcc37ba-edb6-4a62-86b6-f7127a3567b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:51.338989 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcc37ba-edb6-4a62-86b6-f7127a3567b5 None admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:51.339749 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcc37ba-edb6-4a62-86b6-f7127a3567b5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:59:51.340056 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcc37ba-edb6-4a62-86b6-f7127a3567b5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:51.342444 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcc37ba-edb6-4a62-86b6-f7127a3567b5 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:51.353292 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ad3b9a-c1d8-4d4a-baf6-40e6606cff82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:51.353925 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ad3b9a-c1d8-4d4a-baf6-40e6606cff82 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:51.354199 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ad3b9a-c1d8-4d4a-baf6-40e6606cff82 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:51.354464 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ad3b9a-c1d8-4d4a-baf6-40e6606cff82 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:51.363946 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ad3b9a-c1d8-4d4a-baf6-40e6606cff82 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:51.365531 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ad3b9a-c1d8-4d4a-baf6-40e6606cff82 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:51.370315 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 301/593] 10.222.0.79 () {56 vars in 1133 bytes} [Tue Aug 30 00:59:51 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:59:51.370315 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcc37ba-edb6-4a62-86b6-f7127a3567b5 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:51.375429 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:51.382935 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application [None req-42ad3b9a-c1d8-4d4a-baf6-40e6606cff82 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 30 00:59:51.382935 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:59:51.382935 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:59:51.382935 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:59:51.382935 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:59:51.382935 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:59:51.382935 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:59:51.382935 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:59:51.382935 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:59:51.382935 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:59:51.382935 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:59:51.382935 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:59:51.382935 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 00:59:51.382935 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 00:59:51.382935 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 00:59:51.382935 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 00:59:51.384042 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:59:51.384042 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:59:51.384042 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 00:59:51.384042 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:59:51.384042 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 00:59:51.384042 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:59:51.384042 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:59:51.384042 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:59:51.384042 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:59:51.384042 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:59:51.384042 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:59:51.384042 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application with Lock( Aug 30 00:59:51.384042 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:59:51.384042 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:59:51.384042 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:59:51.384042 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:59:51.384042 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:59:51.384042 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:59:51.385266 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:59:51.385266 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:59:51.385266 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 00:59:51.385266 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 00:59:51.385266 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 00:59:51.385266 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 00:59:51.385266 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 00:59:51.385266 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 00:59:51.385266 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 30 00:59:51.385266 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Aug 30 00:59:51.385266 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 293/594] 10.222.0.79 () {56 vars in 1102 bytes} [Tue Aug 30 00:59:51 2022] GET /identity/v3/users/neutron => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:59:51.385910 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ad3b9a-c1d8-4d4a-baf6-40e6606cff82 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:51.488965 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcc37ba-edb6-4a62-86b6-f7127a3567b5 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:51.499665 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ad3b9a-c1d8-4d4a-baf6-40e6606cff82 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:51.531489 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80525de-fb5b-46d5-98ac-f80b3ddc0d11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:51.532402 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80525de-fb5b-46d5-98ac-f80b3ddc0d11 None admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:51.532873 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80525de-fb5b-46d5-98ac-f80b3ddc0d11 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:51.533236 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80525de-fb5b-46d5-98ac-f80b3ddc0d11 None admin] PATH_INFO: `/v3/projects/0eec3a73673e45dc881de586b9b0fbbb/users/7f827c7670b74d938ffe066ced88d1c2/roles/687d3359d6b2413b84ca5a54d30d5488` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:51.538585 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98447a88-42ed-4a3e-ace8-9480b5b9b988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:51.539217 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98447a88-42ed-4a3e-ace8-9480b5b9b988 None admin] REQUEST_METHOD: `PUT` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:51.539499 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98447a88-42ed-4a3e-ace8-9480b5b9b988 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:51.539774 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98447a88-42ed-4a3e-ace8-9480b5b9b988 None admin] PATH_INFO: `/v3/projects/0eec3a73673e45dc881de586b9b0fbbb/users/5e37a5c33c064c488fd4667170f7703a/roles/687d3359d6b2413b84ca5a54d30d5488` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:51.544127 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:51.551251 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80525de-fb5b-46d5-98ac-f80b3ddc0d11 None admin] RBAC: Authorizing `identity:create_grant(project_id=0eec3a73673e45dc881de586b9b0fbbb, user_id=7f827c7670b74d938ffe066ced88d1c2, role_id=687d3359d6b2413b84ca5a54d30d5488)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:51.552690 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80525de-fb5b-46d5-98ac-f80b3ddc0d11 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:51.556568 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98447a88-42ed-4a3e-ace8-9480b5b9b988 None admin] RBAC: Authorizing `identity:create_grant(project_id=0eec3a73673e45dc881de586b9b0fbbb, user_id=5e37a5c33c064c488fd4667170f7703a, role_id=687d3359d6b2413b84ca5a54d30d5488)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:51.558175 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98447a88-42ed-4a3e-ace8-9480b5b9b988 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:51.575613 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 302/595] 10.222.0.79 () {58 vars in 1439 bytes} [Tue Aug 30 00:59:51 2022] PUT /identity/v3/projects/0eec3a73673e45dc881de586b9b0fbbb/users/7f827c7670b74d938ffe066ced88d1c2/roles/687d3359d6b2413b84ca5a54d30d5488 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:59:51.575613 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80525de-fb5b-46d5-98ac-f80b3ddc0d11 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:51.583980 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 294/596] 10.222.0.79 () {58 vars in 1439 bytes} [Tue Aug 30 00:59:51 2022] PUT /identity/v3/projects/0eec3a73673e45dc881de586b9b0fbbb/users/5e37a5c33c064c488fd4667170f7703a/roles/687d3359d6b2413b84ca5a54d30d5488 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:59:51.585081 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98447a88-42ed-4a3e-ace8-9480b5b9b988 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:51.699728 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:51.748752 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98447a88-42ed-4a3e-ace8-9480b5b9b988 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:51.814045 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fff760-029d-4202-8f04-4921e7a3832e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:51.815001 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fff760-029d-4202-8f04-4921e7a3832e None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:51.815546 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fff760-029d-4202-8f04-4921e7a3832e None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:51.816020 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fff760-029d-4202-8f04-4921e7a3832e None admin] PATH_INFO: `/v3/users` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:51.817246 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fff760-029d-4202-8f04-4921e7a3832e None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:59:51.817789 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fff760-029d-4202-8f04-4921e7a3832e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:51.819469 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fff760-029d-4202-8f04-4921e7a3832e None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:51.833082 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80525de-fb5b-46d5-98ac-f80b3ddc0d11 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:51.847226 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 295/597] 10.222.0.79 () {56 vars in 1139 bytes} [Tue Aug 30 00:59:51 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:59:51.853049 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fff760-029d-4202-8f04-4921e7a3832e None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:51.882576 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a4ece1-81e5-42c6-9613-9079f21ce614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:51.884663 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a4ece1-81e5-42c6-9613-9079f21ce614 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:51.885451 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a4ece1-81e5-42c6-9613-9079f21ce614 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:51.886482 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a4ece1-81e5-42c6-9613-9079f21ce614 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:51.902905 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a4ece1-81e5-42c6-9613-9079f21ce614 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:51.904808 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a4ece1-81e5-42c6-9613-9079f21ce614 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:51.914931 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:51.923698 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-f4a4ece1-81e5-42c6-9613-9079f21ce614 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:59:51.923698 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:59:51.923698 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:59:51.923698 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:59:51.923698 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:59:51.923698 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:59:51.923698 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:59:51.923698 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:59:51.923698 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:59:51.923698 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:59:51.923698 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:59:51.923698 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:59:51.923698 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:59:51.923698 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:59:51.923698 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:59:51.923698 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:59:51.924681 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:59:51.924681 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:59:51.924681 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:59:51.924681 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:59:51.924681 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:59:51.924681 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:59:51.924681 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:59:51.924681 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Aug 30 00:59:51.924681 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:59:51.924681 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:59:51.924681 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:59:51.924681 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:59:51.924681 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:59:51.924681 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:59:51.924681 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:59:51.924681 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:59:51.924681 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:59:51.925670 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:59:51.925670 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:59:51.925670 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Aug 30 00:59:51.928092 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 303/598] 10.222.0.79 () {56 vars in 1108 bytes} [Tue Aug 30 00:59:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 359 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:59:51.934481 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a4ece1-81e5-42c6-9613-9079f21ce614 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:51.983363 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fff760-029d-4202-8f04-4921e7a3832e None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:52.023506 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9812c2d-2424-4a3f-a44a-817cd4b13663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:52.024143 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9812c2d-2424-4a3f-a44a-817cd4b13663 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:52.024417 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9812c2d-2424-4a3f-a44a-817cd4b13663 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:52.024683 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9812c2d-2424-4a3f-a44a-817cd4b13663 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:52.036519 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9812c2d-2424-4a3f-a44a-817cd4b13663 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:52.037987 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9812c2d-2424-4a3f-a44a-817cd4b13663 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:52.054058 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application [None req-d9812c2d-2424-4a3f-a44a-817cd4b13663 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:59:52.054058 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:59:52.054058 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:59:52.054058 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:59:52.054058 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:59:52.054058 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:59:52.054058 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:59:52.054058 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:59:52.054058 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:59:52.054058 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:59:52.054058 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:59:52.054058 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:59:52.054058 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:59:52.054058 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:59:52.054058 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:59:52.054058 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:59:52.055080 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:59:52.055080 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:59:52.055080 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:59:52.055080 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:59:52.055080 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:59:52.055080 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:59:52.055080 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:59:52.055080 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application with Lock( Aug 30 00:59:52.055080 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:59:52.055080 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:59:52.055080 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:59:52.055080 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:59:52.055080 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:59:52.055080 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:59:52.055080 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:59:52.055080 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:59:52.055080 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:59:52.056409 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:59:52.056409 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:59:52.056409 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Aug 30 00:59:52.056409 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 296/599] 10.222.0.79 () {56 vars in 1108 bytes} [Tue Aug 30 00:59:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 00:59:52.056802 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45ae075-bea3-4457-87e6-d7306a838f77 None None] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:52.056990 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45ae075-bea3-4457-87e6-d7306a838f77 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:52.057262 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45ae075-bea3-4457-87e6-d7306a838f77 None None] PATH_INFO: `/` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:52.063711 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 297/600] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 00:59:52 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:59:52.064659 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45ae075-bea3-4457-87e6-d7306a838f77 None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:52.078271 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a4ece1-81e5-42c6-9613-9079f21ce614 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:52.088312 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:52.128954 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a8d89a-98f3-4074-9de0-546a105247ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:52.130176 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a8d89a-98f3-4074-9de0-546a105247ef None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:52.130915 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a8d89a-98f3-4074-9de0-546a105247ef None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:52.131856 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a8d89a-98f3-4074-9de0-546a105247ef None admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:52.132988 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a8d89a-98f3-4074-9de0-546a105247ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:59:52.133546 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a8d89a-98f3-4074-9de0-546a105247ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:52.136185 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a8d89a-98f3-4074-9de0-546a105247ef None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:52.157416 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 304/601] 10.222.0.79 () {56 vars in 1109 bytes} [Tue Aug 30 00:59:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:59:52.157416 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b566c65-7e92-458f-aea5-91a04663d882 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:52.157416 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b566c65-7e92-458f-aea5-91a04663d882 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:52.157416 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b566c65-7e92-458f-aea5-91a04663d882 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:52.177023 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-0b566c65-7e92-458f-aea5-91a04663d882 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:59:52.177781 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:52.178552 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-0b566c65-7e92-458f-aea5-91a04663d882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:59:52.186818 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45ae075-bea3-4457-87e6-d7306a838f77 None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:52.226549 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be1d274-aa77-43e2-903f-c8b121b7f7f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:52.227587 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be1d274-aa77-43e2-903f-c8b121b7f7f9 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:52.228103 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be1d274-aa77-43e2-903f-c8b121b7f7f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:52.228569 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be1d274-aa77-43e2-903f-c8b121b7f7f9 None admin] PATH_INFO: `/v3/domains` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:52.236094 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be1d274-aa77-43e2-903f-c8b121b7f7f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:59:52.236707 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be1d274-aa77-43e2-903f-c8b121b7f7f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:52.238634 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be1d274-aa77-43e2-903f-c8b121b7f7f9 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:52.252452 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 298/602] 10.222.0.79 () {56 vars in 1109 bytes} [Tue Aug 30 00:59:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:59:52.253378 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be1d274-aa77-43e2-903f-c8b121b7f7f9 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:52.271564 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 305/603] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 00:59:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:59:52.272545 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b566c65-7e92-458f-aea5-91a04663d882 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:52.381617 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:52.388852 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b566c65-7e92-458f-aea5-91a04663d882 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:52.450571 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be1d274-aa77-43e2-903f-c8b121b7f7f9 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:52.452141 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c194f9-d63e-4609-9e58-cbd5b52c4784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:52.452781 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c194f9-d63e-4609-9e58-cbd5b52c4784 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:52.453056 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c194f9-d63e-4609-9e58-cbd5b52c4784 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:52.453320 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c194f9-d63e-4609-9e58-cbd5b52c4784 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:52.467211 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c194f9-d63e-4609-9e58-cbd5b52c4784 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:52.468663 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c194f9-d63e-4609-9e58-cbd5b52c4784 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:52.488939 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-14c194f9-d63e-4609-9e58-cbd5b52c4784 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:59:52.488939 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:59:52.488939 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:59:52.488939 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:59:52.488939 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:59:52.488939 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:59:52.488939 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:59:52.488939 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:59:52.488939 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:59:52.488939 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:59:52.488939 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:59:52.488939 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:59:52.488939 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 00:59:52.488939 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 00:59:52.488939 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 00:59:52.489909 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 00:59:52.489909 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:59:52.489909 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:59:52.489909 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:59:52.489909 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:59:52.489909 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:59:52.489909 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:59:52.489909 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:59:52.489909 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Aug 30 00:59:52.489909 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:59:52.489909 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:59:52.489909 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:59:52.489909 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:59:52.489909 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:59:52.489909 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:59:52.489909 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:59:52.489909 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:59:52.490789 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 00:59:52.490789 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 00:59:52.490789 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 00:59:52.490789 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 00:59:52.490789 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 00:59:52.490789 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 00:59:52.490789 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:59:52.490789 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Aug 30 00:59:52.490789 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 306/604] 10.222.0.79 () {56 vars in 1111 bytes} [Tue Aug 30 00:59:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:59:52.496035 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c194f9-d63e-4609-9e58-cbd5b52c4784 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:52.523756 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b440fd-7145-4b6d-87a0-f4a30e0cba7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:52.524378 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b440fd-7145-4b6d-87a0-f4a30e0cba7b None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:52.524650 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b440fd-7145-4b6d-87a0-f4a30e0cba7b None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:52.524914 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b440fd-7145-4b6d-87a0-f4a30e0cba7b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:52.536306 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b440fd-7145-4b6d-87a0-f4a30e0cba7b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:52.537774 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b440fd-7145-4b6d-87a0-f4a30e0cba7b None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:52.549940 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application [None req-e0b440fd-7145-4b6d-87a0-f4a30e0cba7b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:59:52.549940 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:59:52.549940 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:59:52.549940 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:59:52.549940 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:59:52.549940 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:59:52.549940 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:59:52.549940 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:59:52.549940 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:59:52.549940 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:59:52.549940 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:59:52.549940 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:59:52.549940 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 00:59:52.549940 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 00:59:52.549940 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 00:59:52.550839 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 00:59:52.550839 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:59:52.550839 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:59:52.550839 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:59:52.550839 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:59:52.550839 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:59:52.550839 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:59:52.550839 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:59:52.550839 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application with Lock( Aug 30 00:59:52.550839 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:59:52.550839 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:59:52.550839 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:59:52.550839 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:59:52.550839 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:59:52.550839 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:59:52.550839 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:59:52.550839 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:59:52.551773 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 00:59:52.551773 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 00:59:52.551773 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 00:59:52.551773 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 00:59:52.551773 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 00:59:52.551773 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 00:59:52.551773 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:59:52.551773 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Aug 30 00:59:52.555238 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 299/605] 10.222.0.79 () {56 vars in 1111 bytes} [Tue Aug 30 00:59:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:59:52.556971 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b440fd-7145-4b6d-87a0-f4a30e0cba7b None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:52.576503 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:52.665973 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b440fd-7145-4b6d-87a0-f4a30e0cba7b None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:52.666167 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c194f9-d63e-4609-9e58-cbd5b52c4784 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:52.702920 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc89c85-059a-4b51-a973-1ae9facd9969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:52.703442 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8559e936-3476-41ac-8172-b0c9d0f653f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:52.703566 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc89c85-059a-4b51-a973-1ae9facd9969 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:52.703819 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc89c85-059a-4b51-a973-1ae9facd9969 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:52.704050 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8559e936-3476-41ac-8172-b0c9d0f653f5 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:52.704152 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc89c85-059a-4b51-a973-1ae9facd9969 None admin] PATH_INFO: `/v3/projects` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:52.704331 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8559e936-3476-41ac-8172-b0c9d0f653f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:52.704605 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8559e936-3476-41ac-8172-b0c9d0f653f5 None admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:52.704777 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc89c85-059a-4b51-a973-1ae9facd9969 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:59:52.705053 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc89c85-059a-4b51-a973-1ae9facd9969 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:52.705299 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8559e936-3476-41ac-8172-b0c9d0f653f5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:59:52.705599 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8559e936-3476-41ac-8172-b0c9d0f653f5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:52.706470 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc89c85-059a-4b51-a973-1ae9facd9969 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:52.707003 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8559e936-3476-41ac-8172-b0c9d0f653f5 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:52.724348 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 300/606] 10.222.0.79 () {56 vars in 1148 bytes} [Tue Aug 30 00:59:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:59:52.725399 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 307/607] 10.222.0.79 () {56 vars in 1148 bytes} [Tue Aug 30 00:59:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:59:52.725595 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc89c85-059a-4b51-a973-1ae9facd9969 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:52.726471 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8559e936-3476-41ac-8172-b0c9d0f653f5 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:52.745444 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:52.815515 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:52.836139 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8559e936-3476-41ac-8172-b0c9d0f653f5 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:52.840485 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc89c85-059a-4b51-a973-1ae9facd9969 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:52.876000 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a67a50-07e6-47bf-8237-7cf5e297caed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:52.876775 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a67a50-07e6-47bf-8237-7cf5e297caed None admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:52.877058 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a67a50-07e6-47bf-8237-7cf5e297caed None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:52.877335 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a67a50-07e6-47bf-8237-7cf5e297caed None admin] PATH_INFO: `/v3/projects/0eec3a73673e45dc881de586b9b0fbbb/users/16e6a0ca26fc4ef892c188ad89a1e132/roles/687d3359d6b2413b84ca5a54d30d5488` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:52.886024 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cb70a7-3858-4337-a41c-f8c1190fb7a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:52.887845 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cb70a7-3858-4337-a41c-f8c1190fb7a8 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:52.888608 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cb70a7-3858-4337-a41c-f8c1190fb7a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:52.889105 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cb70a7-3858-4337-a41c-f8c1190fb7a8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:52.893312 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a67a50-07e6-47bf-8237-7cf5e297caed None admin] RBAC: Authorizing `identity:create_grant(project_id=0eec3a73673e45dc881de586b9b0fbbb, user_id=16e6a0ca26fc4ef892c188ad89a1e132, role_id=687d3359d6b2413b84ca5a54d30d5488)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:52.894773 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a67a50-07e6-47bf-8237-7cf5e297caed None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:52.904892 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cb70a7-3858-4337-a41c-f8c1190fb7a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:59:52.912552 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application [None req-64cb70a7-3858-4337-a41c-f8c1190fb7a8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 00:59:52.912552 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:59:52.912552 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:59:52.912552 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:59:52.912552 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:59:52.912552 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:59:52.912552 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:59:52.912552 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:59:52.912552 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:59:52.912552 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:59:52.912552 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:59:52.912552 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:59:52.912552 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:59:52.912552 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:59:52.912552 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:59:52.912552 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:59:52.913739 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:59:52.913739 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:59:52.913739 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:59:52.913739 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:59:52.913739 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:59:52.913739 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:59:52.913739 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:59:52.913739 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:59:52.913739 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:59:52.913739 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:59:52.913739 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:59:52.913739 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application with Lock( Aug 30 00:59:52.913739 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:59:52.913739 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:59:52.913739 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:59:52.913739 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:59:52.914575 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:59:52.914575 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:59:52.914575 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:59:52.914575 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:59:52.914575 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:59:52.914575 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:59:52.914575 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:59:52.914575 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:59:52.914575 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:59:52.914575 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:59:52.914575 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 00:59:52.914575 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Aug 30 00:59:52.921013 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 301/608] 10.222.0.79 () {56 vars in 1102 bytes} [Tue Aug 30 00:59:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:59:52.921777 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cb70a7-3858-4337-a41c-f8c1190fb7a8 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:52.923373 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 308/609] 10.222.0.79 () {58 vars in 1439 bytes} [Tue Aug 30 00:59:52 2022] PUT /identity/v3/projects/0eec3a73673e45dc881de586b9b0fbbb/users/16e6a0ca26fc4ef892c188ad89a1e132/roles/687d3359d6b2413b84ca5a54d30d5488 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:59:52.924495 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a67a50-07e6-47bf-8237-7cf5e297caed None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:53.010712 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:53.052994 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a67a50-07e6-47bf-8237-7cf5e297caed None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:53.094963 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee230db-23c1-4e38-b0cc-47332c82e459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:53.096070 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee230db-23c1-4e38-b0cc-47332c82e459 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:53.096555 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee230db-23c1-4e38-b0cc-47332c82e459 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:53.097049 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee230db-23c1-4e38-b0cc-47332c82e459 None admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:53.097932 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee230db-23c1-4e38-b0cc-47332c82e459 None admin] RBAC: Adding query filter params (name=service) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:59:53.098430 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee230db-23c1-4e38-b0cc-47332c82e459 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:53.100065 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee230db-23c1-4e38-b0cc-47332c82e459 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:53.111160 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 309/610] 10.222.0.79 () {56 vars in 1103 bytes} [Tue Aug 30 00:59:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:59:53.124262 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee230db-23c1-4e38-b0cc-47332c82e459 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:53.191648 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cb70a7-3858-4337-a41c-f8c1190fb7a8 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:53.228436 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab96655-e6a6-46a2-984c-9314980c8e17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:53.229468 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab96655-e6a6-46a2-984c-9314980c8e17 None admin] REQUEST_METHOD: `PUT` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:53.229943 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab96655-e6a6-46a2-984c-9314980c8e17 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:53.230430 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab96655-e6a6-46a2-984c-9314980c8e17 None admin] PATH_INFO: `/v3/projects/0eec3a73673e45dc881de586b9b0fbbb/users/6480b2f14c37474c89df9fba48f7cd91/roles/687d3359d6b2413b84ca5a54d30d5488` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:53.235466 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:53.250702 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab96655-e6a6-46a2-984c-9314980c8e17 None admin] RBAC: Authorizing `identity:create_grant(project_id=0eec3a73673e45dc881de586b9b0fbbb, user_id=6480b2f14c37474c89df9fba48f7cd91, role_id=687d3359d6b2413b84ca5a54d30d5488)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:53.252645 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab96655-e6a6-46a2-984c-9314980c8e17 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:53.274395 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 302/611] 10.222.0.79 () {58 vars in 1439 bytes} [Tue Aug 30 00:59:52 2022] PUT /identity/v3/projects/0eec3a73673e45dc881de586b9b0fbbb/users/6480b2f14c37474c89df9fba48f7cd91/roles/687d3359d6b2413b84ca5a54d30d5488 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:59:53.276687 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee230db-23c1-4e38-b0cc-47332c82e459 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:53.316604 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ef1b31-b9d2-4939-8719-15b6642a303d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:53.317561 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ef1b31-b9d2-4939-8719-15b6642a303d None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:53.317846 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ef1b31-b9d2-4939-8719-15b6642a303d None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:53.318122 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ef1b31-b9d2-4939-8719-15b6642a303d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:53.331642 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:53.336017 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ef1b31-b9d2-4939-8719-15b6642a303d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:53.337740 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ef1b31-b9d2-4939-8719-15b6642a303d None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:53.354845 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-c4ef1b31-b9d2-4939-8719-15b6642a303d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:59:53.354845 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:59:53.354845 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:59:53.354845 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:59:53.354845 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:59:53.354845 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:59:53.354845 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:59:53.354845 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:59:53.354845 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:59:53.354845 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:59:53.354845 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:59:53.354845 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:59:53.354845 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:59:53.354845 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:59:53.354845 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:59:53.354845 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:59:53.355883 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:59:53.355883 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:59:53.355883 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:59:53.355883 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:59:53.355883 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:59:53.355883 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:59:53.355883 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:59:53.355883 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Aug 30 00:59:53.355883 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:59:53.355883 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:59:53.355883 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:59:53.355883 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:59:53.355883 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:59:53.355883 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:59:53.355883 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:59:53.355883 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:59:53.355883 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:59:53.357444 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:59:53.357444 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:59:53.357444 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Aug 30 00:59:53.364589 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 310/612] 10.222.0.79 () {56 vars in 1108 bytes} [Tue Aug 30 00:59:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:59:53.367014 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab96655-e6a6-46a2-984c-9314980c8e17 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:53.487475 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab96655-e6a6-46a2-984c-9314980c8e17 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:53.530306 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffa51f7-71d9-40d3-924b-2eabb807e3f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:53.530921 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffa51f7-71d9-40d3-924b-2eabb807e3f2 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:53.531217 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffa51f7-71d9-40d3-924b-2eabb807e3f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:53.531546 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffa51f7-71d9-40d3-924b-2eabb807e3f2 None admin] PATH_INFO: `/v3/domains` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:53.532199 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffa51f7-71d9-40d3-924b-2eabb807e3f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:59:53.532541 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffa51f7-71d9-40d3-924b-2eabb807e3f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:53.533923 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffa51f7-71d9-40d3-924b-2eabb807e3f2 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:53.547854 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 303/613] 10.222.0.79 () {56 vars in 1109 bytes} [Tue Aug 30 00:59:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:59:53.557133 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ef1b31-b9d2-4939-8719-15b6642a303d None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:53.690369 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ef1b31-b9d2-4939-8719-15b6642a303d None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:53.742725 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb4f7f9-a9cf-45f3-8c10-b5c72ca702d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:53.743337 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb4f7f9-a9cf-45f3-8c10-b5c72ca702d7 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:53.743623 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb4f7f9-a9cf-45f3-8c10-b5c72ca702d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:53.743896 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb4f7f9-a9cf-45f3-8c10-b5c72ca702d7 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:53.755325 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb4f7f9-a9cf-45f3-8c10-b5c72ca702d7 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:53.756771 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb4f7f9-a9cf-45f3-8c10-b5c72ca702d7 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:53.774743 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-4fb4f7f9-a9cf-45f3-8c10-b5c72ca702d7 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 30 00:59:53.774743 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:59:53.774743 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:59:53.774743 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:59:53.774743 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:59:53.774743 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:59:53.774743 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:59:53.774743 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:59:53.774743 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:59:53.774743 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:59:53.774743 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:59:53.774743 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:59:53.774743 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 00:59:53.774743 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 00:59:53.774743 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 00:59:53.774743 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 00:59:53.775772 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:59:53.775772 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:59:53.775772 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 00:59:53.775772 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:59:53.775772 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 00:59:53.775772 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:59:53.775772 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:59:53.775772 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:59:53.775772 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:59:53.775772 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:59:53.775772 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:59:53.775772 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Aug 30 00:59:53.775772 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:59:53.775772 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:59:53.775772 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:59:53.775772 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:59:53.775772 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:59:53.775772 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:59:53.776712 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:59:53.776712 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:59:53.776712 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 00:59:53.776712 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 00:59:53.776712 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 00:59:53.776712 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 00:59:53.776712 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 00:59:53.776712 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 00:59:53.776712 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 30 00:59:53.776712 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Aug 30 00:59:53.783158 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 311/614] 10.222.0.79 () {56 vars in 1096 bytes} [Tue Aug 30 00:59:53 2022] GET /identity/v3/users/swift => generated 83 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:59:53.788499 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffa51f7-71d9-40d3-924b-2eabb807e3f2 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:53.881809 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:53.961141 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a700ae-251e-41dd-8a48-c9330d4818a4 None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:53.961695 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a700ae-251e-41dd-8a48-c9330d4818a4 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:53.961695 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a700ae-251e-41dd-8a48-c9330d4818a4 None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:53.967452 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 312/615] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 00:59:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:59:53.968847 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7a683e-a032-4fa0-9fd8-a5ce92a3dca2 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:53.969130 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7a683e-a032-4fa0-9fd8-a5ce92a3dca2 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:53.969407 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7a683e-a032-4fa0-9fd8-a5ce92a3dca2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:53.998286 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffa51f7-71d9-40d3-924b-2eabb807e3f2 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:54.001189 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-5c7a683e-a032-4fa0-9fd8-a5ce92a3dca2 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:59:54.002569 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-5c7a683e-a032-4fa0-9fd8-a5ce92a3dca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:59:54.055154 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dcba7e-cdc2-4a5b-9b09-4c21967afa96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:54.055154 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dcba7e-cdc2-4a5b-9b09-4c21967afa96 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:54.055154 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dcba7e-cdc2-4a5b-9b09-4c21967afa96 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:54.059151 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:54.059346 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dcba7e-cdc2-4a5b-9b09-4c21967afa96 None admin] PATH_INFO: `/v3/users` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:54.059346 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dcba7e-cdc2-4a5b-9b09-4c21967afa96 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:59:54.059346 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dcba7e-cdc2-4a5b-9b09-4c21967afa96 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:54.062441 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dcba7e-cdc2-4a5b-9b09-4c21967afa96 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:54.094139 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 313/617] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 00:59:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:59:54.100074 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 304/617] 10.222.0.79 () {56 vars in 1135 bytes} [Tue Aug 30 00:59:53 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:59:54.100556 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c830c4-8e41-46aa-8fc4-98ede98f5e9f None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:54.100851 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c830c4-8e41-46aa-8fc4-98ede98f5e9f None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:54.101123 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c830c4-8e41-46aa-8fc4-98ede98f5e9f None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:54.101615 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dcba7e-cdc2-4a5b-9b09-4c21967afa96 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:54.102795 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 314/618] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 00:59:54 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:59:54.108585 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67e73a6-b5bc-46e7-a3b3-26272f8ea6ec None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:54.108866 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67e73a6-b5bc-46e7-a3b3-26272f8ea6ec None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:54.109140 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67e73a6-b5bc-46e7-a3b3-26272f8ea6ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:54.151119 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-c67e73a6-b5bc-46e7-a3b3-26272f8ea6ec None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:59:54.152142 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-c67e73a6-b5bc-46e7-a3b3-26272f8ea6ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:59:54.348063 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dcba7e-cdc2-4a5b-9b09-4c21967afa96 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:54.357575 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:54.386691 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 315/619] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 00:59:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:59:54.388512 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ac98c1-892c-42b1-8442-7d8025d442bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:54.389152 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ac98c1-892c-42b1-8442-7d8025d442bb None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:54.389427 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ac98c1-892c-42b1-8442-7d8025d442bb None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:54.389694 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ac98c1-892c-42b1-8442-7d8025d442bb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:54.400571 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ac98c1-892c-42b1-8442-7d8025d442bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:54.402031 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ac98c1-892c-42b1-8442-7d8025d442bb None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:54.418197 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application [None req-64ac98c1-892c-42b1-8442-7d8025d442bb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:59:54.418197 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:59:54.418197 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:59:54.418197 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:59:54.418197 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:59:54.418197 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:59:54.418197 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:59:54.418197 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:59:54.418197 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:59:54.418197 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:59:54.418197 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:59:54.418197 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:59:54.418197 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:59:54.418197 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:59:54.418197 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:59:54.418197 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:59:54.420057 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:59:54.420057 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:59:54.420057 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:59:54.420057 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:59:54.420057 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:59:54.420057 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:59:54.420057 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:59:54.420057 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application with Lock( Aug 30 00:59:54.420057 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:59:54.420057 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:59:54.420057 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:59:54.420057 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:59:54.420057 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:59:54.420057 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:59:54.420057 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:59:54.420057 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:59:54.420057 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:59:54.422179 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:59:54.422179 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:59:54.422179 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Aug 30 00:59:54.422179 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 305/620] 10.222.0.79 () {56 vars in 1108 bytes} [Tue Aug 30 00:59:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:59:54.428264 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67e73a6-b5bc-46e7-a3b3-26272f8ea6ec None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:54.454172 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ac98c1-892c-42b1-8442-7d8025d442bb None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:54.615994 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ac98c1-892c-42b1-8442-7d8025d442bb None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:54.627041 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:54.632608 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67e73a6-b5bc-46e7-a3b3-26272f8ea6ec None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:54.655345 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8355f96-ee39-49f8-bc31-802552645d52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:54.655984 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8355f96-ee39-49f8-bc31-802552645d52 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:54.656262 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8355f96-ee39-49f8-bc31-802552645d52 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:54.656533 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8355f96-ee39-49f8-bc31-802552645d52 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:54.670162 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8355f96-ee39-49f8-bc31-802552645d52 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:59:54.676635 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application [None req-f8355f96-ee39-49f8-bc31-802552645d52 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 00:59:54.676635 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:59:54.676635 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:59:54.676635 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:59:54.676635 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:59:54.676635 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:59:54.676635 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:59:54.676635 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:59:54.676635 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:59:54.676635 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:59:54.676635 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:59:54.676635 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:59:54.676635 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:59:54.676635 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:59:54.676635 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:59:54.676635 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:59:54.677562 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:59:54.677562 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:59:54.677562 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:59:54.677562 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:59:54.677562 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:59:54.677562 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:59:54.677562 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:59:54.677562 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:59:54.677562 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:59:54.677562 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:59:54.677562 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:59:54.677562 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application with Lock( Aug 30 00:59:54.677562 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:59:54.677562 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:59:54.677562 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:59:54.677562 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:59:54.678652 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:59:54.678652 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:59:54.678652 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:59:54.678652 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:59:54.678652 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:59:54.678652 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:59:54.678652 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:59:54.678652 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:59:54.678652 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:59:54.678652 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:59:54.678652 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 00:59:54.678652 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Aug 30 00:59:54.678652 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 306/621] 10.222.0.79 () {56 vars in 1102 bytes} [Tue Aug 30 00:59:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 00:59:54.688095 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8355f96-ee39-49f8-bc31-802552645d52 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:54.708540 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:54.713357 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83dde23-96c9-45b3-998b-a8c2e753ad91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:54.714506 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83dde23-96c9-45b3-998b-a8c2e753ad91 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:54.715227 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83dde23-96c9-45b3-998b-a8c2e753ad91 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:54.715808 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83dde23-96c9-45b3-998b-a8c2e753ad91 None admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:54.717715 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83dde23-96c9-45b3-998b-a8c2e753ad91 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:59:54.718452 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83dde23-96c9-45b3-998b-a8c2e753ad91 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:54.720177 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83dde23-96c9-45b3-998b-a8c2e753ad91 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:54.753100 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 316/622] 10.222.0.79 () {56 vars in 1109 bytes} [Tue Aug 30 00:59:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:59:54.764442 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83dde23-96c9-45b3-998b-a8c2e753ad91 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:54.803483 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8355f96-ee39-49f8-bc31-802552645d52 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:54.849794 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335e8f0c-35e6-4939-b219-fe127e5737fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:54.850668 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335e8f0c-35e6-4939-b219-fe127e5737fc None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:54.851043 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335e8f0c-35e6-4939-b219-fe127e5737fc None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:54.851485 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335e8f0c-35e6-4939-b219-fe127e5737fc None admin] PATH_INFO: `/v3/roles` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:54.852314 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335e8f0c-35e6-4939-b219-fe127e5737fc None admin] RBAC: Adding query filter params (name=service) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:59:54.852717 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335e8f0c-35e6-4939-b219-fe127e5737fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:54.854280 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335e8f0c-35e6-4939-b219-fe127e5737fc None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:54.864279 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 307/623] 10.222.0.79 () {56 vars in 1103 bytes} [Tue Aug 30 00:59:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:59:54.865518 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335e8f0c-35e6-4939-b219-fe127e5737fc None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:54.916156 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83dde23-96c9-45b3-998b-a8c2e753ad91 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:54.963390 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:54.967597 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b686d72-87dc-4fba-a7c0-37c6f5cda15f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:54.969234 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b686d72-87dc-4fba-a7c0-37c6f5cda15f None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:54.969641 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b686d72-87dc-4fba-a7c0-37c6f5cda15f None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:54.969923 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b686d72-87dc-4fba-a7c0-37c6f5cda15f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:54.979606 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b686d72-87dc-4fba-a7c0-37c6f5cda15f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:54.981042 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b686d72-87dc-4fba-a7c0-37c6f5cda15f None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:54.994046 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-1b686d72-87dc-4fba-a7c0-37c6f5cda15f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:59:54.994046 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:59:54.994046 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:59:54.994046 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:59:54.994046 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:59:54.994046 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:59:54.994046 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:59:54.994046 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:59:54.994046 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:59:54.994046 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:59:54.994046 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:59:54.994046 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:59:54.994046 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 00:59:54.994046 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 00:59:54.994046 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 00:59:54.995008 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 00:59:54.995008 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:59:54.995008 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:59:54.995008 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:59:54.995008 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:59:54.995008 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:59:54.995008 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:59:54.995008 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:59:54.995008 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Aug 30 00:59:54.995008 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:59:54.995008 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:59:54.995008 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:59:54.995008 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:59:54.995008 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:59:54.995008 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:59:54.995008 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:59:54.995008 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:59:54.995933 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 00:59:54.995933 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 00:59:54.995933 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 00:59:54.995933 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 00:59:54.995933 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 00:59:54.995933 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 00:59:54.995933 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:59:54.995933 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Aug 30 00:59:54.997575 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335e8f0c-35e6-4939-b219-fe127e5737fc None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:55.000645 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 317/624] 10.222.0.79 () {56 vars in 1111 bytes} [Tue Aug 30 00:59:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:59:55.001488 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b686d72-87dc-4fba-a7c0-37c6f5cda15f None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:55.025064 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:55.042142 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8024a4-2c2a-48cf-b3ac-21b078e6e31b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:55.043022 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8024a4-2c2a-48cf-b3ac-21b078e6e31b None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:55.043486 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8024a4-2c2a-48cf-b3ac-21b078e6e31b None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:55.044392 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8024a4-2c2a-48cf-b3ac-21b078e6e31b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:55.058838 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8024a4-2c2a-48cf-b3ac-21b078e6e31b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:59:55.067800 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application [None req-bf8024a4-2c2a-48cf-b3ac-21b078e6e31b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 00:59:55.067800 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:59:55.067800 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:59:55.067800 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:59:55.067800 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:59:55.067800 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:59:55.067800 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:59:55.067800 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:59:55.067800 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:59:55.067800 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:59:55.067800 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:59:55.067800 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:59:55.067800 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:59:55.067800 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:59:55.067800 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:59:55.067800 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:59:55.068969 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:59:55.068969 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:59:55.068969 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:59:55.068969 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:59:55.068969 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:59:55.068969 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:59:55.068969 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:59:55.068969 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:59:55.068969 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:59:55.068969 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:59:55.068969 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:59:55.068969 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application with Lock( Aug 30 00:59:55.068969 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:59:55.068969 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:59:55.068969 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:59:55.068969 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:59:55.069805 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:59:55.069805 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:59:55.069805 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:59:55.069805 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:59:55.069805 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:59:55.069805 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:59:55.069805 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:59:55.069805 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:59:55.069805 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:59:55.069805 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:59:55.069805 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 00:59:55.069805 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Aug 30 00:59:55.069805 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 308/625] 10.222.0.79 () {56 vars in 1102 bytes} [Tue Aug 30 00:59:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:59:55.070487 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8024a4-2c2a-48cf-b3ac-21b078e6e31b None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:55.127948 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b686d72-87dc-4fba-a7c0-37c6f5cda15f None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:55.174901 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea91f32-8224-4a40-ba9e-863d670755c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:55.176467 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea91f32-8224-4a40-ba9e-863d670755c2 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:55.176970 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea91f32-8224-4a40-ba9e-863d670755c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:55.177616 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea91f32-8224-4a40-ba9e-863d670755c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:55.189859 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8024a4-2c2a-48cf-b3ac-21b078e6e31b None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:55.194480 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea91f32-8224-4a40-ba9e-863d670755c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:55.196152 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea91f32-8224-4a40-ba9e-863d670755c2 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:55.217422 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-dea91f32-8224-4a40-ba9e-863d670755c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:59:55.217422 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:59:55.217422 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:59:55.217422 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:59:55.217422 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:59:55.217422 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:59:55.217422 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:59:55.217422 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:59:55.217422 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:59:55.217422 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:59:55.217422 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:59:55.217422 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:59:55.217422 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:59:55.217422 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:59:55.217422 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:59:55.217422 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:59:55.218567 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:59:55.218567 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:59:55.218567 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:59:55.218567 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:59:55.218567 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:59:55.218567 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:59:55.218567 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:59:55.218567 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Aug 30 00:59:55.218567 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:59:55.218567 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:59:55.218567 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:59:55.218567 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:59:55.218567 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:59:55.218567 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:59:55.218567 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:59:55.218567 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:59:55.218567 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:59:55.219669 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:59:55.219669 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:59:55.219669 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Aug 30 00:59:55.222096 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 318/626] 10.222.0.79 () {56 vars in 1108 bytes} [Tue Aug 30 00:59:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:59:55.223430 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea91f32-8224-4a40-ba9e-863d670755c2 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:55.234320 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ff3168-82a1-4ccc-860a-8f0d4dd030bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:55.236568 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ff3168-82a1-4ccc-860a-8f0d4dd030bd None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:55.236568 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ff3168-82a1-4ccc-860a-8f0d4dd030bd None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:55.237191 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ff3168-82a1-4ccc-860a-8f0d4dd030bd None admin] PATH_INFO: `/v3/projects` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:55.237947 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ff3168-82a1-4ccc-860a-8f0d4dd030bd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:59:55.238259 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ff3168-82a1-4ccc-860a-8f0d4dd030bd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:55.241490 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ff3168-82a1-4ccc-860a-8f0d4dd030bd None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:55.254382 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:55.263179 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 309/627] 10.222.0.79 () {56 vars in 1148 bytes} [Tue Aug 30 00:59:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:59:55.264626 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ff3168-82a1-4ccc-860a-8f0d4dd030bd None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:55.322347 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:55.358303 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea91f32-8224-4a40-ba9e-863d670755c2 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:55.395253 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79c7f12-13f4-4c86-aba2-7b0257e824b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:55.395964 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79c7f12-13f4-4c86-aba2-7b0257e824b1 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:55.396246 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79c7f12-13f4-4c86-aba2-7b0257e824b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:55.396514 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79c7f12-13f4-4c86-aba2-7b0257e824b1 None admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:55.397401 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79c7f12-13f4-4c86-aba2-7b0257e824b1 None admin] RBAC: Adding query filter params (name=service) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:59:55.397535 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79c7f12-13f4-4c86-aba2-7b0257e824b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:55.398843 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79c7f12-13f4-4c86-aba2-7b0257e824b1 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:55.403459 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ff3168-82a1-4ccc-860a-8f0d4dd030bd None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:55.412773 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 319/628] 10.222.0.79 () {56 vars in 1103 bytes} [Tue Aug 30 00:59:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:59:55.412773 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79c7f12-13f4-4c86-aba2-7b0257e824b1 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:55.442737 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d322e7-ba75-4bf4-af6a-dc77030efd90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:55.443404 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d322e7-ba75-4bf4-af6a-dc77030efd90 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:55.443753 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d322e7-ba75-4bf4-af6a-dc77030efd90 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:55.444093 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d322e7-ba75-4bf4-af6a-dc77030efd90 None admin] PATH_INFO: `/v3/domains` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:55.444804 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d322e7-ba75-4bf4-af6a-dc77030efd90 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:59:55.445112 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d322e7-ba75-4bf4-af6a-dc77030efd90 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:55.446476 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d322e7-ba75-4bf4-af6a-dc77030efd90 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:55.458979 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 310/629] 10.222.0.79 () {56 vars in 1109 bytes} [Tue Aug 30 00:59:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:59:55.460261 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cc24e2-2569-431a-ba10-322229ff4a00 None None] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:55.460544 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cc24e2-2569-431a-ba10-322229ff4a00 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:55.460818 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cc24e2-2569-431a-ba10-322229ff4a00 None None] PATH_INFO: `/` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:55.462169 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 311/630] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 00:59:55 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:59:55.466772 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cc24e2-2569-431a-ba10-322229ff4a00 None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:55.528747 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79c7f12-13f4-4c86-aba2-7b0257e824b1 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:55.531975 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:55.564766 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ee34c3-195b-44ed-85f5-3d24742ed902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:55.565424 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ee34c3-195b-44ed-85f5-3d24742ed902 None admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:55.565709 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ee34c3-195b-44ed-85f5-3d24742ed902 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:55.565971 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ee34c3-195b-44ed-85f5-3d24742ed902 None admin] PATH_INFO: `/v3/projects/0eec3a73673e45dc881de586b9b0fbbb/users/dd556fa6ba464928b1e067325792a523/roles/687d3359d6b2413b84ca5a54d30d5488` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:55.568987 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:55.580994 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cc24e2-2569-431a-ba10-322229ff4a00 None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:55.583114 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ee34c3-195b-44ed-85f5-3d24742ed902 None admin] RBAC: Authorizing `identity:create_grant(project_id=0eec3a73673e45dc881de586b9b0fbbb, user_id=dd556fa6ba464928b1e067325792a523, role_id=687d3359d6b2413b84ca5a54d30d5488)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:55.584649 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ee34c3-195b-44ed-85f5-3d24742ed902 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:55.601988 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 320/631] 10.222.0.79 () {58 vars in 1439 bytes} [Tue Aug 30 00:59:55 2022] PUT /identity/v3/projects/0eec3a73673e45dc881de586b9b0fbbb/users/dd556fa6ba464928b1e067325792a523/roles/687d3359d6b2413b84ca5a54d30d5488 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:59:55.603830 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ee34c3-195b-44ed-85f5-3d24742ed902 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:55.626672 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ca9f38-4daa-4c02-9296-a0f8f419c114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:55.627382 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ca9f38-4daa-4c02-9296-a0f8f419c114 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:55.627662 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ca9f38-4daa-4c02-9296-a0f8f419c114 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:55.627935 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ca9f38-4daa-4c02-9296-a0f8f419c114 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:55.643444 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ca9f38-4daa-4c02-9296-a0f8f419c114 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:55.645098 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ca9f38-4daa-4c02-9296-a0f8f419c114 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:55.663877 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application [None req-a3ca9f38-4daa-4c02-9296-a0f8f419c114 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:59:55.663877 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:59:55.663877 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:59:55.663877 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:59:55.663877 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:59:55.663877 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:59:55.663877 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:59:55.663877 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:59:55.663877 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:59:55.663877 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:59:55.663877 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:59:55.663877 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:59:55.663877 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:59:55.663877 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:59:55.663877 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:59:55.663877 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:59:55.664905 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:59:55.664905 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:59:55.664905 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:59:55.664905 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:59:55.664905 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:59:55.664905 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:59:55.664905 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:59:55.664905 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application with Lock( Aug 30 00:59:55.664905 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:59:55.664905 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:59:55.664905 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:59:55.664905 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:59:55.664905 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:59:55.664905 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:59:55.664905 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:59:55.664905 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:59:55.664905 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:59:55.665826 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:59:55.665826 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:59:55.665826 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Aug 30 00:59:55.665826 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 312/632] 10.222.0.79 () {56 vars in 1108 bytes} [Tue Aug 30 00:59:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:59:55.671193 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3f1c42-0572-480a-897a-20e01de322ca None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:55.671193 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3f1c42-0572-480a-897a-20e01de322ca None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:55.671193 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3f1c42-0572-480a-897a-20e01de322ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:55.694369 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-7e3f1c42-0572-480a-897a-20e01de322ca None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:59:55.695841 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-7e3f1c42-0572-480a-897a-20e01de322ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:59:55.767743 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ee34c3-195b-44ed-85f5-3d24742ed902 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:55.784579 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 313/633] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 00:59:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:59:55.785729 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3f1c42-0572-480a-897a-20e01de322ca None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:55.820244 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43801cff-fd5b-4c2a-9b2b-5395c91c648f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:55.821332 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43801cff-fd5b-4c2a-9b2b-5395c91c648f None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:55.822167 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43801cff-fd5b-4c2a-9b2b-5395c91c648f None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:55.822899 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43801cff-fd5b-4c2a-9b2b-5395c91c648f None admin] PATH_INFO: `/v3/users/glance` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:55.832971 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43801cff-fd5b-4c2a-9b2b-5395c91c648f None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:55.833646 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:55.835210 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43801cff-fd5b-4c2a-9b2b-5395c91c648f None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:55.850573 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-43801cff-fd5b-4c2a-9b2b-5395c91c648f None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 30 00:59:55.850573 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:59:55.850573 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:59:55.850573 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:59:55.850573 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:59:55.850573 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:59:55.850573 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:59:55.850573 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:59:55.850573 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:59:55.850573 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:59:55.850573 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:59:55.850573 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:59:55.850573 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 00:59:55.850573 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 00:59:55.850573 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 00:59:55.850573 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 00:59:55.851636 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:59:55.851636 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:59:55.851636 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 00:59:55.851636 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:59:55.851636 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 00:59:55.851636 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:59:55.851636 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:59:55.851636 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:59:55.851636 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:59:55.851636 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:59:55.851636 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:59:55.851636 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Aug 30 00:59:55.851636 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:59:55.851636 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:59:55.851636 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:59:55.851636 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:59:55.851636 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:59:55.851636 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:59:55.852570 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:59:55.852570 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:59:55.852570 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 00:59:55.852570 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 00:59:55.852570 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 00:59:55.852570 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 00:59:55.852570 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 00:59:55.852570 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 00:59:55.852570 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 30 00:59:55.852570 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Aug 30 00:59:55.853110 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 321/634] 10.222.0.79 () {56 vars in 1099 bytes} [Tue Aug 30 00:59:55 2022] GET /identity/v3/users/glance => generated 84 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:59:55.854013 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0feeb1-57ef-4807-90a9-02da754aa638 None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:55.854262 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0feeb1-57ef-4807-90a9-02da754aa638 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:55.854533 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0feeb1-57ef-4807-90a9-02da754aa638 None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:55.856780 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 322/635] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 00:59:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:59:55.860126 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0feeb1-57ef-4807-90a9-02da754aa638 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:55.920503 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:55.933226 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3f1c42-0572-480a-897a-20e01de322ca None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:55.997669 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77b91b9-4be8-4d6b-b4e4-9f6a46e7b571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:55.998734 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77b91b9-4be8-4d6b-b4e4-9f6a46e7b571 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:55.999231 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77b91b9-4be8-4d6b-b4e4-9f6a46e7b571 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:55.999650 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77b91b9-4be8-4d6b-b4e4-9f6a46e7b571 None admin] PATH_INFO: `/v3/domains` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:55.999765 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0feeb1-57ef-4807-90a9-02da754aa638 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:56.000887 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77b91b9-4be8-4d6b-b4e4-9f6a46e7b571 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:59:56.001362 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77b91b9-4be8-4d6b-b4e4-9f6a46e7b571 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:56.003078 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77b91b9-4be8-4d6b-b4e4-9f6a46e7b571 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:56.016233 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 314/636] 10.222.0.79 () {56 vars in 1109 bytes} [Tue Aug 30 00:59:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:59:56.017810 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196fcb09-831b-46f5-82c0-22325fbb67c2 None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:56.018258 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196fcb09-831b-46f5-82c0-22325fbb67c2 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:56.018663 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196fcb09-831b-46f5-82c0-22325fbb67c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:56.041428 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-196fcb09-831b-46f5-82c0-22325fbb67c2 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:59:56.042868 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-196fcb09-831b-46f5-82c0-22325fbb67c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:59:56.050122 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7179c35b-0f44-42e4-bf70-7d1d01da3820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:56.050869 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7179c35b-0f44-42e4-bf70-7d1d01da3820 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:56.051286 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7179c35b-0f44-42e4-bf70-7d1d01da3820 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:56.051649 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7179c35b-0f44-42e4-bf70-7d1d01da3820 None admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:56.053038 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7179c35b-0f44-42e4-bf70-7d1d01da3820 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:59:56.053486 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7179c35b-0f44-42e4-bf70-7d1d01da3820 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:56.055399 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7179c35b-0f44-42e4-bf70-7d1d01da3820 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:56.079174 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 323/637] 10.222.0.79 () {56 vars in 1137 bytes} [Tue Aug 30 00:59:55 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:59:56.079174 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7179c35b-0f44-42e4-bf70-7d1d01da3820 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:56.120652 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 315/638] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 00:59:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:59:56.126858 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196fcb09-831b-46f5-82c0-22325fbb67c2 None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:56.168541 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:56.190832 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7179c35b-0f44-42e4-bf70-7d1d01da3820 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:56.192755 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:56.233009 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10f3b93-8405-407b-a55b-9b01884b7d04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:56.238396 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10f3b93-8405-407b-a55b-9b01884b7d04 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:56.238777 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10f3b93-8405-407b-a55b-9b01884b7d04 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:56.239216 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10f3b93-8405-407b-a55b-9b01884b7d04 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:56.248595 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10f3b93-8405-407b-a55b-9b01884b7d04 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:56.250567 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10f3b93-8405-407b-a55b-9b01884b7d04 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:56.254019 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196fcb09-831b-46f5-82c0-22325fbb67c2 None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:56.265815 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-a10f3b93-8405-407b-a55b-9b01884b7d04 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 30 00:59:56.265815 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:59:56.265815 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:59:56.265815 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:59:56.265815 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:59:56.265815 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:59:56.265815 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:59:56.265815 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:59:56.265815 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:59:56.265815 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:59:56.265815 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:59:56.265815 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:59:56.265815 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 00:59:56.265815 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 00:59:56.265815 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 00:59:56.265815 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 00:59:56.266803 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:59:56.266803 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:59:56.266803 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 00:59:56.266803 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:59:56.266803 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 00:59:56.266803 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:59:56.266803 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:59:56.266803 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:59:56.266803 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:59:56.266803 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:59:56.266803 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:59:56.266803 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Aug 30 00:59:56.266803 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:59:56.266803 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:59:56.266803 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:59:56.266803 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:59:56.266803 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:59:56.266803 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:59:56.267854 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:59:56.267854 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:59:56.267854 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 00:59:56.267854 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 00:59:56.267854 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 00:59:56.267854 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 00:59:56.267854 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 00:59:56.267854 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 00:59:56.267854 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 30 00:59:56.267854 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Aug 30 00:59:56.271310 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 324/639] 10.222.0.79 () {56 vars in 1099 bytes} [Tue Aug 30 00:59:56 2022] GET /identity/v3/users/cinder => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:59:56.272447 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10f3b93-8405-407b-a55b-9b01884b7d04 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:56.304844 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27998760-20fc-48e4-a2a9-8a508bfd503b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:56.305482 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27998760-20fc-48e4-a2a9-8a508bfd503b None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:56.305813 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27998760-20fc-48e4-a2a9-8a508bfd503b None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:56.306083 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27998760-20fc-48e4-a2a9-8a508bfd503b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:56.317260 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27998760-20fc-48e4-a2a9-8a508bfd503b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:59:56.322490 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application [None req-27998760-20fc-48e4-a2a9-8a508bfd503b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 00:59:56.322490 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:59:56.322490 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:59:56.322490 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:59:56.322490 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:59:56.322490 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:59:56.322490 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:59:56.322490 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:59:56.322490 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:59:56.322490 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:59:56.322490 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:59:56.322490 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:59:56.322490 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:59:56.322490 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:59:56.322490 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:59:56.322490 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:59:56.323660 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:59:56.323660 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:59:56.323660 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:59:56.323660 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:59:56.323660 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:59:56.323660 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:59:56.323660 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:59:56.323660 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:59:56.323660 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:59:56.323660 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:59:56.323660 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:59:56.323660 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application with Lock( Aug 30 00:59:56.323660 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:59:56.323660 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:59:56.323660 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:59:56.323660 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:59:56.324495 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:59:56.324495 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:59:56.324495 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:59:56.324495 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:59:56.324495 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:59:56.324495 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:59:56.324495 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:59:56.324495 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:59:56.324495 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:59:56.324495 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:59:56.324495 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 00:59:56.324495 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Aug 30 00:59:56.324495 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 316/640] 10.222.0.79 () {56 vars in 1102 bytes} [Tue Aug 30 00:59:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:59:56.326293 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27998760-20fc-48e4-a2a9-8a508bfd503b None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:56.415855 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10f3b93-8405-407b-a55b-9b01884b7d04 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:56.437713 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:56.449255 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27998760-20fc-48e4-a2a9-8a508bfd503b None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:56.453180 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe93b8c-341e-4036-98d1-9ca6b9bff160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:56.453801 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe93b8c-341e-4036-98d1-9ca6b9bff160 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:56.454079 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe93b8c-341e-4036-98d1-9ca6b9bff160 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:56.454353 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe93b8c-341e-4036-98d1-9ca6b9bff160 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:56.488150 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2238e21-6820-4373-9ca0-74aa61ce009d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:56.488762 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2238e21-6820-4373-9ca0-74aa61ce009d None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:56.488894 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:56.489034 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2238e21-6820-4373-9ca0-74aa61ce009d None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:56.489295 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2238e21-6820-4373-9ca0-74aa61ce009d None admin] PATH_INFO: `/v3/users` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:56.490031 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2238e21-6820-4373-9ca0-74aa61ce009d None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:59:56.490327 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2238e21-6820-4373-9ca0-74aa61ce009d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:56.491818 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2238e21-6820-4373-9ca0-74aa61ce009d None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:56.525964 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 317/641] 10.222.0.79 () {56 vars in 1137 bytes} [Tue Aug 30 00:59:56 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:59:56.525964 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2238e21-6820-4373-9ca0-74aa61ce009d None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:56.548703 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe93b8c-341e-4036-98d1-9ca6b9bff160 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:56.550176 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe93b8c-341e-4036-98d1-9ca6b9bff160 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:56.650424 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2238e21-6820-4373-9ca0-74aa61ce009d None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:56.679186 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 325/642] 10.222.0.79 () {58 vars in 1282 bytes} [Tue Aug 30 00:59:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 00:59:56.679186 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe93b8c-341e-4036-98d1-9ca6b9bff160 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:56.697933 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40964e1-4d83-4abb-a867-10a993a75942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:56.698543 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40964e1-4d83-4abb-a867-10a993a75942 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:56.698820 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40964e1-4d83-4abb-a867-10a993a75942 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:56.699088 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40964e1-4d83-4abb-a867-10a993a75942 None admin] PATH_INFO: `/v3/roles` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:56.699787 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40964e1-4d83-4abb-a867-10a993a75942 None admin] RBAC: Adding query filter params (name=service) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:59:56.700654 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40964e1-4d83-4abb-a867-10a993a75942 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:56.702032 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40964e1-4d83-4abb-a867-10a993a75942 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:56.714797 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 318/643] 10.222.0.79 () {56 vars in 1103 bytes} [Tue Aug 30 00:59:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:59:56.714797 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40964e1-4d83-4abb-a867-10a993a75942 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:56.726097 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:56.756570 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:56.809778 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe93b8c-341e-4036-98d1-9ca6b9bff160 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:56.830951 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40964e1-4d83-4abb-a867-10a993a75942 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:56.847803 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbaab8d-39d9-491c-85c7-0ae713b658f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:56.848438 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbaab8d-39d9-491c-85c7-0ae713b658f9 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:56.848716 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbaab8d-39d9-491c-85c7-0ae713b658f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:56.849013 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbaab8d-39d9-491c-85c7-0ae713b658f9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:56.859527 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbaab8d-39d9-491c-85c7-0ae713b658f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:59:56.864375 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-9dbaab8d-39d9-491c-85c7-0ae713b658f9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 00:59:56.864375 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:59:56.864375 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:59:56.864375 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:59:56.864375 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:59:56.864375 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:59:56.864375 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:59:56.864375 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:59:56.864375 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:59:56.864375 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:59:56.864375 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:59:56.864375 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:59:56.864375 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:59:56.864375 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:59:56.864375 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:59:56.864375 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:59:56.865419 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:59:56.865419 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:59:56.865419 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:59:56.865419 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:59:56.865419 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:59:56.865419 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:59:56.865419 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:59:56.865419 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:59:56.865419 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:59:56.865419 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:59:56.865419 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:59:56.865419 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Aug 30 00:59:56.865419 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:59:56.865419 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:59:56.865419 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:59:56.865419 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:59:56.868276 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:59:56.868276 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:59:56.868276 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:59:56.868276 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:59:56.868276 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:59:56.868276 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:59:56.868276 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:59:56.868276 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:59:56.868276 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:59:56.868276 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:59:56.868276 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 00:59:56.868276 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Aug 30 00:59:56.868969 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1ccf3c-2fda-454c-b3a0-9281c539d99b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:56.868969 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1ccf3c-2fda-454c-b3a0-9281c539d99b None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:56.868969 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1ccf3c-2fda-454c-b3a0-9281c539d99b None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:56.868969 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1ccf3c-2fda-454c-b3a0-9281c539d99b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:56.869281 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 326/644] 10.222.0.79 () {56 vars in 1102 bytes} [Tue Aug 30 00:59:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:59:56.869281 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbaab8d-39d9-491c-85c7-0ae713b658f9 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:56.942672 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1ccf3c-2fda-454c-b3a0-9281c539d99b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:56.944950 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1ccf3c-2fda-454c-b3a0-9281c539d99b None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:56.961087 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:56.979614 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbaab8d-39d9-491c-85c7-0ae713b658f9 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:57.009162 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:57.022889 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dab8ad-c71d-4573-819f-ad495ec74c43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:57.024185 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dab8ad-c71d-4573-819f-ad495ec74c43 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:57.024185 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dab8ad-c71d-4573-819f-ad495ec74c43 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:57.024185 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dab8ad-c71d-4573-819f-ad495ec74c43 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:57.034915 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dab8ad-c71d-4573-819f-ad495ec74c43 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:57.036536 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dab8ad-c71d-4573-819f-ad495ec74c43 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:57.052909 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-12dab8ad-c71d-4573-819f-ad495ec74c43 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:59:57.052909 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:59:57.052909 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:59:57.052909 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:59:57.052909 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:59:57.052909 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:59:57.052909 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:59:57.052909 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:59:57.052909 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:59:57.052909 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:59:57.052909 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:59:57.052909 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:59:57.052909 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:59:57.052909 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:59:57.052909 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:59:57.052909 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:59:57.053942 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:59:57.053942 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:59:57.053942 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:59:57.053942 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:59:57.053942 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:59:57.053942 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:59:57.053942 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:59:57.053942 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Aug 30 00:59:57.053942 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:59:57.053942 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:59:57.053942 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:59:57.053942 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:59:57.053942 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:59:57.053942 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:59:57.053942 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:59:57.053942 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:59:57.053942 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:59:57.055009 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:59:57.055009 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:59:57.055009 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Aug 30 00:59:57.055009 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 327/645] 10.222.0.79 () {56 vars in 1108 bytes} [Tue Aug 30 00:59:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:59:57.055009 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dab8ad-c71d-4573-819f-ad495ec74c43 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:57.067990 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 319/646] 10.222.0.79 () {58 vars in 1282 bytes} [Tue Aug 30 00:59:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 00:59:57.067990 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1ccf3c-2fda-454c-b3a0-9281c539d99b None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:57.170952 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1ccf3c-2fda-454c-b3a0-9281c539d99b None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:57.176071 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dab8ad-c71d-4573-819f-ad495ec74c43 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:57.182687 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:57.209956 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdb43fa-9134-427f-84a2-d64ab09e16d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:57.210860 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdb43fa-9134-427f-84a2-d64ab09e16d9 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:57.211148 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdb43fa-9134-427f-84a2-d64ab09e16d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:57.211430 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdb43fa-9134-427f-84a2-d64ab09e16d9 None admin] PATH_INFO: `/v3/roles` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:57.212097 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdb43fa-9134-427f-84a2-d64ab09e16d9 None admin] RBAC: Adding query filter params (name=service) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:59:57.212393 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdb43fa-9134-427f-84a2-d64ab09e16d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:57.213749 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdb43fa-9134-427f-84a2-d64ab09e16d9 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:57.214478 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97223f8a-5b1d-47c9-a40b-cecf7a1c3f78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:57.215401 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97223f8a-5b1d-47c9-a40b-cecf7a1c3f78 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:57.215805 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97223f8a-5b1d-47c9-a40b-cecf7a1c3f78 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:57.216540 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97223f8a-5b1d-47c9-a40b-cecf7a1c3f78 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:57.226615 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 320/647] 10.222.0.79 () {56 vars in 1103 bytes} [Tue Aug 30 00:59:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:59:57.226615 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdb43fa-9134-427f-84a2-d64ab09e16d9 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:57.238082 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97223f8a-5b1d-47c9-a40b-cecf7a1c3f78 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:57.240764 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97223f8a-5b1d-47c9-a40b-cecf7a1c3f78 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:57.262720 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-97223f8a-5b1d-47c9-a40b-cecf7a1c3f78 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:59:57.262720 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:59:57.262720 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:59:57.262720 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:59:57.262720 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:59:57.262720 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:59:57.262720 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:59:57.262720 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:59:57.262720 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:59:57.262720 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:59:57.262720 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:59:57.262720 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:59:57.262720 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:59:57.262720 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:59:57.262720 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:59:57.262720 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:59:57.263990 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:59:57.263990 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:59:57.263990 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:59:57.263990 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:59:57.263990 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:59:57.263990 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:59:57.263990 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:59:57.263990 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Aug 30 00:59:57.263990 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:59:57.263990 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:59:57.263990 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:59:57.263990 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:59:57.263990 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:59:57.263990 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:59:57.263990 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:59:57.263990 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:59:57.263990 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:59:57.265087 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:59:57.265087 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:59:57.265087 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Aug 30 00:59:57.270554 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 328/648] 10.222.0.79 () {56 vars in 1108 bytes} [Tue Aug 30 00:59:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:59:57.270554 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97223f8a-5b1d-47c9-a40b-cecf7a1c3f78 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:57.308920 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:57.339144 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdb43fa-9134-427f-84a2-d64ab09e16d9 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:57.375961 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc54f42-8eb0-4407-9f1a-f1d35de90bfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:57.376578 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc54f42-8eb0-4407-9f1a-f1d35de90bfc None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:57.376877 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc54f42-8eb0-4407-9f1a-f1d35de90bfc None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:57.377148 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc54f42-8eb0-4407-9f1a-f1d35de90bfc None admin] PATH_INFO: `/v3/domains` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:57.377800 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc54f42-8eb0-4407-9f1a-f1d35de90bfc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:59:57.378096 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc54f42-8eb0-4407-9f1a-f1d35de90bfc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:57.379501 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc54f42-8eb0-4407-9f1a-f1d35de90bfc None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:57.392369 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 321/649] 10.222.0.79 () {56 vars in 1109 bytes} [Tue Aug 30 00:59:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:59:57.393056 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc54f42-8eb0-4407-9f1a-f1d35de90bfc None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:57.400868 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97223f8a-5b1d-47c9-a40b-cecf7a1c3f78 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:57.429003 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:57.447989 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b3a71a-ef87-4821-9139-efa4cff74af2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:57.448811 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b3a71a-ef87-4821-9139-efa4cff74af2 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:57.449247 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b3a71a-ef87-4821-9139-efa4cff74af2 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:57.449673 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b3a71a-ef87-4821-9139-efa4cff74af2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:57.463227 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b3a71a-ef87-4821-9139-efa4cff74af2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:57.464690 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b3a71a-ef87-4821-9139-efa4cff74af2 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:57.480875 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-03b3a71a-ef87-4821-9139-efa4cff74af2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:59:57.480875 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:59:57.480875 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:59:57.480875 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:59:57.480875 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:59:57.480875 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:59:57.480875 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:59:57.480875 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:59:57.480875 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:59:57.480875 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:59:57.480875 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:59:57.480875 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:59:57.480875 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:59:57.480875 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:59:57.480875 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:59:57.480875 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:59:57.487074 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:59:57.487074 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:59:57.487074 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:59:57.487074 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:59:57.487074 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:59:57.487074 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:59:57.487074 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:59:57.487074 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Aug 30 00:59:57.487074 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:59:57.487074 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:59:57.487074 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:59:57.487074 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:59:57.487074 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:59:57.487074 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:59:57.487074 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:59:57.487074 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:59:57.487074 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:59:57.488311 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:59:57.488311 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:59:57.488311 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Aug 30 00:59:57.488311 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 329/650] 10.222.0.79 () {56 vars in 1108 bytes} [Tue Aug 30 00:59:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:59:57.488311 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b3a71a-ef87-4821-9139-efa4cff74af2 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:57.514746 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc54f42-8eb0-4407-9f1a-f1d35de90bfc None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:57.552523 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b292918a-d139-492c-a8b3-e684f07bfa08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:57.553256 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b292918a-d139-492c-a8b3-e684f07bfa08 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:57.553604 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b292918a-d139-492c-a8b3-e684f07bfa08 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:57.553944 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b292918a-d139-492c-a8b3-e684f07bfa08 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:57.565751 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b292918a-d139-492c-a8b3-e684f07bfa08 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:57.567584 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b292918a-d139-492c-a8b3-e684f07bfa08 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:57.576015 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:57.583887 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application [None req-b292918a-d139-492c-a8b3-e684f07bfa08 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:59:57.583887 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:59:57.583887 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:59:57.583887 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:59:57.583887 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:59:57.583887 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:59:57.583887 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:59:57.583887 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:59:57.583887 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:59:57.583887 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:59:57.583887 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:59:57.583887 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:59:57.583887 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:59:57.583887 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:59:57.583887 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:59:57.583887 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:59:57.584911 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:59:57.584911 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:59:57.584911 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:59:57.584911 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:59:57.584911 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:59:57.584911 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:59:57.584911 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:59:57.584911 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application with Lock( Aug 30 00:59:57.584911 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:59:57.584911 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:59:57.584911 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:59:57.584911 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:59:57.584911 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:59:57.584911 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:59:57.584911 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:59:57.584911 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:59:57.584911 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:59:57.585819 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:59:57.585819 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:59:57.585819 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Aug 30 00:59:57.585819 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 322/651] 10.222.0.79 () {56 vars in 1108 bytes} [Tue Aug 30 00:59:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:59:57.585819 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b292918a-d139-492c-a8b3-e684f07bfa08 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:57.604286 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b3a71a-ef87-4821-9139-efa4cff74af2 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:57.642253 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a96715-10e7-4fe5-ae09-67291842260c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:57.643299 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a96715-10e7-4fe5-ae09-67291842260c None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:57.643761 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a96715-10e7-4fe5-ae09-67291842260c None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:57.644226 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a96715-10e7-4fe5-ae09-67291842260c None admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:57.645059 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a96715-10e7-4fe5-ae09-67291842260c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:59:57.645617 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a96715-10e7-4fe5-ae09-67291842260c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:57.647436 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a96715-10e7-4fe5-ae09-67291842260c None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:57.660967 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 330/652] 10.222.0.79 () {56 vars in 1109 bytes} [Tue Aug 30 00:59:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:59:57.661994 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a96715-10e7-4fe5-ae09-67291842260c None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:57.683958 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:57.701792 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b292918a-d139-492c-a8b3-e684f07bfa08 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:57.738157 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe6629a-131b-4564-9d65-d31b5131e9db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:57.739241 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe6629a-131b-4564-9d65-d31b5131e9db None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:57.739777 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe6629a-131b-4564-9d65-d31b5131e9db None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:57.740305 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe6629a-131b-4564-9d65-d31b5131e9db None admin] PATH_INFO: `/v3/projects/service` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:57.750399 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe6629a-131b-4564-9d65-d31b5131e9db None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:57.751939 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe6629a-131b-4564-9d65-d31b5131e9db None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:57.764044 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application [None req-dfe6629a-131b-4564-9d65-d31b5131e9db None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:59:57.764044 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:59:57.764044 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:59:57.764044 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:59:57.764044 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:59:57.764044 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:59:57.764044 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:59:57.764044 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:59:57.764044 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:59:57.764044 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:59:57.764044 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:59:57.764044 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:59:57.764044 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 00:59:57.764044 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 00:59:57.764044 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 00:59:57.765143 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 00:59:57.765143 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:59:57.765143 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:59:57.765143 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:59:57.765143 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:59:57.765143 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:59:57.765143 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:59:57.765143 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:59:57.765143 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application with Lock( Aug 30 00:59:57.765143 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:59:57.765143 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:59:57.765143 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:59:57.765143 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:59:57.765143 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:59:57.765143 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:59:57.765143 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:59:57.765143 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:59:57.766046 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 00:59:57.766046 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 00:59:57.766046 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 00:59:57.766046 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 00:59:57.766046 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 00:59:57.766046 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 00:59:57.766046 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:59:57.766046 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Aug 30 00:59:57.766046 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 323/653] 10.222.0.79 () {56 vars in 1111 bytes} [Tue Aug 30 00:59:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:59:57.766046 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe6629a-131b-4564-9d65-d31b5131e9db None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:57.780722 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a96715-10e7-4fe5-ae09-67291842260c None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:57.818777 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5739746d-8d14-46a6-9f1f-60cafb0a0968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:57.819407 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5739746d-8d14-46a6-9f1f-60cafb0a0968 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:57.819686 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5739746d-8d14-46a6-9f1f-60cafb0a0968 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:57.819956 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5739746d-8d14-46a6-9f1f-60cafb0a0968 None admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:57.820595 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5739746d-8d14-46a6-9f1f-60cafb0a0968 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:59:57.821015 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5739746d-8d14-46a6-9f1f-60cafb0a0968 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:57.822501 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5739746d-8d14-46a6-9f1f-60cafb0a0968 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:57.830063 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:57.841631 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 331/654] 10.222.0.79 () {56 vars in 1109 bytes} [Tue Aug 30 00:59:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:59:57.841631 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5739746d-8d14-46a6-9f1f-60cafb0a0968 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:57.879413 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe6629a-131b-4564-9d65-d31b5131e9db None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:57.913574 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143493c6-3bce-47e7-8e31-1acb8b0a1106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:57.914178 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143493c6-3bce-47e7-8e31-1acb8b0a1106 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:57.914448 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143493c6-3bce-47e7-8e31-1acb8b0a1106 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:57.914724 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143493c6-3bce-47e7-8e31-1acb8b0a1106 None admin] PATH_INFO: `/v3/domains` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:57.915405 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143493c6-3bce-47e7-8e31-1acb8b0a1106 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:59:57.915706 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143493c6-3bce-47e7-8e31-1acb8b0a1106 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:57.917067 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143493c6-3bce-47e7-8e31-1acb8b0a1106 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:57.928890 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 324/655] 10.222.0.79 () {56 vars in 1109 bytes} [Tue Aug 30 00:59:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:59:57.929704 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143493c6-3bce-47e7-8e31-1acb8b0a1106 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:57.934462 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:57.953876 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5739746d-8d14-46a6-9f1f-60cafb0a0968 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:57.990413 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fba5379-d4b3-43db-b7af-b0f27a19db4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:57.991044 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fba5379-d4b3-43db-b7af-b0f27a19db4b None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:57.991350 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fba5379-d4b3-43db-b7af-b0f27a19db4b None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:57.991616 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fba5379-d4b3-43db-b7af-b0f27a19db4b None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:57.999988 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fba5379-d4b3-43db-b7af-b0f27a19db4b None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:58.001421 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fba5379-d4b3-43db-b7af-b0f27a19db4b None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:58.014284 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-0fba5379-d4b3-43db-b7af-b0f27a19db4b None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 30 00:59:58.014284 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:59:58.014284 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:59:58.014284 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:59:58.014284 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:59:58.014284 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:59:58.014284 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:59:58.014284 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:59:58.014284 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:59:58.014284 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:59:58.014284 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:59:58.014284 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:59:58.014284 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 00:59:58.014284 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 00:59:58.014284 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 00:59:58.014284 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 00:59:58.015754 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:59:58.015754 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:59:58.015754 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 00:59:58.015754 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:59:58.015754 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 00:59:58.015754 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:59:58.015754 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:59:58.015754 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:59:58.015754 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:59:58.015754 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:59:58.015754 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:59:58.015754 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Aug 30 00:59:58.015754 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:59:58.015754 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:59:58.015754 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:59:58.015754 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:59:58.015754 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:59:58.015754 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:59:58.016708 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:59:58.016708 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:59:58.016708 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 00:59:58.016708 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 00:59:58.016708 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 00:59:58.016708 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 00:59:58.016708 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 00:59:58.016708 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 00:59:58.016708 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 30 00:59:58.016708 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Aug 30 00:59:58.020109 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 332/656] 10.222.0.79 () {56 vars in 1102 bytes} [Tue Aug 30 00:59:57 2022] GET /identity/v3/users/neutron => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:59:58.020972 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fba5379-d4b3-43db-b7af-b0f27a19db4b None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:58.040058 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143493c6-3bce-47e7-8e31-1acb8b0a1106 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:58.077493 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbf236a-848d-45b6-bb51-21f1183bad4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:58.078091 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbf236a-848d-45b6-bb51-21f1183bad4b None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:58.078365 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbf236a-848d-45b6-bb51-21f1183bad4b None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:58.078629 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbf236a-848d-45b6-bb51-21f1183bad4b None admin] PATH_INFO: `/v3/projects` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:58.079344 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbf236a-848d-45b6-bb51-21f1183bad4b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:59:58.079640 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbf236a-848d-45b6-bb51-21f1183bad4b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:58.081049 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbf236a-848d-45b6-bb51-21f1183bad4b None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:58.088868 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:58.093448 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 325/657] 10.222.0.79 () {56 vars in 1148 bytes} [Tue Aug 30 00:59:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:59:58.094326 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbf236a-848d-45b6-bb51-21f1183bad4b None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:58.143198 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fba5379-d4b3-43db-b7af-b0f27a19db4b None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:58.158055 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:58.177089 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd19f888-5cfb-4c66-8636-be6d7bdd67f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:58.177959 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd19f888-5cfb-4c66-8636-be6d7bdd67f0 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:58.178264 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd19f888-5cfb-4c66-8636-be6d7bdd67f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:58.178561 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd19f888-5cfb-4c66-8636-be6d7bdd67f0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:58.186115 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd19f888-5cfb-4c66-8636-be6d7bdd67f0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:58.187598 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd19f888-5cfb-4c66-8636-be6d7bdd67f0 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:58.196808 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbf236a-848d-45b6-bb51-21f1183bad4b None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:58.199196 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-dd19f888-5cfb-4c66-8636-be6d7bdd67f0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:59:58.199196 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:59:58.199196 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:59:58.199196 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:59:58.199196 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:59:58.199196 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:59:58.199196 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:59:58.199196 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:59:58.199196 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:59:58.199196 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:59:58.199196 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:59:58.199196 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:59:58.199196 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 00:59:58.199196 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 00:59:58.199196 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 00:59:58.200929 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 00:59:58.200929 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:59:58.200929 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:59:58.200929 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:59:58.200929 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:59:58.200929 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:59:58.200929 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:59:58.200929 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:59:58.200929 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Aug 30 00:59:58.200929 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:59:58.200929 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:59:58.200929 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:59:58.200929 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:59:58.200929 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:59:58.200929 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:59:58.200929 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:59:58.200929 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:59:58.202130 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 00:59:58.202130 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 00:59:58.202130 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 00:59:58.202130 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 00:59:58.202130 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 00:59:58.202130 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 00:59:58.202130 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:59:58.202130 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Aug 30 00:59:58.202130 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 333/658] 10.222.0.79 () {56 vars in 1111 bytes} [Tue Aug 30 00:59:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:59:58.202130 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd19f888-5cfb-4c66-8636-be6d7bdd67f0 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:58.235731 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc712096-8b11-45bd-8bc1-468cc90f1789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:58.235731 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc712096-8b11-45bd-8bc1-468cc90f1789 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:58.235731 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc712096-8b11-45bd-8bc1-468cc90f1789 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:58.235731 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc712096-8b11-45bd-8bc1-468cc90f1789 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:58.242255 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc712096-8b11-45bd-8bc1-468cc90f1789 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:58.243758 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc712096-8b11-45bd-8bc1-468cc90f1789 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:58.255714 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application [None req-cc712096-8b11-45bd-8bc1-468cc90f1789 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 30 00:59:58.255714 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:59:58.255714 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:59:58.255714 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:59:58.255714 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:59:58.255714 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:59:58.255714 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:59:58.255714 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:59:58.255714 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:59:58.255714 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:59:58.255714 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:59:58.255714 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:59:58.255714 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 00:59:58.255714 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 00:59:58.255714 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 00:59:58.255714 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 00:59:58.256802 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:59:58.256802 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:59:58.256802 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 00:59:58.256802 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:59:58.256802 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 00:59:58.256802 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:59:58.256802 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:59:58.256802 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:59:58.256802 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:59:58.256802 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:59:58.256802 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:59:58.256802 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application with Lock( Aug 30 00:59:58.256802 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:59:58.256802 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:59:58.256802 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:59:58.256802 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:59:58.256802 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:59:58.256802 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:59:58.257868 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:59:58.257868 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:59:58.257868 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 00:59:58.257868 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 00:59:58.257868 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 00:59:58.257868 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 00:59:58.257868 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 00:59:58.257868 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 00:59:58.257868 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 30 00:59:58.257868 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Aug 30 00:59:58.257868 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 326/659] 10.222.0.79 () {56 vars in 1093 bytes} [Tue Aug 30 00:59:58 2022] GET /identity/v3/users/nova => generated 82 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:59:58.257868 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc712096-8b11-45bd-8bc1-468cc90f1789 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:58.315432 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd19f888-5cfb-4c66-8636-be6d7bdd67f0 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:58.335248 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:58.353208 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff1eaba-8adf-442a-89ad-b9bf242dedb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:58.353811 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff1eaba-8adf-442a-89ad-b9bf242dedb0 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:58.354096 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff1eaba-8adf-442a-89ad-b9bf242dedb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:58.354370 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff1eaba-8adf-442a-89ad-b9bf242dedb0 None admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:58.355097 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff1eaba-8adf-442a-89ad-b9bf242dedb0 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:59:58.355435 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff1eaba-8adf-442a-89ad-b9bf242dedb0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:58.357056 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff1eaba-8adf-442a-89ad-b9bf242dedb0 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:58.361076 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc712096-8b11-45bd-8bc1-468cc90f1789 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:58.374829 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 334/660] 10.222.0.79 () {56 vars in 1139 bytes} [Tue Aug 30 00:59:58 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:59:58.376115 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c7104e-151b-4a14-9d7a-992048242c4e None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:58.376424 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c7104e-151b-4a14-9d7a-992048242c4e None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:58.376703 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c7104e-151b-4a14-9d7a-992048242c4e None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:58.378078 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 335/661] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 00:59:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:59:58.378622 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c7104e-151b-4a14-9d7a-992048242c4e None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:58.390281 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:58.403834 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7640e86-5beb-47fd-9f24-2aa911008ab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:58.404372 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7640e86-5beb-47fd-9f24-2aa911008ab9 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:58.404650 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7640e86-5beb-47fd-9f24-2aa911008ab9 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:58.404921 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7640e86-5beb-47fd-9f24-2aa911008ab9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:58.405650 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7640e86-5beb-47fd-9f24-2aa911008ab9 None admin] RBAC: Adding query filter params (role.id=687d3359d6b2413b84ca5a54d30d5488, scope.project.id=0eec3a73673e45dc881de586b9b0fbbb, user.id=5e37a5c33c064c488fd4667170f7703a) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:59:58.405956 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7640e86-5beb-47fd-9f24-2aa911008ab9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:58.407449 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7640e86-5beb-47fd-9f24-2aa911008ab9 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:58.413595 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 327/662] 10.222.0.79 () {56 vars in 1374 bytes} [Tue Aug 30 00:59:58 2022] GET /identity/v3/role_assignments?user.id=5e37a5c33c064c488fd4667170f7703a&scope.project.id=0eec3a73673e45dc881de586b9b0fbbb&role.id=687d3359d6b2413b84ca5a54d30d5488 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:59:58.414380 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7640e86-5beb-47fd-9f24-2aa911008ab9 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:58.502491 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c7104e-151b-4a14-9d7a-992048242c4e None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:58.540085 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb3eb8b-d7e0-44cf-af3f-900c621ca788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:58.540701 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb3eb8b-d7e0-44cf-af3f-900c621ca788 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:58.540940 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7640e86-5beb-47fd-9f24-2aa911008ab9 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:58.541447 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb3eb8b-d7e0-44cf-af3f-900c621ca788 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:58.541447 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb3eb8b-d7e0-44cf-af3f-900c621ca788 None admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:58.541958 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb3eb8b-d7e0-44cf-af3f-900c621ca788 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:59:58.542254 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb3eb8b-d7e0-44cf-af3f-900c621ca788 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:58.544311 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb3eb8b-d7e0-44cf-af3f-900c621ca788 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:58.557859 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 336/663] 10.222.0.79 () {56 vars in 1148 bytes} [Tue Aug 30 00:59:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:59:58.558715 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb3eb8b-d7e0-44cf-af3f-900c621ca788 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:58.597121 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c88120-bbc0-4c6f-82bc-79b604d97825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:58.598127 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c88120-bbc0-4c6f-82bc-79b604d97825 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:58.598590 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c88120-bbc0-4c6f-82bc-79b604d97825 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:58.599039 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c88120-bbc0-4c6f-82bc-79b604d97825 None admin] PATH_INFO: `/v3/users` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:58.600426 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c88120-bbc0-4c6f-82bc-79b604d97825 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:59:58.600674 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:58.600937 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c88120-bbc0-4c6f-82bc-79b604d97825 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:58.604352 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c88120-bbc0-4c6f-82bc-79b604d97825 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:58.626793 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 328/664] 10.222.0.79 () {56 vars in 1133 bytes} [Tue Aug 30 00:59:58 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:59:58.628390 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b82b167-7675-464b-bb8d-acb004f4fe17 None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:58.628678 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b82b167-7675-464b-bb8d-acb004f4fe17 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:58.628952 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b82b167-7675-464b-bb8d-acb004f4fe17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:58.649102 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-3b82b167-7675-464b-bb8d-acb004f4fe17 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:59:58.651082 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-3b82b167-7675-464b-bb8d-acb004f4fe17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:59:58.689598 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb3eb8b-d7e0-44cf-af3f-900c621ca788 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:58.700248 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:58.729224 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 329/665] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 00:59:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:59:58.730081 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b82b167-7675-464b-bb8d-acb004f4fe17 None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:58.740482 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffd0389-51d2-49b1-a41d-5d80487d9bf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:58.741472 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffd0389-51d2-49b1-a41d-5d80487d9bf1 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:58.741759 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffd0389-51d2-49b1-a41d-5d80487d9bf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:58.742153 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffd0389-51d2-49b1-a41d-5d80487d9bf1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:58.829833 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffd0389-51d2-49b1-a41d-5d80487d9bf1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:58.831507 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffd0389-51d2-49b1-a41d-5d80487d9bf1 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:58.878374 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:58.894501 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b82b167-7675-464b-bb8d-acb004f4fe17 None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:58.941079 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96578c1-880a-42e1-8d9b-2c80579d7e66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:58.941844 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96578c1-880a-42e1-8d9b-2c80579d7e66 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:58.942533 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96578c1-880a-42e1-8d9b-2c80579d7e66 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:58.942904 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96578c1-880a-42e1-8d9b-2c80579d7e66 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:58.943773 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96578c1-880a-42e1-8d9b-2c80579d7e66 None admin] RBAC: Adding query filter params (role.id=687d3359d6b2413b84ca5a54d30d5488, scope.project.id=0eec3a73673e45dc881de586b9b0fbbb, user.id=7f827c7670b74d938ffe066ced88d1c2) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:59:58.944369 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96578c1-880a-42e1-8d9b-2c80579d7e66 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:58.946075 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96578c1-880a-42e1-8d9b-2c80579d7e66 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:58.959540 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 330/666] 10.222.0.79 () {56 vars in 1374 bytes} [Tue Aug 30 00:59:58 2022] GET /identity/v3/role_assignments?user.id=7f827c7670b74d938ffe066ced88d1c2&scope.project.id=0eec3a73673e45dc881de586b9b0fbbb&role.id=687d3359d6b2413b84ca5a54d30d5488 => generated 608 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:59:58.960653 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96578c1-880a-42e1-8d9b-2c80579d7e66 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:58.964744 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 337/667] 10.222.0.79 () {58 vars in 1282 bytes} [Tue Aug 30 00:59:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 00:59:58.972290 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffd0389-51d2-49b1-a41d-5d80487d9bf1 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:59.051520 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:59.130036 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96578c1-880a-42e1-8d9b-2c80579d7e66 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:59.136400 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffd0389-51d2-49b1-a41d-5d80487d9bf1 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:59.172725 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba517a2-2b31-4438-945e-6b0546445195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:59.173441 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba517a2-2b31-4438-945e-6b0546445195 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:59.174603 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba517a2-2b31-4438-945e-6b0546445195 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:59.174942 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba517a2-2b31-4438-945e-6b0546445195 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:59.179849 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfabf551-0375-4b94-a390-73e4b6132a94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:59.180490 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfabf551-0375-4b94-a390-73e4b6132a94 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:59.180767 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfabf551-0375-4b94-a390-73e4b6132a94 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:59.181036 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfabf551-0375-4b94-a390-73e4b6132a94 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:59.184785 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:59.195064 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfabf551-0375-4b94-a390-73e4b6132a94 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:59.196219 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfabf551-0375-4b94-a390-73e4b6132a94 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:59.213580 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-dfabf551-0375-4b94-a390-73e4b6132a94 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:59:59.213580 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:59:59.213580 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:59:59.213580 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:59:59.213580 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:59:59.213580 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:59:59.213580 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:59:59.213580 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:59:59.213580 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:59:59.213580 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:59:59.213580 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:59:59.213580 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:59:59.213580 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:59:59.213580 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:59:59.213580 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:59:59.213580 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:59:59.214817 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:59:59.214817 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:59:59.214817 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:59:59.214817 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:59:59.214817 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:59:59.214817 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:59:59.214817 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:59:59.214817 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Aug 30 00:59:59.214817 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:59:59.214817 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:59:59.214817 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:59:59.214817 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:59:59.214817 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:59:59.214817 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:59:59.214817 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:59:59.214817 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:59:59.214817 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:59:59.216593 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:59:59.216593 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:59:59.216593 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Aug 30 00:59:59.216593 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 338/668] 10.222.0.79 () {56 vars in 1108 bytes} [Tue Aug 30 00:59:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:59:59.217245 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfabf551-0375-4b94-a390-73e4b6132a94 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:59.269054 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba517a2-2b31-4438-945e-6b0546445195 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:59.270498 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba517a2-2b31-4438-945e-6b0546445195 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:59.333362 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:59.350004 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfabf551-0375-4b94-a390-73e4b6132a94 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:59.388851 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793bd461-7d14-47a7-a523-404092635abf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:59.389491 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793bd461-7d14-47a7-a523-404092635abf None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:59.389768 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793bd461-7d14-47a7-a523-404092635abf None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:59.390038 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793bd461-7d14-47a7-a523-404092635abf None admin] PATH_INFO: `/v3/roles/service` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:59.401892 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793bd461-7d14-47a7-a523-404092635abf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:59:59.407968 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-793bd461-7d14-47a7-a523-404092635abf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 00:59:59.407968 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:59:59.407968 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:59:59.407968 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:59:59.407968 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:59:59.407968 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:59:59.407968 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:59:59.407968 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:59:59.407968 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:59:59.407968 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:59:59.407968 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:59:59.407968 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:59:59.407968 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:59:59.407968 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:59:59.407968 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:59:59.407968 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:59:59.409151 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:59:59.409151 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:59:59.409151 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:59:59.409151 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:59:59.409151 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:59:59.409151 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:59:59.409151 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:59:59.409151 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:59:59.409151 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:59:59.409151 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:59:59.409151 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:59:59.409151 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Aug 30 00:59:59.409151 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:59:59.409151 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:59:59.409151 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:59:59.409151 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:59:59.410159 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:59:59.410159 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:59:59.410159 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:59:59.410159 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:59:59.410159 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:59:59.410159 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:59:59.410159 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:59:59.410159 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:59:59.410159 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:59:59.410159 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:59:59.410159 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 00:59:59.410159 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Aug 30 00:59:59.414046 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 339/669] 10.222.0.79 () {56 vars in 1102 bytes} [Tue Aug 30 00:59:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:59:59.414921 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793bd461-7d14-47a7-a523-404092635abf None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:59.417458 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 331/670] 10.222.0.79 () {58 vars in 1282 bytes} [Tue Aug 30 00:59:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 00:59:59.419339 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba517a2-2b31-4438-945e-6b0546445195 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:59.471171 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:59.528728 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793bd461-7d14-47a7-a523-404092635abf None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:59.552073 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba517a2-2b31-4438-945e-6b0546445195 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:59.565556 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f131af47-a5e5-4801-bfe6-246a02787ac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:59.566182 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f131af47-a5e5-4801-bfe6-246a02787ac4 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:59.566462 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f131af47-a5e5-4801-bfe6-246a02787ac4 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:59.566734 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f131af47-a5e5-4801-bfe6-246a02787ac4 None admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:59.567757 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f131af47-a5e5-4801-bfe6-246a02787ac4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:59:59.568376 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f131af47-a5e5-4801-bfe6-246a02787ac4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:59.569479 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f131af47-a5e5-4801-bfe6-246a02787ac4 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:59.583499 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 340/671] 10.222.0.79 () {56 vars in 1109 bytes} [Tue Aug 30 00:59:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:59:59.584446 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f131af47-a5e5-4801-bfe6-246a02787ac4 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:59.597045 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb7e2e5-4216-48e4-a7a2-511e840d2796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:59.597948 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb7e2e5-4216-48e4-a7a2-511e840d2796 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:59.598400 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb7e2e5-4216-48e4-a7a2-511e840d2796 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:59.598818 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb7e2e5-4216-48e4-a7a2-511e840d2796 None admin] PATH_INFO: `/v3/roles` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:59.599667 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb7e2e5-4216-48e4-a7a2-511e840d2796 None admin] RBAC: Adding query filter params (name=service) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:59:59.600184 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb7e2e5-4216-48e4-a7a2-511e840d2796 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:59.601820 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb7e2e5-4216-48e4-a7a2-511e840d2796 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:59.612226 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 332/672] 10.222.0.79 () {56 vars in 1103 bytes} [Tue Aug 30 00:59:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:59:59.613258 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb7e2e5-4216-48e4-a7a2-511e840d2796 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:59.616096 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:59.712419 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f131af47-a5e5-4801-bfe6-246a02787ac4 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:59.725511 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:59.731082 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb7e2e5-4216-48e4-a7a2-511e840d2796 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:59.758420 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77790370-9dc2-4f23-9af5-592fed8eb818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:59.759052 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77790370-9dc2-4f23-9af5-592fed8eb818 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:59.759513 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77790370-9dc2-4f23-9af5-592fed8eb818 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:59.759632 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77790370-9dc2-4f23-9af5-592fed8eb818 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:59.770615 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77790370-9dc2-4f23-9af5-592fed8eb818 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:59.771908 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b2d4d1-e0ad-4663-b0a7-3f92c7eb0fba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:59.772060 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77790370-9dc2-4f23-9af5-592fed8eb818 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:59.773005 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b2d4d1-e0ad-4663-b0a7-3f92c7eb0fba None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:59.773434 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b2d4d1-e0ad-4663-b0a7-3f92c7eb0fba None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:59.773926 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b2d4d1-e0ad-4663-b0a7-3f92c7eb0fba None admin] PATH_INFO: `/v3/projects/service` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:59.781661 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b2d4d1-e0ad-4663-b0a7-3f92c7eb0fba None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:59.783310 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b2d4d1-e0ad-4663-b0a7-3f92c7eb0fba None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:59.787221 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-77790370-9dc2-4f23-9af5-592fed8eb818 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:59:59.787221 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:59:59.787221 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:59:59.787221 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:59:59.787221 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:59:59.787221 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:59:59.787221 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:59:59.787221 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:59:59.787221 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:59:59.787221 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:59:59.787221 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:59:59.787221 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:59:59.787221 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:59:59.787221 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:59:59.787221 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:59:59.787221 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:59:59.788379 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:59:59.788379 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:59:59.788379 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:59:59.788379 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:59:59.788379 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:59:59.788379 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:59:59.788379 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:59:59.788379 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Aug 30 00:59:59.788379 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:59:59.788379 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:59:59.788379 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:59:59.788379 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:59:59.788379 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:59:59.788379 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:59:59.788379 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:59:59.788379 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:59:59.788379 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:59:59.789276 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:59:59.789276 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:59:59.789276 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Aug 30 00:59:59.789276 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 341/673] 10.222.0.79 () {56 vars in 1108 bytes} [Tue Aug 30 00:59:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:59:59.789776 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77790370-9dc2-4f23-9af5-592fed8eb818 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:59.799000 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application [None req-30b2d4d1-e0ad-4663-b0a7-3f92c7eb0fba None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:59:59.799000 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:59:59.799000 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:59:59.799000 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:59:59.799000 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:59:59.799000 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:59:59.799000 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:59:59.799000 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:59:59.799000 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:59:59.799000 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:59:59.799000 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:59:59.799000 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:59:59.799000 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 00:59:59.799000 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 00:59:59.799000 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 00:59:59.799963 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 00:59:59.799963 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:59:59.799963 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:59:59.799963 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:59:59.799963 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:59:59.799963 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:59:59.799963 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:59:59.799963 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:59:59.799963 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application with Lock( Aug 30 00:59:59.799963 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:59:59.799963 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:59:59.799963 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:59:59.799963 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:59:59.799963 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:59:59.799963 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:59:59.799963 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:59:59.799963 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:59:59.800857 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 00:59:59.800857 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 00:59:59.800857 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 00:59:59.800857 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 00:59:59.800857 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 00:59:59.800857 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 00:59:59.800857 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:59:59.800857 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Aug 30 00:59:59.803297 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 333/674] 10.222.0.79 () {56 vars in 1111 bytes} [Tue Aug 30 00:59:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:59:59.804298 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b2d4d1-e0ad-4663-b0a7-3f92c7eb0fba None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:59.878002 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:59.897616 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77790370-9dc2-4f23-9af5-592fed8eb818 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:59.923911 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b2d4d1-e0ad-4663-b0a7-3f92c7eb0fba None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:59:59.932302 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0183e55e-7066-423f-b2c2-46df21b626a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:59.933058 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0183e55e-7066-423f-b2c2-46df21b626a9 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:59.933244 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0183e55e-7066-423f-b2c2-46df21b626a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:59.933483 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0183e55e-7066-423f-b2c2-46df21b626a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:59.946054 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0183e55e-7066-423f-b2c2-46df21b626a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:59.947532 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0183e55e-7066-423f-b2c2-46df21b626a9 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:59.963052 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-0183e55e-7066-423f-b2c2-46df21b626a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:59:59.963052 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:59:59.963052 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:59:59.963052 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:59:59.963052 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:59:59.963052 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:59:59.963052 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:59:59.963052 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:59:59.963052 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:59:59.963052 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:59:59.963052 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:59:59.963052 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:59:59.963052 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:59:59.963052 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:59:59.963052 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:59:59.963052 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:59:59.964086 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:59:59.964086 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:59:59.964086 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:59:59.964086 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:59:59.964086 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:59:59.964086 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:59:59.964086 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:59:59.964086 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Aug 30 00:59:59.964086 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:59:59.964086 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:59:59.964086 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:59:59.964086 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:59:59.964086 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:59:59.964086 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:59:59.964086 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:59:59.964086 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:59:59.964086 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:59:59.964976 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:59:59.964976 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:59:59.964976 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Aug 30 00:59:59.964976 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 342/675] 10.222.0.79 () {56 vars in 1108 bytes} [Tue Aug 30 00:59:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:59:59.968017 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4598be-e7d4-414e-b422-fdc2d1ccb796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:59:59.968879 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4598be-e7d4-414e-b422-fdc2d1ccb796 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:59:59.969363 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4598be-e7d4-414e-b422-fdc2d1ccb796 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:59:59.969689 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0183e55e-7066-423f-b2c2-46df21b626a9 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:59:59.970063 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4598be-e7d4-414e-b422-fdc2d1ccb796 None admin] PATH_INFO: `/v3/domains` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:59:59.970983 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4598be-e7d4-414e-b422-fdc2d1ccb796 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:59:59.971519 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4598be-e7d4-414e-b422-fdc2d1ccb796 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:59:59.973228 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4598be-e7d4-414e-b422-fdc2d1ccb796 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:59:59.987324 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:59.988737 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 334/676] 10.222.0.79 () {56 vars in 1109 bytes} [Tue Aug 30 00:59:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:59:59.990166 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4598be-e7d4-414e-b422-fdc2d1ccb796 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:00.101834 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0183e55e-7066-423f-b2c2-46df21b626a9 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:00.116813 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4598be-e7d4-414e-b422-fdc2d1ccb796 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:00.140309 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70e6b7c-5892-4dc6-8577-63bcdad6b9c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:00.141019 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70e6b7c-5892-4dc6-8577-63bcdad6b9c1 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:00.141244 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70e6b7c-5892-4dc6-8577-63bcdad6b9c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:00.141536 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70e6b7c-5892-4dc6-8577-63bcdad6b9c1 None admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:00.142239 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70e6b7c-5892-4dc6-8577-63bcdad6b9c1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:00:00.142537 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70e6b7c-5892-4dc6-8577-63bcdad6b9c1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:00.144119 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70e6b7c-5892-4dc6-8577-63bcdad6b9c1 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:00.147279 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:00.161800 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 343/677] 10.222.0.79 () {56 vars in 1148 bytes} [Tue Aug 30 00:59:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:00:00.162752 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70e6b7c-5892-4dc6-8577-63bcdad6b9c1 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:00.163012 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541723e7-4678-4b3c-8915-197d5108589c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:00.163919 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541723e7-4678-4b3c-8915-197d5108589c None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:00.164412 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541723e7-4678-4b3c-8915-197d5108589c None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:00.164881 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541723e7-4678-4b3c-8915-197d5108589c None admin] PATH_INFO: `/v3/domains` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:00.165838 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541723e7-4678-4b3c-8915-197d5108589c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:00:00.166351 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541723e7-4678-4b3c-8915-197d5108589c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:00.168061 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541723e7-4678-4b3c-8915-197d5108589c None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:00.181859 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 335/678] 10.222.0.79 () {56 vars in 1109 bytes} [Tue Aug 30 00:59:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:00:00.183163 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541723e7-4678-4b3c-8915-197d5108589c None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:00.246275 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:00.280577 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70e6b7c-5892-4dc6-8577-63bcdad6b9c1 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:00.314401 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541723e7-4678-4b3c-8915-197d5108589c None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:00.319396 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889d2cde-a0d6-442b-9663-7fc98bf88b26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:00.320120 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889d2cde-a0d6-442b-9663-7fc98bf88b26 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:00.320509 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889d2cde-a0d6-442b-9663-7fc98bf88b26 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:00.320852 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889d2cde-a0d6-442b-9663-7fc98bf88b26 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:00.328346 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889d2cde-a0d6-442b-9663-7fc98bf88b26 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:00.329891 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889d2cde-a0d6-442b-9663-7fc98bf88b26 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:00.342148 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-889d2cde-a0d6-442b-9663-7fc98bf88b26 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 01:00:00.342148 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:00:00.342148 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:00:00.342148 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:00:00.342148 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:00:00.342148 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:00:00.342148 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:00:00.342148 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:00:00.342148 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:00:00.342148 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:00:00.342148 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:00:00.342148 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:00:00.342148 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 01:00:00.342148 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 01:00:00.342148 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 01:00:00.343114 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 01:00:00.343114 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:00:00.343114 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:00:00.343114 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:00:00.343114 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:00:00.343114 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:00:00.343114 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:00:00.343114 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:00:00.343114 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Aug 30 01:00:00.343114 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:00:00.343114 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:00:00.343114 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:00:00.343114 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:00:00.343114 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:00:00.343114 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:00:00.343114 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:00:00.343114 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:00:00.344053 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 01:00:00.344053 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 01:00:00.344053 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 01:00:00.344053 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 01:00:00.344053 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 01:00:00.344053 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 01:00:00.344053 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 01:00:00.344053 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Aug 30 01:00:00.347396 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 344/679] 10.222.0.79 () {56 vars in 1111 bytes} [Tue Aug 30 01:00:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:00:00.348292 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889d2cde-a0d6-442b-9663-7fc98bf88b26 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:00.358892 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87f99ee-91b8-4775-bae8-4433196c9b44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:00.359858 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87f99ee-91b8-4775-bae8-4433196c9b44 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:00.360360 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87f99ee-91b8-4775-bae8-4433196c9b44 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:00.360833 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87f99ee-91b8-4775-bae8-4433196c9b44 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:00.361841 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87f99ee-91b8-4775-bae8-4433196c9b44 None admin] RBAC: Adding query filter params (role.id=687d3359d6b2413b84ca5a54d30d5488, scope.project.id=0eec3a73673e45dc881de586b9b0fbbb, user.id=16e6a0ca26fc4ef892c188ad89a1e132) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:00:00.362351 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87f99ee-91b8-4775-bae8-4433196c9b44 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:00.364071 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87f99ee-91b8-4775-bae8-4433196c9b44 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:00.371332 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 336/680] 10.222.0.79 () {56 vars in 1374 bytes} [Tue Aug 30 01:00:00 2022] GET /identity/v3/role_assignments?user.id=16e6a0ca26fc4ef892c188ad89a1e132&scope.project.id=0eec3a73673e45dc881de586b9b0fbbb&role.id=687d3359d6b2413b84ca5a54d30d5488 => generated 608 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:00:00.373005 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87f99ee-91b8-4775-bae8-4433196c9b44 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:00.448197 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:00.485043 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889d2cde-a0d6-442b-9663-7fc98bf88b26 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:00.516368 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87f99ee-91b8-4775-bae8-4433196c9b44 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:00.540534 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:00.550592 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6296dd57-e747-4b40-ad02-ccf2156009b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:00.551644 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6296dd57-e747-4b40-ad02-ccf2156009b9 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:00.552132 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6296dd57-e747-4b40-ad02-ccf2156009b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:00.552951 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6296dd57-e747-4b40-ad02-ccf2156009b9 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:00.570666 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6296dd57-e747-4b40-ad02-ccf2156009b9 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:00.572455 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6296dd57-e747-4b40-ad02-ccf2156009b9 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:00.588730 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-6296dd57-e747-4b40-ad02-ccf2156009b9 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 30 01:00:00.588730 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:00:00.588730 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:00:00.588730 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:00:00.588730 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:00:00.588730 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:00:00.588730 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:00:00.588730 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:00:00.588730 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:00:00.588730 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:00:00.588730 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:00:00.588730 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:00:00.588730 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 01:00:00.588730 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 01:00:00.588730 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 01:00:00.588730 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 01:00:00.589715 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:00:00.589715 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:00:00.589715 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 01:00:00.589715 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 01:00:00.589715 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 01:00:00.589715 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 01:00:00.589715 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:00:00.589715 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:00:00.589715 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:00:00.589715 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:00:00.589715 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:00:00.589715 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Aug 30 01:00:00.589715 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:00:00.589715 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:00:00.589715 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:00:00.589715 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:00:00.589715 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:00:00.589715 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:00:00.591009 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:00:00.591009 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:00:00.591009 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 01:00:00.591009 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 01:00:00.591009 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 01:00:00.591009 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 01:00:00.591009 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 01:00:00.591009 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 01:00:00.591009 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 30 01:00:00.591009 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Aug 30 01:00:00.591697 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231cbe96-b61c-45e1-9000-5ee591b0fd03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:00.591697 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231cbe96-b61c-45e1-9000-5ee591b0fd03 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:00.591697 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231cbe96-b61c-45e1-9000-5ee591b0fd03 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:00.591697 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231cbe96-b61c-45e1-9000-5ee591b0fd03 None admin] PATH_INFO: `/v3/projects` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:00.592299 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231cbe96-b61c-45e1-9000-5ee591b0fd03 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:00:00.592299 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231cbe96-b61c-45e1-9000-5ee591b0fd03 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:00.593604 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231cbe96-b61c-45e1-9000-5ee591b0fd03 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:00.594871 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 345/681] 10.222.0.79 () {56 vars in 1096 bytes} [Tue Aug 30 01:00:00 2022] GET /identity/v3/users/swift => generated 83 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:00:00.604283 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6296dd57-e747-4b40-ad02-ccf2156009b9 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:00.608426 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 337/682] 10.222.0.79 () {56 vars in 1148 bytes} [Tue Aug 30 01:00:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:00:00.616185 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231cbe96-b61c-45e1-9000-5ee591b0fd03 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:00.738249 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6296dd57-e747-4b40-ad02-ccf2156009b9 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:00.751858 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231cbe96-b61c-45e1-9000-5ee591b0fd03 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:00.760858 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:00.776467 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b341c69a-ad44-4ff3-b8a9-8ac651ab6bb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:00.776991 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b341c69a-ad44-4ff3-b8a9-8ac651ab6bb8 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:00.777270 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b341c69a-ad44-4ff3-b8a9-8ac651ab6bb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:00.777544 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b341c69a-ad44-4ff3-b8a9-8ac651ab6bb8 None admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:00.778322 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b341c69a-ad44-4ff3-b8a9-8ac651ab6bb8 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:00:00.778691 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b341c69a-ad44-4ff3-b8a9-8ac651ab6bb8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:00.780279 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b341c69a-ad44-4ff3-b8a9-8ac651ab6bb8 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:00.794203 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ee1164-4af3-4430-a175-fedf018d4c2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:00.794846 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ee1164-4af3-4430-a175-fedf018d4c2f None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:00.795148 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ee1164-4af3-4430-a175-fedf018d4c2f None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:00.795409 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ee1164-4af3-4430-a175-fedf018d4c2f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:00.796267 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ee1164-4af3-4430-a175-fedf018d4c2f None admin] RBAC: Adding query filter params (role.id=687d3359d6b2413b84ca5a54d30d5488, scope.project.id=0eec3a73673e45dc881de586b9b0fbbb, user.id=6480b2f14c37474c89df9fba48f7cd91) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:00:00.796574 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ee1164-4af3-4430-a175-fedf018d4c2f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:00.798018 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ee1164-4af3-4430-a175-fedf018d4c2f None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:00.804342 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 346/683] 10.222.0.79 () {56 vars in 1135 bytes} [Tue Aug 30 01:00:00 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:00:00.804747 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 338/684] 10.222.0.79 () {56 vars in 1374 bytes} [Tue Aug 30 01:00:00 2022] GET /identity/v3/role_assignments?user.id=6480b2f14c37474c89df9fba48f7cd91&scope.project.id=0eec3a73673e45dc881de586b9b0fbbb&role.id=687d3359d6b2413b84ca5a54d30d5488 => generated 608 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:00:00.805904 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e188bf1-3e80-4c1d-8eec-bae646746d04 None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:00.806198 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e188bf1-3e80-4c1d-8eec-bae646746d04 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:00.806474 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e188bf1-3e80-4c1d-8eec-bae646746d04 None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:00.808285 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 347/685] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 01:00:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:00:00.810190 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ee1164-4af3-4430-a175-fedf018d4c2f None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:00.821134 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95d6d23-2d57-4906-8bf7-95d035abcc83 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:00.821468 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95d6d23-2d57-4906-8bf7-95d035abcc83 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:00.821667 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95d6d23-2d57-4906-8bf7-95d035abcc83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:00.873074 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-e95d6d23-2d57-4906-8bf7-95d035abcc83 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:00:00.874538 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-e95d6d23-2d57-4906-8bf7-95d035abcc83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:00:00.932510 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ee1164-4af3-4430-a175-fedf018d4c2f None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:00.973290 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e9a590-3981-4002-b0bf-9464bd1184f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:00.974029 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e9a590-3981-4002-b0bf-9464bd1184f9 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:00.974335 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e9a590-3981-4002-b0bf-9464bd1184f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:00.974621 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e9a590-3981-4002-b0bf-9464bd1184f9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:00.990002 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:01.033998 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:01.053679 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 348/686] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 01:00:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 01:00:01.067851 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e9a590-3981-4002-b0bf-9464bd1184f9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:01.069315 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e9a590-3981-4002-b0bf-9464bd1184f9 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:01.154808 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ffd832-3e6c-4954-ad15-134b32abdf1e None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:01.155847 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ffd832-3e6c-4954-ad15-134b32abdf1e None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:01.156330 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ffd832-3e6c-4954-ad15-134b32abdf1e None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:01.158272 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 349/687] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 01:00:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 01:00:01.164727 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55ee918-c59e-40ba-8744-8dd1e516b201 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:01.165308 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55ee918-c59e-40ba-8744-8dd1e516b201 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:01.165782 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55ee918-c59e-40ba-8744-8dd1e516b201 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:01.179111 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 339/688] 10.222.0.79 () {58 vars in 1282 bytes} [Tue Aug 30 01:00:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 30 01:00:01.185850 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e9a590-3981-4002-b0bf-9464bd1184f9 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:01.187115 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-b55ee918-c59e-40ba-8744-8dd1e516b201 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:00:01.191290 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-b55ee918-c59e-40ba-8744-8dd1e516b201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:00:01.289140 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 350/689] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 01:00:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 01:00:01.293169 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:01.319865 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e9a590-3981-4002-b0bf-9464bd1184f9 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:01.363764 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e082e9-896c-4fb4-a662-0af0b7bffbcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:01.364611 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e082e9-896c-4fb4-a662-0af0b7bffbcc None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:01.365042 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e082e9-896c-4fb4-a662-0af0b7bffbcc None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:01.365450 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e082e9-896c-4fb4-a662-0af0b7bffbcc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:01.374490 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55ee918-c59e-40ba-8744-8dd1e516b201 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:01.383834 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e082e9-896c-4fb4-a662-0af0b7bffbcc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:01.385370 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e082e9-896c-4fb4-a662-0af0b7bffbcc None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:01.405445 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application [None req-e9e082e9-896c-4fb4-a662-0af0b7bffbcc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:00:01.405445 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:00:01.405445 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:00:01.405445 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:00:01.405445 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:00:01.405445 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:00:01.405445 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:00:01.405445 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:00:01.405445 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:00:01.405445 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:00:01.405445 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:00:01.405445 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:00:01.405445 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 01:00:01.405445 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 01:00:01.405445 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 01:00:01.405445 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 01:00:01.406485 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:00:01.406485 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:00:01.406485 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:00:01.406485 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:00:01.406485 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:00:01.406485 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:00:01.406485 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:00:01.406485 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application with Lock( Aug 30 01:00:01.406485 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:00:01.406485 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:00:01.406485 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:00:01.406485 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:00:01.406485 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:00:01.406485 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:00:01.406485 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:00:01.406485 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:00:01.406485 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 01:00:01.407444 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 01:00:01.407444 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:00:01.407444 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Aug 30 01:00:01.407444 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 340/690] 10.222.0.79 () {56 vars in 1108 bytes} [Tue Aug 30 01:00:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:00:01.412534 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e082e9-896c-4fb4-a662-0af0b7bffbcc None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:01.541918 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e082e9-896c-4fb4-a662-0af0b7bffbcc None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:01.567281 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55ee918-c59e-40ba-8744-8dd1e516b201 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:01.572286 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:01.589563 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:01.595886 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab066851-21ee-4964-b2f0-35a53ab764f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:01.597181 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab066851-21ee-4964-b2f0-35a53ab764f3 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:01.597673 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab066851-21ee-4964-b2f0-35a53ab764f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:01.598142 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab066851-21ee-4964-b2f0-35a53ab764f3 None admin] PATH_INFO: `/v3/domains` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:01.599010 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab066851-21ee-4964-b2f0-35a53ab764f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:00:01.599564 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab066851-21ee-4964-b2f0-35a53ab764f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:01.601136 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab066851-21ee-4964-b2f0-35a53ab764f3 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:01.612599 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f0856b-2305-4827-bb57-669c8648b81b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:01.613229 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f0856b-2305-4827-bb57-669c8648b81b None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:01.613504 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f0856b-2305-4827-bb57-669c8648b81b None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:01.613771 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f0856b-2305-4827-bb57-669c8648b81b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:01.626273 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f0856b-2305-4827-bb57-669c8648b81b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:01.627287 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f0856b-2305-4827-bb57-669c8648b81b None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:01.630161 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 341/691] 10.222.0.79 () {56 vars in 1109 bytes} [Tue Aug 30 01:00:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:00:01.631301 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab066851-21ee-4964-b2f0-35a53ab764f3 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:01.643001 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-34f0856b-2305-4827-bb57-669c8648b81b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:00:01.643001 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:00:01.643001 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:00:01.643001 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:00:01.643001 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:00:01.643001 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:00:01.643001 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:00:01.643001 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:00:01.643001 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:00:01.643001 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:00:01.643001 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:00:01.643001 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:00:01.643001 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 01:00:01.643001 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 01:00:01.643001 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 01:00:01.643001 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 01:00:01.644026 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:00:01.644026 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:00:01.644026 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:00:01.644026 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:00:01.644026 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:00:01.644026 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:00:01.644026 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:00:01.644026 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Aug 30 01:00:01.644026 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:00:01.644026 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:00:01.644026 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:00:01.644026 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:00:01.644026 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:00:01.644026 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:00:01.644026 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:00:01.644026 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:00:01.644026 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 01:00:01.644977 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 01:00:01.644977 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:00:01.644977 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Aug 30 01:00:01.644977 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 351/692] 10.222.0.79 () {56 vars in 1108 bytes} [Tue Aug 30 01:00:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:00:01.645645 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f0856b-2305-4827-bb57-669c8648b81b None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:01.745175 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab066851-21ee-4964-b2f0-35a53ab764f3 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:01.754287 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f0856b-2305-4827-bb57-669c8648b81b None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:01.785898 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa0d88a-67bb-458c-a014-4f9523315dda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:01.786534 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa0d88a-67bb-458c-a014-4f9523315dda None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:01.786811 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa0d88a-67bb-458c-a014-4f9523315dda None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:01.787082 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa0d88a-67bb-458c-a014-4f9523315dda None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:01.787794 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa0d88a-67bb-458c-a014-4f9523315dda None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:01.789358 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa0d88a-67bb-458c-a014-4f9523315dda None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:01.790692 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741aff30-3af4-4b39-a72e-ffe76f7c5e42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:01.791372 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741aff30-3af4-4b39-a72e-ffe76f7c5e42 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:01.791648 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741aff30-3af4-4b39-a72e-ffe76f7c5e42 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:01.791915 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741aff30-3af4-4b39-a72e-ffe76f7c5e42 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:01.799487 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741aff30-3af4-4b39-a72e-ffe76f7c5e42 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:01.800856 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741aff30-3af4-4b39-a72e-ffe76f7c5e42 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:01.801995 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application [None req-6aa0d88a-67bb-458c-a014-4f9523315dda None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 30 01:00:01.801995 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:00:01.801995 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 01:00:01.801995 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 01:00:01.801995 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 01:00:01.801995 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 01:00:01.801995 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 01:00:01.801995 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 01:00:01.801995 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 30 01:00:01.801995 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Aug 30 01:00:01.801995 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 01:00:01.801995 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Aug 30 01:00:01.801995 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:00:01.801995 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:00:01.801995 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:00:01.801995 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:00:01.801995 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:00:01.804344 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:00:01.804344 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:00:01.804344 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:00:01.804344 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:00:01.804344 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:00:01.804344 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:00:01.804344 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 01:00:01.804344 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 01:00:01.804344 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 01:00:01.804344 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 01:00:01.804344 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:00:01.804344 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:00:01.804344 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:00:01.804344 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:00:01.804344 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:00:01.804344 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:00:01.806314 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:00:01.806314 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application with Lock( Aug 30 01:00:01.806314 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:00:01.806314 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:00:01.806314 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:00:01.806314 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:00:01.806314 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:00:01.806314 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:00:01.806314 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:00:01.806314 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:00:01.806314 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 01:00:01.806314 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 01:00:01.806314 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 30 01:00:01.806314 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Aug 30 01:00:01.812194 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 342/693] 10.222.0.79 () {56 vars in 1129 bytes} [Tue Aug 30 01:00:01 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:00:01.812194 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa0d88a-67bb-458c-a014-4f9523315dda None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:01.813497 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-741aff30-3af4-4b39-a72e-ffe76f7c5e42 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 01:00:01.813497 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:00:01.813497 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:00:01.813497 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:00:01.813497 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:00:01.813497 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:00:01.813497 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:00:01.813497 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:00:01.813497 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:00:01.813497 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:00:01.813497 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:00:01.813497 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:00:01.813497 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 01:00:01.813497 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 01:00:01.813497 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 01:00:01.815492 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 01:00:01.815492 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:00:01.815492 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:00:01.815492 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:00:01.815492 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:00:01.815492 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:00:01.815492 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:00:01.815492 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:00:01.815492 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Aug 30 01:00:01.815492 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:00:01.815492 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:00:01.815492 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:00:01.815492 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:00:01.815492 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:00:01.815492 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:00:01.815492 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:00:01.815492 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:00:01.817858 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 01:00:01.817858 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 01:00:01.817858 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 01:00:01.817858 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 01:00:01.817858 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 01:00:01.817858 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 01:00:01.817858 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 01:00:01.817858 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Aug 30 01:00:01.822412 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 352/694] 10.222.0.79 () {56 vars in 1111 bytes} [Tue Aug 30 01:00:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:00:01.822412 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741aff30-3af4-4b39-a72e-ffe76f7c5e42 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:01.848149 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:01.883534 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:01.925759 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa0d88a-67bb-458c-a014-4f9523315dda None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:01.934513 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741aff30-3af4-4b39-a72e-ffe76f7c5e42 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:01.962833 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2f375f-14ab-43d4-a1f8-581bede1122a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:01.963569 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2f375f-14ab-43d4-a1f8-581bede1122a None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:01.963919 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2f375f-14ab-43d4-a1f8-581bede1122a None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:01.964261 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2f375f-14ab-43d4-a1f8-581bede1122a None admin] PATH_INFO: `/v3/domains` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:01.965043 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2f375f-14ab-43d4-a1f8-581bede1122a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:00:01.966076 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2f375f-14ab-43d4-a1f8-581bede1122a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:01.968007 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2f375f-14ab-43d4-a1f8-581bede1122a None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:01.970686 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d4bcd1-637d-475a-ac5d-68a332c2e072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:01.971469 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d4bcd1-637d-475a-ac5d-68a332c2e072 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:01.971746 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d4bcd1-637d-475a-ac5d-68a332c2e072 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:01.972014 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d4bcd1-637d-475a-ac5d-68a332c2e072 None admin] PATH_INFO: `/v3/services` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:01.972638 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d4bcd1-637d-475a-ac5d-68a332c2e072 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:00:01.972934 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d4bcd1-637d-475a-ac5d-68a332c2e072 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:01.974283 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d4bcd1-637d-475a-ac5d-68a332c2e072 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:01.979040 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 353/695] 10.222.0.79 () {56 vars in 1124 bytes} [Tue Aug 30 01:00:01 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:00:01.979863 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d4bcd1-637d-475a-ac5d-68a332c2e072 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:01.986865 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 343/696] 10.222.0.79 () {56 vars in 1109 bytes} [Tue Aug 30 01:00:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:00:01.987760 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2f375f-14ab-43d4-a1f8-581bede1122a None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:02.074584 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:02.091708 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d4bcd1-637d-475a-ac5d-68a332c2e072 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:02.099611 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2f375f-14ab-43d4-a1f8-581bede1122a None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:02.119577 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:02.128356 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502eaceb-bc81-4a0f-9629-b3e706c07c8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:02.129047 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502eaceb-bc81-4a0f-9629-b3e706c07c8a None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:02.129391 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502eaceb-bc81-4a0f-9629-b3e706c07c8a None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:02.129722 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502eaceb-bc81-4a0f-9629-b3e706c07c8a None admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:02.130475 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502eaceb-bc81-4a0f-9629-b3e706c07c8a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:00:02.130839 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502eaceb-bc81-4a0f-9629-b3e706c07c8a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:02.132582 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502eaceb-bc81-4a0f-9629-b3e706c07c8a None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:02.140159 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be8d948-5eec-4971-8358-71322e49de53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:02.141455 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be8d948-5eec-4971-8358-71322e49de53 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:02.141797 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be8d948-5eec-4971-8358-71322e49de53 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:02.142133 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be8d948-5eec-4971-8358-71322e49de53 None admin] PATH_INFO: `/v3/services` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:02.143390 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be8d948-5eec-4971-8358-71322e49de53 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:00:02.143780 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be8d948-5eec-4971-8358-71322e49de53 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:02.145527 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be8d948-5eec-4971-8358-71322e49de53 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:02.151250 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 354/697] 10.222.0.79 () {56 vars in 1148 bytes} [Tue Aug 30 01:00:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:00:02.152177 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502eaceb-bc81-4a0f-9629-b3e706c07c8a None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:02.156929 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 344/698] 10.222.0.79 () {56 vars in 1124 bytes} [Tue Aug 30 01:00:01 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:00:02.157905 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be8d948-5eec-4971-8358-71322e49de53 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:02.272150 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be8d948-5eec-4971-8358-71322e49de53 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:02.311629 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1751910-c155-4de4-9cbd-601b87263586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:02.312245 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1751910-c155-4de4-9cbd-601b87263586 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:02.312517 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1751910-c155-4de4-9cbd-601b87263586 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:02.312783 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1751910-c155-4de4-9cbd-601b87263586 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:02.313518 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1751910-c155-4de4-9cbd-601b87263586 None admin] RBAC: Adding query filter params (role.id=687d3359d6b2413b84ca5a54d30d5488, scope.project.id=0eec3a73673e45dc881de586b9b0fbbb, user.id=dd556fa6ba464928b1e067325792a523) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:00:02.313818 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1751910-c155-4de4-9cbd-601b87263586 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:02.315291 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1751910-c155-4de4-9cbd-601b87263586 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:02.322432 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 345/699] 10.222.0.79 () {56 vars in 1374 bytes} [Tue Aug 30 01:00:02 2022] GET /identity/v3/role_assignments?user.id=dd556fa6ba464928b1e067325792a523&scope.project.id=0eec3a73673e45dc881de586b9b0fbbb&role.id=687d3359d6b2413b84ca5a54d30d5488 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:00:02.388070 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502eaceb-bc81-4a0f-9629-b3e706c07c8a None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:02.432798 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7990732e-7da5-4a73-ae81-2a0fae7a3781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:02.433418 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7990732e-7da5-4a73-ae81-2a0fae7a3781 None admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:02.433590 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7990732e-7da5-4a73-ae81-2a0fae7a3781 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:02.433743 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7990732e-7da5-4a73-ae81-2a0fae7a3781 None admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:02.434706 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7990732e-7da5-4a73-ae81-2a0fae7a3781 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:02.436217 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7990732e-7da5-4a73-ae81-2a0fae7a3781 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:02.461409 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 355/700] 10.222.0.79 () {60 vars in 1132 bytes} [Tue Aug 30 01:00:02 2022] POST /identity/v3/users => generated 254 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:00:02.712078 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5bcd95-07c4-4fce-9848-bed033681506 None None] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:02.712744 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5bcd95-07c4-4fce-9848-bed033681506 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:02.712744 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5bcd95-07c4-4fce-9848-bed033681506 None None] PATH_INFO: `/` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:02.713872 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 346/701] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 01:00:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:00:02.719671 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fad1435-90f8-4190-8ebe-3dec5ba84318 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:02.719958 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fad1435-90f8-4190-8ebe-3dec5ba84318 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:02.720227 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fad1435-90f8-4190-8ebe-3dec5ba84318 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:02.728026 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:02.745092 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-9fad1435-90f8-4190-8ebe-3dec5ba84318 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:00:02.746341 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-9fad1435-90f8-4190-8ebe-3dec5ba84318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:00:02.831721 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 356/702] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 01:00:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 01:00:03.170093 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5bcd95-07c4-4fce-9848-bed033681506 None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:03.213971 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:03.304770 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5bcd95-07c4-4fce-9848-bed033681506 None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:03.352585 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5131790c-aea9-48e9-9001-fc7d43e02123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:03.353210 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5131790c-aea9-48e9-9001-fc7d43e02123 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:03.353482 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5131790c-aea9-48e9-9001-fc7d43e02123 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:03.353744 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5131790c-aea9-48e9-9001-fc7d43e02123 None admin] PATH_INFO: `/v3/services/network` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:03.354397 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5131790c-aea9-48e9-9001-fc7d43e02123 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:03.355785 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5131790c-aea9-48e9-9001-fc7d43e02123 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:03.367874 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application [None req-5131790c-aea9-48e9-9001-fc7d43e02123 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 30 01:00:03.367874 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:00:03.367874 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 01:00:03.367874 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 01:00:03.367874 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 01:00:03.367874 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 01:00:03.367874 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 01:00:03.367874 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 01:00:03.367874 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 30 01:00:03.367874 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Aug 30 01:00:03.367874 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 01:00:03.367874 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Aug 30 01:00:03.367874 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:00:03.367874 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:00:03.367874 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:00:03.367874 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:00:03.367874 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:00:03.368857 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:00:03.368857 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:00:03.368857 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:00:03.368857 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:00:03.368857 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:00:03.368857 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:00:03.368857 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 01:00:03.368857 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 01:00:03.368857 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 01:00:03.368857 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 01:00:03.368857 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:00:03.368857 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:00:03.368857 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:00:03.368857 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:00:03.368857 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:00:03.368857 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:00:03.369685 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:00:03.369685 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application with Lock( Aug 30 01:00:03.369685 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:00:03.369685 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:00:03.369685 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:00:03.369685 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:00:03.369685 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:00:03.369685 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:00:03.369685 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:00:03.369685 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:00:03.369685 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 01:00:03.369685 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 01:00:03.369685 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 30 01:00:03.369685 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Aug 30 01:00:03.369685 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 347/703] 10.222.0.79 () {56 vars in 1111 bytes} [Tue Aug 30 01:00:03 2022] GET /identity/v3/services/network => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:00:03.377295 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fad1435-90f8-4190-8ebe-3dec5ba84318 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:03.513505 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fad1435-90f8-4190-8ebe-3dec5ba84318 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:03.553492 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:03.558695 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2a4097-ab61-4a4c-b0d9-ccdbef4849cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:03.559360 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2a4097-ab61-4a4c-b0d9-ccdbef4849cd None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:03.563488 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2a4097-ab61-4a4c-b0d9-ccdbef4849cd None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:03.563762 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2a4097-ab61-4a4c-b0d9-ccdbef4849cd None admin] PATH_INFO: `/v3/services` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:03.564461 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2a4097-ab61-4a4c-b0d9-ccdbef4849cd None admin] RBAC: Adding query filter params (name=network) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:00:03.564767 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2a4097-ab61-4a4c-b0d9-ccdbef4849cd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:03.566125 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2a4097-ab61-4a4c-b0d9-ccdbef4849cd None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:03.571188 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 357/704] 10.222.0.79 () {56 vars in 1112 bytes} [Tue Aug 30 01:00:03 2022] GET /identity/v3/services?name=network => generated 124 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:00:03.578125 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5131790c-aea9-48e9-9001-fc7d43e02123 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:03.620943 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e4271f-2b09-4479-b3d9-2aac5ee2fb22 None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:03.621251 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e4271f-2b09-4479-b3d9-2aac5ee2fb22 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:03.621481 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e4271f-2b09-4479-b3d9-2aac5ee2fb22 None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:03.623165 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 358/705] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 01:00:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:00:03.649142 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c740e596-05c4-43ca-9f21-31d87e3c8b28 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:03.649438 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c740e596-05c4-43ca-9f21-31d87e3c8b28 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:03.649673 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c740e596-05c4-43ca-9f21-31d87e3c8b28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:03.682927 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-c740e596-05c4-43ca-9f21-31d87e3c8b28 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:00:03.684238 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-c740e596-05c4-43ca-9f21-31d87e3c8b28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:00:03.696015 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:03.702638 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5131790c-aea9-48e9-9001-fc7d43e02123 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:03.741936 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881cf053-afbf-4465-9203-fe71677beb43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:03.742673 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881cf053-afbf-4465-9203-fe71677beb43 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:03.742853 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881cf053-afbf-4465-9203-fe71677beb43 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:03.743052 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881cf053-afbf-4465-9203-fe71677beb43 None admin] PATH_INFO: `/v3/services` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:03.743709 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881cf053-afbf-4465-9203-fe71677beb43 None admin] RBAC: Adding query filter params (type=network) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:00:03.744003 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881cf053-afbf-4465-9203-fe71677beb43 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:03.745366 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881cf053-afbf-4465-9203-fe71677beb43 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:03.755590 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 348/706] 10.222.0.79 () {56 vars in 1112 bytes} [Tue Aug 30 01:00:03 2022] GET /identity/v3/services?type=network => generated 124 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:00:03.815147 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 359/707] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 01:00:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 01:00:04.185771 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881cf053-afbf-4465-9203-fe71677beb43 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:04.301097 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881cf053-afbf-4465-9203-fe71677beb43 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:04.345227 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1112cd-f5c5-4d94-a084-d588abf8c893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:04.345865 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1112cd-f5c5-4d94-a084-d588abf8c893 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:04.346144 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1112cd-f5c5-4d94-a084-d588abf8c893 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:04.346416 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1112cd-f5c5-4d94-a084-d588abf8c893 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:04.360416 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1112cd-f5c5-4d94-a084-d588abf8c893 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 01:00:04.365417 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application [None req-2d1112cd-f5c5-4d94-a084-d588abf8c893 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 01:00:04.365417 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:00:04.365417 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:00:04.365417 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:00:04.365417 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:00:04.365417 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:00:04.365417 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:00:04.365417 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:00:04.365417 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:00:04.365417 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:00:04.365417 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:00:04.365417 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:00:04.365417 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 01:00:04.365417 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 01:00:04.365417 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 01:00:04.365417 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 01:00:04.367498 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 01:00:04.367498 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 01:00:04.367498 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 01:00:04.367498 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 01:00:04.367498 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:00:04.367498 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:00:04.367498 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:00:04.367498 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:00:04.367498 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:00:04.367498 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:00:04.367498 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:00:04.367498 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application with Lock( Aug 30 01:00:04.367498 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:00:04.367498 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:00:04.367498 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:00:04.367498 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:00:04.369442 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:00:04.369442 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:00:04.369442 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:00:04.369442 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:00:04.369442 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 01:00:04.369442 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 01:00:04.369442 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 01:00:04.369442 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 01:00:04.369442 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 01:00:04.369442 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 01:00:04.369442 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 01:00:04.369442 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Aug 30 01:00:04.370927 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 349/708] 10.222.0.79 () {56 vars in 1096 bytes} [Tue Aug 30 01:00:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:00:04.377733 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c740e596-05c4-43ca-9f21-31d87e3c8b28 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:04.514818 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c740e596-05c4-43ca-9f21-31d87e3c8b28 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:04.552216 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:04.564995 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3269e3-40e4-4724-a8a6-1867d32ca3d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:04.565613 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3269e3-40e4-4724-a8a6-1867d32ca3d1 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:04.565887 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3269e3-40e4-4724-a8a6-1867d32ca3d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:04.566157 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3269e3-40e4-4724-a8a6-1867d32ca3d1 None admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:04.566831 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3269e3-40e4-4724-a8a6-1867d32ca3d1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:00:04.567408 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3269e3-40e4-4724-a8a6-1867d32ca3d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:04.568768 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3269e3-40e4-4724-a8a6-1867d32ca3d1 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:04.580537 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 360/709] 10.222.0.79 () {56 vars in 1099 bytes} [Tue Aug 30 01:00:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:00:04.586226 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1112cd-f5c5-4d94-a084-d588abf8c893 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:04.621399 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:04.681001 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c446dc-0dc9-4c86-9b2b-a64dcf7a147b None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:04.681418 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c446dc-0dc9-4c86-9b2b-a64dcf7a147b None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:04.681821 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c446dc-0dc9-4c86-9b2b-a64dcf7a147b None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:04.684247 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 361/710] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 01:00:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:00:04.690649 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da17a44a-472a-485d-ac13-0d5112d0fd20 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:04.691071 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da17a44a-472a-485d-ac13-0d5112d0fd20 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:04.691544 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da17a44a-472a-485d-ac13-0d5112d0fd20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:04.724200 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-da17a44a-472a-485d-ac13-0d5112d0fd20 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:00:04.725416 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-da17a44a-472a-485d-ac13-0d5112d0fd20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:00:04.741015 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1112cd-f5c5-4d94-a084-d588abf8c893 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:04.784490 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf613b93-ed16-4e9b-91a7-25750aa0a76e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:04.785248 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf613b93-ed16-4e9b-91a7-25750aa0a76e None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:04.785407 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf613b93-ed16-4e9b-91a7-25750aa0a76e None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:04.785554 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf613b93-ed16-4e9b-91a7-25750aa0a76e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:04.812225 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf613b93-ed16-4e9b-91a7-25750aa0a76e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:04.814062 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf613b93-ed16-4e9b-91a7-25750aa0a76e None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:04.824048 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 362/711] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 01:00:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 01:00:04.839144 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application [None req-bf613b93-ed16-4e9b-91a7-25750aa0a76e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:00:04.839144 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:00:04.839144 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:00:04.839144 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:00:04.839144 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:00:04.839144 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:00:04.839144 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:00:04.839144 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:00:04.839144 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:00:04.839144 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:00:04.839144 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:00:04.839144 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:00:04.839144 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 01:00:04.839144 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 01:00:04.839144 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 01:00:04.839144 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 01:00:04.840103 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:00:04.840103 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:00:04.840103 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:00:04.840103 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:00:04.840103 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:00:04.840103 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:00:04.840103 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:00:04.840103 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application with Lock( Aug 30 01:00:04.840103 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:00:04.840103 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:00:04.840103 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:00:04.840103 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:00:04.840103 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:00:04.840103 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:00:04.840103 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:00:04.840103 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:00:04.840103 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 01:00:04.841994 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 01:00:04.841994 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:00:04.841994 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Aug 30 01:00:04.844040 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 350/712] 10.222.0.79 () {56 vars in 1108 bytes} [Tue Aug 30 01:00:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:00:04.849801 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da17a44a-472a-485d-ac13-0d5112d0fd20 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:04.994930 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da17a44a-472a-485d-ac13-0d5112d0fd20 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:05.018655 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:05.047451 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08012963-8c03-497a-b759-b5132f976b83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:05.048392 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08012963-8c03-497a-b759-b5132f976b83 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:05.048894 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08012963-8c03-497a-b759-b5132f976b83 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:05.049392 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08012963-8c03-497a-b759-b5132f976b83 None admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:05.050242 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08012963-8c03-497a-b759-b5132f976b83 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:00:05.050753 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08012963-8c03-497a-b759-b5132f976b83 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:05.052347 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08012963-8c03-497a-b759-b5132f976b83 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:05.064941 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 363/713] 10.222.0.79 () {56 vars in 1109 bytes} [Tue Aug 30 01:00:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:00:05.070622 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf613b93-ed16-4e9b-91a7-25750aa0a76e None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:05.101562 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9008be-a9a7-42bd-9f17-3fbb0d242c2a None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:05.102183 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9008be-a9a7-42bd-9f17-3fbb0d242c2a None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:05.102657 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9008be-a9a7-42bd-9f17-3fbb0d242c2a None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:05.104531 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 364/714] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 01:00:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 01:00:05.105441 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9008be-a9a7-42bd-9f17-3fbb0d242c2a None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:05.161237 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:05.191683 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf613b93-ed16-4e9b-91a7-25750aa0a76e None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:05.224299 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9008be-a9a7-42bd-9f17-3fbb0d242c2a None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:05.242132 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c899f70-3fdd-4f97-b324-3f0aba9e8131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:05.242776 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c899f70-3fdd-4f97-b324-3f0aba9e8131 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:05.243327 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c899f70-3fdd-4f97-b324-3f0aba9e8131 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:05.243599 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c899f70-3fdd-4f97-b324-3f0aba9e8131 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:05.252345 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c899f70-3fdd-4f97-b324-3f0aba9e8131 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:05.253801 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c899f70-3fdd-4f97-b324-3f0aba9e8131 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:05.262956 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6f2f57-b4ed-4e19-a1a2-81a06f461c6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:05.263589 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6f2f57-b4ed-4e19-a1a2-81a06f461c6d None admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:05.263870 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6f2f57-b4ed-4e19-a1a2-81a06f461c6d None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:05.264174 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6f2f57-b4ed-4e19-a1a2-81a06f461c6d None admin] PATH_INFO: `/v3/services` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:05.264833 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6f2f57-b4ed-4e19-a1a2-81a06f461c6d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:05.266161 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application [None req-2c899f70-3fdd-4f97-b324-3f0aba9e8131 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 30 01:00:05.266161 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:00:05.266161 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:00:05.266161 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:00:05.266161 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:00:05.266161 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:00:05.266161 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:00:05.266161 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:00:05.266161 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:00:05.266161 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:00:05.266161 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:00:05.266161 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:00:05.266161 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 01:00:05.266161 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 01:00:05.266161 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 01:00:05.266161 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 01:00:05.267121 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:00:05.267121 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:00:05.267121 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 01:00:05.267121 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 01:00:05.267121 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 01:00:05.267121 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 01:00:05.267121 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:00:05.267121 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:00:05.267121 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:00:05.267121 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:00:05.267121 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:00:05.267121 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application with Lock( Aug 30 01:00:05.267121 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:00:05.267121 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:00:05.267121 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:00:05.267121 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:00:05.267121 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:00:05.267121 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:00:05.268257 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:00:05.268257 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:00:05.268257 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 01:00:05.268257 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 01:00:05.268257 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 01:00:05.268257 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 01:00:05.268257 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 01:00:05.268257 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 01:00:05.268257 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 30 01:00:05.268257 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Aug 30 01:00:05.268895 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6f2f57-b4ed-4e19-a1a2-81a06f461c6d None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:05.271955 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 351/715] 10.222.0.79 () {56 vars in 1093 bytes} [Tue Aug 30 01:00:05 2022] GET /identity/v3/users/nova => generated 82 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:00:05.273291 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d790103-8350-4ad9-8189-adb748ce8d5b None None] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:05.273573 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d790103-8350-4ad9-8189-adb748ce8d5b None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:05.273958 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d790103-8350-4ad9-8189-adb748ce8d5b None None] PATH_INFO: `/` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:05.275385 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 352/716] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 01:00:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:00:05.280163 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fc3714-b7e4-4e3e-a826-9101ec7b9f53 None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:05.280547 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fc3714-b7e4-4e3e-a826-9101ec7b9f53 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:05.280823 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fc3714-b7e4-4e3e-a826-9101ec7b9f53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:05.285501 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 365/717] 10.222.0.79 () {60 vars in 1141 bytes} [Tue Aug 30 01:00:05 2022] POST /identity/v3/services => generated 251 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:00:05.296268 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6f2f57-b4ed-4e19-a1a2-81a06f461c6d None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:05.300445 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-b2fc3714-b7e4-4e3e-a826-9101ec7b9f53 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:00:05.302006 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-b2fc3714-b7e4-4e3e-a826-9101ec7b9f53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:00:05.345899 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:05.407304 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 353/718] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 01:00:05 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 01:00:05.409094 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da42b8a1-ffe8-4ece-8af3-591033083d99 None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:05.409594 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da42b8a1-ffe8-4ece-8af3-591033083d99 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:05.410062 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da42b8a1-ffe8-4ece-8af3-591033083d99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:05.423998 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6f2f57-b4ed-4e19-a1a2-81a06f461c6d None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:05.445748 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-da42b8a1-ffe8-4ece-8af3-591033083d99 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:00:05.447263 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-da42b8a1-ffe8-4ece-8af3-591033083d99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:00:05.468452 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e62e01-33de-4367-8043-7ca929f6a61b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:05.469058 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e62e01-33de-4367-8043-7ca929f6a61b None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:05.469332 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e62e01-33de-4367-8043-7ca929f6a61b None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:05.469597 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e62e01-33de-4367-8043-7ca929f6a61b None admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:05.470322 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e62e01-33de-4367-8043-7ca929f6a61b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:00:05.470620 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e62e01-33de-4367-8043-7ca929f6a61b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:05.472284 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e62e01-33de-4367-8043-7ca929f6a61b None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:05.489959 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 366/719] 10.222.0.79 () {56 vars in 1133 bytes} [Tue Aug 30 01:00:05 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:00:05.495303 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e62e01-33de-4367-8043-7ca929f6a61b None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:05.518092 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:05.531862 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 354/720] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 01:00:05 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 01:00:05.631077 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e62e01-33de-4367-8043-7ca929f6a61b None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:05.640100 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:05.668198 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0db65e-d085-456c-b2b4-39f162436598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:05.669433 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0db65e-d085-456c-b2b4-39f162436598 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:05.669722 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0db65e-d085-456c-b2b4-39f162436598 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:05.669996 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0db65e-d085-456c-b2b4-39f162436598 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:05.742409 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da42b8a1-ffe8-4ece-8af3-591033083d99 None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:05.742629 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0db65e-d085-456c-b2b4-39f162436598 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:05.744159 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0db65e-d085-456c-b2b4-39f162436598 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:05.857480 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 367/721] 10.222.0.79 () {58 vars in 1282 bytes} [Tue Aug 30 01:00:05 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 30 01:00:05.857480 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:05.857932 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0db65e-d085-456c-b2b4-39f162436598 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:05.914451 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da42b8a1-ffe8-4ece-8af3-591033083d99 None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:05.953481 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e2b4cc-60d1-42a3-896b-44b89ba88510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:05.954469 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e2b4cc-60d1-42a3-896b-44b89ba88510 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:05.954950 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e2b4cc-60d1-42a3-896b-44b89ba88510 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:05.955457 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e2b4cc-60d1-42a3-896b-44b89ba88510 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:05.963063 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0db65e-d085-456c-b2b4-39f162436598 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:05.967237 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e2b4cc-60d1-42a3-896b-44b89ba88510 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 01:00:05.972430 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application [None req-47e2b4cc-60d1-42a3-896b-44b89ba88510 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 01:00:05.972430 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:00:05.972430 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:00:05.972430 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:00:05.972430 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:00:05.972430 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:00:05.972430 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:00:05.972430 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:00:05.972430 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:00:05.972430 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:00:05.972430 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:00:05.972430 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:00:05.972430 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 01:00:05.972430 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 01:00:05.972430 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 01:00:05.972430 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 01:00:05.973359 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 01:00:05.973359 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 01:00:05.973359 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 01:00:05.973359 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 01:00:05.973359 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:00:05.973359 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:00:05.973359 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:00:05.973359 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:00:05.973359 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:00:05.973359 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:00:05.973359 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:00:05.973359 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application with Lock( Aug 30 01:00:05.973359 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:00:05.973359 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:00:05.973359 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:00:05.973359 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:00:05.974184 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:00:05.974184 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:00:05.974184 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:00:05.974184 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:00:05.974184 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 01:00:05.974184 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 01:00:05.974184 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 01:00:05.974184 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 01:00:05.974184 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 01:00:05.974184 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 01:00:05.974184 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 01:00:05.974184 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Aug 30 01:00:05.976761 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 355/722] 10.222.0.79 () {56 vars in 1102 bytes} [Tue Aug 30 01:00:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:00:05.977787 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e2b4cc-60d1-42a3-896b-44b89ba88510 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:06.000843 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850a8649-cbee-49e8-a272-d14b3e9976b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:06.001472 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850a8649-cbee-49e8-a272-d14b3e9976b9 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:06.001751 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850a8649-cbee-49e8-a272-d14b3e9976b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:06.002023 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850a8649-cbee-49e8-a272-d14b3e9976b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:06.013758 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850a8649-cbee-49e8-a272-d14b3e9976b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:06.015464 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850a8649-cbee-49e8-a272-d14b3e9976b9 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:06.030868 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-850a8649-cbee-49e8-a272-d14b3e9976b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:00:06.030868 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:00:06.030868 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:00:06.030868 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:00:06.030868 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:00:06.030868 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:00:06.030868 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:00:06.030868 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:00:06.030868 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:00:06.030868 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:00:06.030868 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:00:06.030868 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:00:06.030868 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 01:00:06.030868 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 01:00:06.030868 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 01:00:06.030868 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 01:00:06.031929 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:00:06.031929 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:00:06.031929 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:00:06.031929 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:00:06.031929 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:00:06.031929 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:00:06.031929 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:00:06.031929 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Aug 30 01:00:06.031929 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:00:06.031929 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:00:06.031929 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:00:06.031929 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:00:06.031929 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:00:06.031929 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:00:06.031929 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:00:06.031929 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:00:06.031929 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 01:00:06.032836 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 01:00:06.032836 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:00:06.032836 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Aug 30 01:00:06.032836 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 368/723] 10.222.0.79 () {56 vars in 1108 bytes} [Tue Aug 30 01:00:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:00:06.033071 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850a8649-cbee-49e8-a272-d14b3e9976b9 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:06.038880 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:06.095540 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e2b4cc-60d1-42a3-896b-44b89ba88510 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:06.127643 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:06.133606 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e54a162-7ca7-418a-9af5-1a0fba5ddf8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:06.134551 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e54a162-7ca7-418a-9af5-1a0fba5ddf8b None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:06.135034 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e54a162-7ca7-418a-9af5-1a0fba5ddf8b None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:06.135531 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e54a162-7ca7-418a-9af5-1a0fba5ddf8b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:06.146867 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e54a162-7ca7-418a-9af5-1a0fba5ddf8b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 01:00:06.152676 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application [None req-0e54a162-7ca7-418a-9af5-1a0fba5ddf8b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 01:00:06.152676 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:00:06.152676 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:00:06.152676 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:00:06.152676 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:00:06.152676 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:00:06.152676 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:00:06.152676 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:00:06.152676 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:00:06.152676 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:00:06.152676 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:00:06.152676 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:00:06.152676 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 01:00:06.152676 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 01:00:06.152676 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 01:00:06.152676 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 01:00:06.153652 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 01:00:06.153652 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 01:00:06.153652 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 01:00:06.153652 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 01:00:06.153652 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:00:06.153652 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:00:06.153652 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:00:06.153652 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:00:06.153652 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:00:06.153652 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:00:06.153652 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:00:06.153652 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application with Lock( Aug 30 01:00:06.153652 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:00:06.153652 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:00:06.153652 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:00:06.153652 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:00:06.154489 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:00:06.154489 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:00:06.154489 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:00:06.154489 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:00:06.154489 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 01:00:06.154489 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 01:00:06.154489 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 01:00:06.154489 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 01:00:06.154489 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 01:00:06.154489 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 01:00:06.154489 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 01:00:06.154489 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Aug 30 01:00:06.161450 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850a8649-cbee-49e8-a272-d14b3e9976b9 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:06.162192 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 356/724] 10.222.0.79 () {56 vars in 1096 bytes} [Tue Aug 30 01:00:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:00:06.163330 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e54a162-7ca7-418a-9af5-1a0fba5ddf8b None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:06.203788 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9894fed6-88ed-4d05-b9f5-d2f6fc8ed1fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:06.204315 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9894fed6-88ed-4d05-b9f5-d2f6fc8ed1fa None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:06.204587 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9894fed6-88ed-4d05-b9f5-d2f6fc8ed1fa None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:06.204850 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9894fed6-88ed-4d05-b9f5-d2f6fc8ed1fa None admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:06.205510 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9894fed6-88ed-4d05-b9f5-d2f6fc8ed1fa None admin] RBAC: Adding query filter params (name=service) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:00:06.205806 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9894fed6-88ed-4d05-b9f5-d2f6fc8ed1fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:06.207190 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9894fed6-88ed-4d05-b9f5-d2f6fc8ed1fa None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:06.219279 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 369/725] 10.222.0.79 () {56 vars in 1103 bytes} [Tue Aug 30 01:00:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:00:06.220334 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9894fed6-88ed-4d05-b9f5-d2f6fc8ed1fa None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:06.278578 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e54a162-7ca7-418a-9af5-1a0fba5ddf8b None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:06.289525 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:06.315960 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83eb4363-d500-4e61-8859-7a133d64b2d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:06.316563 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eb4363-d500-4e61-8859-7a133d64b2d9 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:06.316943 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eb4363-d500-4e61-8859-7a133d64b2d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:06.317363 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eb4363-d500-4e61-8859-7a133d64b2d9 None admin] PATH_INFO: `/v3/domains` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:06.317993 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83eb4363-d500-4e61-8859-7a133d64b2d9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:00:06.318532 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83eb4363-d500-4e61-8859-7a133d64b2d9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:06.319692 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83eb4363-d500-4e61-8859-7a133d64b2d9 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:06.327262 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9894fed6-88ed-4d05-b9f5-d2f6fc8ed1fa None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:06.336712 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 357/726] 10.222.0.79 () {56 vars in 1109 bytes} [Tue Aug 30 01:00:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:00:06.336712 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc268d6b-6b11-41bb-9be2-c3b63840ecee None None] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:06.336712 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc268d6b-6b11-41bb-9be2-c3b63840ecee None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:06.336712 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc268d6b-6b11-41bb-9be2-c3b63840ecee None None] PATH_INFO: `/` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:06.336712 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 358/727] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 01:00:06 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:00:06.336712 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc268d6b-6b11-41bb-9be2-c3b63840ecee None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:06.344287 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:06.370542 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29d5ce7-6296-4883-a639-bcc0eeaacd8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:06.371229 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29d5ce7-6296-4883-a639-bcc0eeaacd8b None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:06.371459 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29d5ce7-6296-4883-a639-bcc0eeaacd8b None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:06.371872 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29d5ce7-6296-4883-a639-bcc0eeaacd8b None admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:06.372990 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29d5ce7-6296-4883-a639-bcc0eeaacd8b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:00:06.373298 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29d5ce7-6296-4883-a639-bcc0eeaacd8b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:06.374656 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29d5ce7-6296-4883-a639-bcc0eeaacd8b None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:06.383188 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 370/728] 10.222.0.79 () {56 vars in 1099 bytes} [Tue Aug 30 01:00:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:00:06.383992 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29d5ce7-6296-4883-a639-bcc0eeaacd8b None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:06.458322 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc268d6b-6b11-41bb-9be2-c3b63840ecee None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:06.494123 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29d5ce7-6296-4883-a639-bcc0eeaacd8b None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:06.497635 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6e7f9d-fad2-4060-b211-f9107449243b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:06.497635 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6e7f9d-fad2-4060-b211-f9107449243b None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:06.497837 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6e7f9d-fad2-4060-b211-f9107449243b None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:06.498107 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6e7f9d-fad2-4060-b211-f9107449243b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:06.509033 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6e7f9d-fad2-4060-b211-f9107449243b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:06.510527 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6e7f9d-fad2-4060-b211-f9107449243b None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:06.526631 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application [None req-8d6e7f9d-fad2-4060-b211-f9107449243b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:00:06.526631 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:00:06.526631 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:00:06.526631 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:00:06.526631 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:00:06.526631 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:00:06.526631 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:00:06.526631 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:00:06.526631 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:00:06.526631 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:00:06.526631 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:00:06.526631 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:00:06.526631 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 01:00:06.526631 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 01:00:06.526631 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 01:00:06.526631 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 01:00:06.527674 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:00:06.527674 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:00:06.527674 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:00:06.527674 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:00:06.527674 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:00:06.527674 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:00:06.527674 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:00:06.527674 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application with Lock( Aug 30 01:00:06.527674 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:00:06.527674 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:00:06.527674 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:00:06.527674 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:00:06.527674 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:00:06.527674 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:00:06.527674 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:00:06.527674 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:00:06.527674 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 01:00:06.529742 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 01:00:06.529742 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:00:06.529742 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Aug 30 01:00:06.529742 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 359/729] 10.222.0.79 () {56 vars in 1108 bytes} [Tue Aug 30 01:00:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:00:06.529742 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862d5aa7-8c35-4ff8-8d6b-a27d0e933937 None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:06.530038 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862d5aa7-8c35-4ff8-8d6b-a27d0e933937 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:06.530105 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862d5aa7-8c35-4ff8-8d6b-a27d0e933937 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:06.538021 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7028f9-a97e-4945-94a5-f89bf8ff734e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:06.538718 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7028f9-a97e-4945-94a5-f89bf8ff734e None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:06.539032 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7028f9-a97e-4945-94a5-f89bf8ff734e None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:06.539382 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7028f9-a97e-4945-94a5-f89bf8ff734e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:06.547760 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7028f9-a97e-4945-94a5-f89bf8ff734e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:06.549162 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7028f9-a97e-4945-94a5-f89bf8ff734e None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:06.550658 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-862d5aa7-8c35-4ff8-8d6b-a27d0e933937 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:00:06.552088 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-862d5aa7-8c35-4ff8-8d6b-a27d0e933937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:00:06.562383 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-4d7028f9-a97e-4945-94a5-f89bf8ff734e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 01:00:06.562383 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:00:06.562383 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:00:06.562383 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:00:06.562383 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:00:06.562383 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:00:06.562383 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:00:06.562383 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:00:06.562383 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:00:06.562383 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:00:06.562383 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:00:06.562383 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:00:06.562383 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 01:00:06.562383 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 01:00:06.562383 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 01:00:06.563498 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 01:00:06.563498 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:00:06.563498 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:00:06.563498 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:00:06.563498 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:00:06.563498 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:00:06.563498 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:00:06.563498 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:00:06.563498 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Aug 30 01:00:06.563498 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:00:06.563498 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:00:06.563498 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:00:06.563498 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:00:06.563498 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:00:06.563498 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:00:06.563498 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:00:06.563498 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:00:06.564591 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 01:00:06.564591 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 01:00:06.564591 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 01:00:06.564591 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 01:00:06.564591 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 01:00:06.564591 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 01:00:06.564591 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 01:00:06.564591 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Aug 30 01:00:06.564591 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 371/730] 10.222.0.79 () {56 vars in 1111 bytes} [Tue Aug 30 01:00:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:00:06.564591 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7028f9-a97e-4945-94a5-f89bf8ff734e None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:06.577620 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:06.603308 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:06.643298 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 360/731] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 01:00:06 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 01:00:06.644181 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862d5aa7-8c35-4ff8-8d6b-a27d0e933937 None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:06.694119 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7028f9-a97e-4945-94a5-f89bf8ff734e None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:06.734974 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74960e49-b304-428e-a86f-9013e1db771f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:06.736010 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74960e49-b304-428e-a86f-9013e1db771f None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:06.736500 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74960e49-b304-428e-a86f-9013e1db771f None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:06.737033 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74960e49-b304-428e-a86f-9013e1db771f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:06.749251 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74960e49-b304-428e-a86f-9013e1db771f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:06.750980 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74960e49-b304-428e-a86f-9013e1db771f None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:06.766856 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-74960e49-b304-428e-a86f-9013e1db771f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:00:06.766856 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:00:06.766856 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:00:06.766856 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:00:06.766856 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:00:06.766856 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:00:06.766856 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:00:06.766856 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:00:06.766856 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:00:06.766856 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:00:06.766856 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:00:06.766856 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:00:06.766856 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 01:00:06.766856 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 01:00:06.766856 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 01:00:06.766856 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 01:00:06.767929 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:00:06.767929 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:00:06.767929 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:00:06.767929 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:00:06.767929 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:00:06.767929 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:00:06.767929 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:00:06.767929 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Aug 30 01:00:06.767929 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:00:06.767929 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:00:06.767929 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:00:06.767929 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:00:06.767929 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:00:06.767929 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:00:06.767929 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:00:06.767929 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:00:06.767929 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 01:00:06.768880 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 01:00:06.768880 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:00:06.768880 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Aug 30 01:00:06.770932 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 372/732] 10.222.0.79 () {56 vars in 1108 bytes} [Tue Aug 30 01:00:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:00:06.771954 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74960e49-b304-428e-a86f-9013e1db771f None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:06.781464 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862d5aa7-8c35-4ff8-8d6b-a27d0e933937 None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:06.833954 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42936430-02f2-4822-9fe2-0f76ee2f549b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:06.834620 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42936430-02f2-4822-9fe2-0f76ee2f549b None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:06.835161 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42936430-02f2-4822-9fe2-0f76ee2f549b None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:06.835437 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42936430-02f2-4822-9fe2-0f76ee2f549b None admin] PATH_INFO: `/v3/domains` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:06.836074 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42936430-02f2-4822-9fe2-0f76ee2f549b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:00:06.836369 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42936430-02f2-4822-9fe2-0f76ee2f549b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:06.838111 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42936430-02f2-4822-9fe2-0f76ee2f549b None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:06.854226 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 361/733] 10.222.0.79 () {56 vars in 1109 bytes} [Tue Aug 30 01:00:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:00:06.855177 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42936430-02f2-4822-9fe2-0f76ee2f549b None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:06.874817 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:06.876716 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:06.896332 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74960e49-b304-428e-a86f-9013e1db771f None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:06.935180 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d3eca9-2ac2-449b-834a-3ef1fc3165af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:06.935877 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d3eca9-2ac2-449b-834a-3ef1fc3165af None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:06.936229 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d3eca9-2ac2-449b-834a-3ef1fc3165af None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:06.936571 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d3eca9-2ac2-449b-834a-3ef1fc3165af None admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:06.937337 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d3eca9-2ac2-449b-834a-3ef1fc3165af None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:00:06.937711 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d3eca9-2ac2-449b-834a-3ef1fc3165af None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:06.939212 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d3eca9-2ac2-449b-834a-3ef1fc3165af None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:06.955193 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 373/734] 10.222.0.79 () {56 vars in 1148 bytes} [Tue Aug 30 01:00:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:00:06.955193 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d3eca9-2ac2-449b-834a-3ef1fc3165af None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:06.986020 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42936430-02f2-4822-9fe2-0f76ee2f549b None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:07.024227 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ac00a0-709e-406c-8436-0aae7ead44eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:07.024989 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ac00a0-709e-406c-8436-0aae7ead44eb None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:07.025360 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ac00a0-709e-406c-8436-0aae7ead44eb None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:07.025719 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ac00a0-709e-406c-8436-0aae7ead44eb None admin] PATH_INFO: `/v3/domains` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:07.026427 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ac00a0-709e-406c-8436-0aae7ead44eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:00:07.026791 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ac00a0-709e-406c-8436-0aae7ead44eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:07.029647 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ac00a0-709e-406c-8436-0aae7ead44eb None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:07.041404 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 362/735] 10.222.0.79 () {56 vars in 1109 bytes} [Tue Aug 30 01:00:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:00:07.043074 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ac00a0-709e-406c-8436-0aae7ead44eb None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:07.067733 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d3eca9-2ac2-449b-834a-3ef1fc3165af None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:07.105561 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76eeab40-d396-4405-97b0-583dd5459fd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:07.106311 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eeab40-d396-4405-97b0-583dd5459fd9 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:07.106649 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eeab40-d396-4405-97b0-583dd5459fd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:07.107008 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eeab40-d396-4405-97b0-583dd5459fd9 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:07.114123 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76eeab40-d396-4405-97b0-583dd5459fd9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:07.115651 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76eeab40-d396-4405-97b0-583dd5459fd9 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:07.118307 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:07.130387 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-76eeab40-d396-4405-97b0-583dd5459fd9 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 01:00:07.130387 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:00:07.130387 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:00:07.130387 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:00:07.130387 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:00:07.130387 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:00:07.130387 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:00:07.130387 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:00:07.130387 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:00:07.130387 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:00:07.130387 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:00:07.130387 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:00:07.130387 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 01:00:07.130387 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 01:00:07.130387 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 01:00:07.130387 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 01:00:07.131586 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:00:07.131586 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:00:07.131586 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 01:00:07.131586 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 01:00:07.131586 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 01:00:07.131586 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 01:00:07.131586 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:00:07.131586 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:00:07.131586 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:00:07.131586 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:00:07.131586 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:00:07.131586 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Aug 30 01:00:07.131586 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:00:07.131586 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:00:07.131586 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:00:07.131586 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:00:07.131586 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:00:07.131586 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:00:07.132627 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:00:07.132627 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:00:07.132627 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 01:00:07.132627 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 01:00:07.132627 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 01:00:07.132627 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 01:00:07.132627 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 01:00:07.132627 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 01:00:07.132627 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 01:00:07.132627 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Aug 30 01:00:07.132627 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 374/736] 10.222.0.79 () {56 vars in 1117 bytes} [Tue Aug 30 01:00:06 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:00:07.132627 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76eeab40-d396-4405-97b0-583dd5459fd9 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:07.138400 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:07.156690 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ac00a0-709e-406c-8436-0aae7ead44eb None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:07.194847 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac28c14-bdd3-4e61-b550-cd7513df907a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:07.195490 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac28c14-bdd3-4e61-b550-cd7513df907a None admin] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:07.195770 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac28c14-bdd3-4e61-b550-cd7513df907a None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:07.196044 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac28c14-bdd3-4e61-b550-cd7513df907a None admin] PATH_INFO: `/v3/services` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:07.196723 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac28c14-bdd3-4e61-b550-cd7513df907a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:07.198503 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac28c14-bdd3-4e61-b550-cd7513df907a None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:07.217098 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 363/737] 10.222.0.79 () {60 vars in 1141 bytes} [Tue Aug 30 01:00:07 2022] POST /identity/v3/services => generated 240 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:00:07.217916 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac28c14-bdd3-4e61-b550-cd7513df907a None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:07.279450 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76eeab40-d396-4405-97b0-583dd5459fd9 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:07.353028 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038709a5-cdc8-485f-b62c-1e25ea6ddfa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:07.353520 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038709a5-cdc8-485f-b62c-1e25ea6ddfa7 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:07.353854 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038709a5-cdc8-485f-b62c-1e25ea6ddfa7 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:07.354192 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038709a5-cdc8-485f-b62c-1e25ea6ddfa7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:07.354998 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038709a5-cdc8-485f-b62c-1e25ea6ddfa7 None admin] RBAC: Adding query filter params (role.id=d14c3070c9184d76a7b23df69bd3db07, scope.project.id=0eec3a73673e45dc881de586b9b0fbbb, user.id=6480b2f14c37474c89df9fba48f7cd91) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:00:07.355396 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038709a5-cdc8-485f-b62c-1e25ea6ddfa7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:07.357385 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038709a5-cdc8-485f-b62c-1e25ea6ddfa7 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:07.367549 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 375/738] 10.222.0.79 () {56 vars in 1374 bytes} [Tue Aug 30 01:00:07 2022] GET /identity/v3/role_assignments?user.id=6480b2f14c37474c89df9fba48f7cd91&scope.project.id=0eec3a73673e45dc881de586b9b0fbbb&role.id=d14c3070c9184d76a7b23df69bd3db07 => generated 259 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:00:07.368609 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038709a5-cdc8-485f-b62c-1e25ea6ddfa7 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:07.377460 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac28c14-bdd3-4e61-b550-cd7513df907a None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:07.421123 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:07.428661 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5fccc8-c479-4139-935b-a04dbe400240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:07.429816 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5fccc8-c479-4139-935b-a04dbe400240 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:07.430337 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5fccc8-c479-4139-935b-a04dbe400240 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:07.430816 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5fccc8-c479-4139-935b-a04dbe400240 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:07.443872 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:07.444428 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5fccc8-c479-4139-935b-a04dbe400240 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:07.446826 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5fccc8-c479-4139-935b-a04dbe400240 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:07.462614 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application [None req-ad5fccc8-c479-4139-935b-a04dbe400240 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 30 01:00:07.462614 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:00:07.462614 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:00:07.462614 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:00:07.462614 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:00:07.462614 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:00:07.462614 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:00:07.462614 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:00:07.462614 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:00:07.462614 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:00:07.462614 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:00:07.462614 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:00:07.462614 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 01:00:07.462614 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 01:00:07.462614 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 01:00:07.462614 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 01:00:07.463694 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:00:07.463694 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:00:07.463694 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 01:00:07.463694 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 01:00:07.463694 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 01:00:07.463694 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 01:00:07.463694 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:00:07.463694 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:00:07.463694 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:00:07.463694 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:00:07.463694 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:00:07.463694 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application with Lock( Aug 30 01:00:07.463694 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:00:07.463694 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:00:07.463694 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:00:07.463694 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:00:07.463694 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:00:07.463694 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:00:07.464647 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:00:07.464647 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:00:07.464647 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 01:00:07.464647 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 01:00:07.464647 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 01:00:07.464647 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 01:00:07.464647 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 01:00:07.464647 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 01:00:07.464647 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 30 01:00:07.464647 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Aug 30 01:00:07.467670 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 364/739] 10.222.0.79 () {56 vars in 1096 bytes} [Tue Aug 30 01:00:07 2022] GET /identity/v3/users/swift => generated 83 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:00:07.478698 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5fccc8-c479-4139-935b-a04dbe400240 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:07.499140 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038709a5-cdc8-485f-b62c-1e25ea6ddfa7 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:07.548407 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f1d501-c905-44de-b99a-b7223255b2a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:07.549025 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f1d501-c905-44de-b99a-b7223255b2a6 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:07.549354 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f1d501-c905-44de-b99a-b7223255b2a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:07.549630 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f1d501-c905-44de-b99a-b7223255b2a6 None admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:07.550372 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f1d501-c905-44de-b99a-b7223255b2a6 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:00:07.550672 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f1d501-c905-44de-b99a-b7223255b2a6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:07.552134 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f1d501-c905-44de-b99a-b7223255b2a6 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:07.572490 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 376/740] 10.222.0.79 () {56 vars in 1149 bytes} [Tue Aug 30 01:00:07 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:00:07.573767 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf86afdf-200e-49e9-8abf-201e820656a5 None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:07.574065 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf86afdf-200e-49e9-8abf-201e820656a5 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:07.574321 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf86afdf-200e-49e9-8abf-201e820656a5 None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:07.583485 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 377/741] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 01:00:07 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:00:07.584652 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf86afdf-200e-49e9-8abf-201e820656a5 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:07.625476 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5fccc8-c479-4139-935b-a04dbe400240 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:07.672581 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059d3c41-817c-4c27-be7a-0ed144ce6d92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:07.673191 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059d3c41-817c-4c27-be7a-0ed144ce6d92 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:07.673465 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059d3c41-817c-4c27-be7a-0ed144ce6d92 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:07.673730 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059d3c41-817c-4c27-be7a-0ed144ce6d92 None admin] PATH_INFO: `/v3/users` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:07.674460 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059d3c41-817c-4c27-be7a-0ed144ce6d92 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:00:07.674764 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059d3c41-817c-4c27-be7a-0ed144ce6d92 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:07.676534 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059d3c41-817c-4c27-be7a-0ed144ce6d92 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:07.700871 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 365/742] 10.222.0.79 () {56 vars in 1135 bytes} [Tue Aug 30 01:00:07 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:00:07.704300 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf86afdf-200e-49e9-8abf-201e820656a5 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:07.707341 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d32955-6bc9-4643-87fb-7b7b1d302b10 None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:07.707810 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d32955-6bc9-4643-87fb-7b7b1d302b10 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:07.708227 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d32955-6bc9-4643-87fb-7b7b1d302b10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:07.728535 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-e3d32955-6bc9-4643-87fb-7b7b1d302b10 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:00:07.730835 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-e3d32955-6bc9-4643-87fb-7b7b1d302b10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:00:07.734062 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:07.751483 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f335ca24-d8c6-45cc-9990-eb6f622b87f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:07.752010 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f335ca24-d8c6-45cc-9990-eb6f622b87f9 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:07.752316 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f335ca24-d8c6-45cc-9990-eb6f622b87f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:07.752868 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f335ca24-d8c6-45cc-9990-eb6f622b87f9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:07.787374 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:07.812764 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 366/743] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 01:00:07 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 01:00:07.813934 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d32955-6bc9-4643-87fb-7b7b1d302b10 None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:07.845273 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f335ca24-d8c6-45cc-9990-eb6f622b87f9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:07.846664 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f335ca24-d8c6-45cc-9990-eb6f622b87f9 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:07.932276 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d32955-6bc9-4643-87fb-7b7b1d302b10 None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:07.951948 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 378/744] 10.222.0.79 () {58 vars in 1282 bytes} [Tue Aug 30 01:00:07 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 01:00:07.957563 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f335ca24-d8c6-45cc-9990-eb6f622b87f9 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:07.974459 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0345be34-5c31-4d8c-bda2-34b437032760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:07.975355 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0345be34-5c31-4d8c-bda2-34b437032760 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:07.975780 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0345be34-5c31-4d8c-bda2-34b437032760 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:07.976195 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0345be34-5c31-4d8c-bda2-34b437032760 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:07.987208 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:08.081848 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:08.118730 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0345be34-5c31-4d8c-bda2-34b437032760 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:08.120217 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0345be34-5c31-4d8c-bda2-34b437032760 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:08.122312 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f335ca24-d8c6-45cc-9990-eb6f622b87f9 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:08.185528 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96037a7-18da-4d3a-be3a-fa4fa2f20c01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:08.187257 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96037a7-18da-4d3a-be3a-fa4fa2f20c01 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:08.187636 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96037a7-18da-4d3a-be3a-fa4fa2f20c01 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:08.188007 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96037a7-18da-4d3a-be3a-fa4fa2f20c01 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:08.201959 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96037a7-18da-4d3a-be3a-fa4fa2f20c01 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:08.204154 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96037a7-18da-4d3a-be3a-fa4fa2f20c01 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:08.264763 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 367/745] 10.222.0.79 () {58 vars in 1282 bytes} [Tue Aug 30 01:00:07 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 01:00:08.265648 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0345be34-5c31-4d8c-bda2-34b437032760 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:08.361138 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-b96037a7-18da-4d3a-be3a-fa4fa2f20c01 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:00:08.361138 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:00:08.361138 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:00:08.361138 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:00:08.361138 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:00:08.361138 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:00:08.361138 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:00:08.361138 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:00:08.361138 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:00:08.361138 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:00:08.361138 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:00:08.361138 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:00:08.361138 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 01:00:08.361138 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 01:00:08.361138 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 01:00:08.361138 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 01:00:08.362164 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:00:08.362164 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:00:08.362164 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:00:08.362164 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:00:08.362164 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:00:08.362164 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:00:08.362164 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:00:08.362164 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Aug 30 01:00:08.362164 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:00:08.362164 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:00:08.362164 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:00:08.362164 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:00:08.362164 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:00:08.362164 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:00:08.362164 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:00:08.362164 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:00:08.362164 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 01:00:08.363098 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 01:00:08.363098 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:00:08.363098 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Aug 30 01:00:08.367342 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 379/746] 10.222.0.79 () {56 vars in 1108 bytes} [Tue Aug 30 01:00:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 405 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 01:00:08.368115 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96037a7-18da-4d3a-be3a-fa4fa2f20c01 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:08.368674 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:08.391829 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0345be34-5c31-4d8c-bda2-34b437032760 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:08.429836 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feab3801-1721-42d8-8472-68f9d72224ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:08.430915 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feab3801-1721-42d8-8472-68f9d72224ff None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:08.431414 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feab3801-1721-42d8-8472-68f9d72224ff None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:08.431825 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feab3801-1721-42d8-8472-68f9d72224ff None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:08.432540 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feab3801-1721-42d8-8472-68f9d72224ff None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:08.434305 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feab3801-1721-42d8-8472-68f9d72224ff None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:08.444387 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application [None req-feab3801-1721-42d8-8472-68f9d72224ff None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 30 01:00:08.444387 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:00:08.444387 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 01:00:08.444387 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 01:00:08.444387 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 01:00:08.444387 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 01:00:08.444387 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 01:00:08.444387 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 01:00:08.444387 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 30 01:00:08.444387 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Aug 30 01:00:08.444387 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 01:00:08.444387 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Aug 30 01:00:08.444387 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:00:08.444387 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:00:08.444387 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:00:08.444387 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:00:08.444387 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:00:08.445592 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:00:08.445592 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:00:08.445592 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:00:08.445592 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:00:08.445592 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:00:08.445592 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:00:08.445592 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 01:00:08.445592 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 01:00:08.445592 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 01:00:08.445592 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 01:00:08.445592 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:00:08.445592 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:00:08.445592 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:00:08.445592 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:00:08.445592 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:00:08.445592 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:00:08.446683 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:00:08.446683 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application with Lock( Aug 30 01:00:08.446683 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:00:08.446683 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:00:08.446683 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:00:08.446683 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:00:08.446683 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:00:08.446683 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:00:08.446683 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:00:08.446683 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:00:08.446683 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 01:00:08.446683 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 01:00:08.446683 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 30 01:00:08.446683 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Aug 30 01:00:08.448002 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:08.455779 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 368/747] 10.222.0.79 () {56 vars in 1129 bytes} [Tue Aug 30 01:00:08 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:00:08.457770 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feab3801-1721-42d8-8472-68f9d72224ff None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:08.476716 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96037a7-18da-4d3a-be3a-fa4fa2f20c01 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:08.513477 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093329b5-506e-446f-897b-a992639ddbe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:08.514105 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093329b5-506e-446f-897b-a992639ddbe4 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:08.514376 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093329b5-506e-446f-897b-a992639ddbe4 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:08.514645 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093329b5-506e-446f-897b-a992639ddbe4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:08.525454 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093329b5-506e-446f-897b-a992639ddbe4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:08.526897 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093329b5-506e-446f-897b-a992639ddbe4 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:08.542766 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-093329b5-506e-446f-897b-a992639ddbe4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:00:08.542766 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:00:08.542766 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:00:08.542766 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:00:08.542766 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:00:08.542766 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:00:08.542766 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:00:08.542766 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:00:08.542766 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:00:08.542766 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:00:08.542766 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:00:08.542766 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:00:08.542766 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 01:00:08.542766 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 01:00:08.542766 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 01:00:08.542766 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 01:00:08.544492 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:00:08.544492 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:00:08.544492 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:00:08.544492 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:00:08.544492 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:00:08.544492 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:00:08.544492 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:00:08.544492 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Aug 30 01:00:08.544492 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:00:08.544492 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:00:08.544492 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:00:08.544492 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:00:08.544492 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:00:08.544492 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:00:08.544492 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:00:08.544492 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:00:08.544492 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 01:00:08.546104 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 01:00:08.546104 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:00:08.546104 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Aug 30 01:00:08.549449 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 380/748] 10.222.0.79 () {56 vars in 1108 bytes} [Tue Aug 30 01:00:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:00:08.550550 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093329b5-506e-446f-897b-a992639ddbe4 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:08.608675 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feab3801-1721-42d8-8472-68f9d72224ff None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:08.646112 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fa60c4-9dcc-450b-9b71-24b282800b88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:08.647001 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fa60c4-9dcc-450b-9b71-24b282800b88 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:08.647473 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fa60c4-9dcc-450b-9b71-24b282800b88 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:08.647915 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fa60c4-9dcc-450b-9b71-24b282800b88 None admin] PATH_INFO: `/v3/domains` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:08.648826 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fa60c4-9dcc-450b-9b71-24b282800b88 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:00:08.649415 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fa60c4-9dcc-450b-9b71-24b282800b88 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:08.650960 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fa60c4-9dcc-450b-9b71-24b282800b88 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:08.664319 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 369/749] 10.222.0.79 () {56 vars in 1109 bytes} [Tue Aug 30 01:00:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:00:08.665536 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fa60c4-9dcc-450b-9b71-24b282800b88 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:08.667576 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093329b5-506e-446f-897b-a992639ddbe4 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:08.695502 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:08.700594 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:08.711331 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4438b75f-c4d7-4e79-a535-d32bb522279a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:08.712759 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4438b75f-c4d7-4e79-a535-d32bb522279a None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:08.713234 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4438b75f-c4d7-4e79-a535-d32bb522279a None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:08.713724 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4438b75f-c4d7-4e79-a535-d32bb522279a None admin] PATH_INFO: `/v3/services` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:08.714576 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4438b75f-c4d7-4e79-a535-d32bb522279a None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:00:08.715098 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4438b75f-c4d7-4e79-a535-d32bb522279a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:08.716854 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4438b75f-c4d7-4e79-a535-d32bb522279a None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:08.727198 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 381/750] 10.222.0.79 () {56 vars in 1124 bytes} [Tue Aug 30 01:00:08 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:00:08.728359 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4438b75f-c4d7-4e79-a535-d32bb522279a None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:08.787337 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fa60c4-9dcc-450b-9b71-24b282800b88 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:08.831945 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcb2392-3087-4265-8f03-5012ee3a1dda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:08.833599 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcb2392-3087-4265-8f03-5012ee3a1dda None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:08.834318 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcb2392-3087-4265-8f03-5012ee3a1dda None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:08.834789 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcb2392-3087-4265-8f03-5012ee3a1dda None admin] PATH_INFO: `/v3/domains` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:08.835920 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcb2392-3087-4265-8f03-5012ee3a1dda None admin] RBAC: Adding query filter params (name=Default) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:00:08.836794 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcb2392-3087-4265-8f03-5012ee3a1dda None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:08.838564 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcb2392-3087-4265-8f03-5012ee3a1dda None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:08.839101 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4438b75f-c4d7-4e79-a535-d32bb522279a None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:08.853862 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 370/751] 10.222.0.79 () {56 vars in 1109 bytes} [Tue Aug 30 01:00:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:00:08.855042 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcb2392-3087-4265-8f03-5012ee3a1dda None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:08.890166 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffead36-c643-4ea1-b883-cbc273d18832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:08.890958 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffead36-c643-4ea1-b883-cbc273d18832 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:08.891617 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffead36-c643-4ea1-b883-cbc273d18832 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:08.891999 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffead36-c643-4ea1-b883-cbc273d18832 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:08.900826 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffead36-c643-4ea1-b883-cbc273d18832 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:08.903400 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffead36-c643-4ea1-b883-cbc273d18832 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:08.917774 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-8ffead36-c643-4ea1-b883-cbc273d18832 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 01:00:08.917774 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:00:08.917774 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:00:08.917774 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:00:08.917774 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:00:08.917774 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:00:08.917774 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:00:08.917774 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:00:08.917774 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:00:08.917774 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:00:08.917774 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:00:08.917774 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:00:08.917774 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 01:00:08.917774 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 01:00:08.917774 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 01:00:08.918739 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 01:00:08.918739 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:00:08.918739 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:00:08.918739 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:00:08.918739 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:00:08.918739 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:00:08.918739 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:00:08.918739 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:00:08.918739 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Aug 30 01:00:08.918739 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:00:08.918739 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:00:08.918739 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:00:08.918739 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:00:08.918739 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:00:08.918739 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:00:08.918739 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:00:08.918739 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:00:08.919648 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 01:00:08.919648 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 01:00:08.919648 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 01:00:08.919648 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 01:00:08.919648 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 01:00:08.919648 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 01:00:08.919648 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 01:00:08.919648 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Aug 30 01:00:08.924017 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 382/752] 10.222.0.79 () {56 vars in 1111 bytes} [Tue Aug 30 01:00:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:00:08.925505 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffead36-c643-4ea1-b883-cbc273d18832 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:08.936183 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:08.990243 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:08.990476 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcb2392-3087-4265-8f03-5012ee3a1dda None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:09.034407 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2103282-6ef2-4fc1-b0c8-3f0fc8d11dba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:09.035304 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2103282-6ef2-4fc1-b0c8-3f0fc8d11dba None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:09.035648 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2103282-6ef2-4fc1-b0c8-3f0fc8d11dba None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:09.035983 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2103282-6ef2-4fc1-b0c8-3f0fc8d11dba None admin] PATH_INFO: `/v3/services` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:09.036769 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2103282-6ef2-4fc1-b0c8-3f0fc8d11dba None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:00:09.037134 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2103282-6ef2-4fc1-b0c8-3f0fc8d11dba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:09.038574 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2103282-6ef2-4fc1-b0c8-3f0fc8d11dba None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:09.049784 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 371/753] 10.222.0.79 () {56 vars in 1124 bytes} [Tue Aug 30 01:00:08 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:00:09.049784 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2103282-6ef2-4fc1-b0c8-3f0fc8d11dba None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:09.051387 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffead36-c643-4ea1-b883-cbc273d18832 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:09.086855 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0678063c-9d7e-476d-b455-b2399b9cb39a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:09.087858 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0678063c-9d7e-476d-b455-b2399b9cb39a None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:09.088334 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0678063c-9d7e-476d-b455-b2399b9cb39a None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:09.088798 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0678063c-9d7e-476d-b455-b2399b9cb39a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:09.096173 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0678063c-9d7e-476d-b455-b2399b9cb39a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:09.097856 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0678063c-9d7e-476d-b455-b2399b9cb39a None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:09.110260 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-0678063c-9d7e-476d-b455-b2399b9cb39a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 01:00:09.110260 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:00:09.110260 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:00:09.110260 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:00:09.110260 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:00:09.110260 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:00:09.110260 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:00:09.110260 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:00:09.110260 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:00:09.110260 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:00:09.110260 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:00:09.110260 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:00:09.110260 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 01:00:09.110260 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 01:00:09.110260 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 01:00:09.111188 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 01:00:09.111188 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:00:09.111188 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:00:09.111188 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:00:09.111188 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:00:09.111188 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:00:09.111188 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:00:09.111188 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:00:09.111188 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Aug 30 01:00:09.111188 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:00:09.111188 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:00:09.111188 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:00:09.111188 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:00:09.111188 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:00:09.111188 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:00:09.111188 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:00:09.111188 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:00:09.112060 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 01:00:09.112060 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 01:00:09.112060 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 01:00:09.112060 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 01:00:09.112060 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 01:00:09.112060 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 01:00:09.112060 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 01:00:09.112060 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Aug 30 01:00:09.114347 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 383/754] 10.222.0.79 () {56 vars in 1111 bytes} [Tue Aug 30 01:00:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:00:09.115348 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0678063c-9d7e-476d-b455-b2399b9cb39a None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:09.164441 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2103282-6ef2-4fc1-b0c8-3f0fc8d11dba None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:09.195245 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:09.205597 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c026abb0-ff00-4221-8390-91246dcaa9e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:09.206203 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c026abb0-ff00-4221-8390-91246dcaa9e2 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:09.206478 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c026abb0-ff00-4221-8390-91246dcaa9e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:09.206769 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c026abb0-ff00-4221-8390-91246dcaa9e2 None admin] PATH_INFO: `/v3/projects` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:09.207500 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c026abb0-ff00-4221-8390-91246dcaa9e2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:00:09.207797 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c026abb0-ff00-4221-8390-91246dcaa9e2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:09.210065 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c026abb0-ff00-4221-8390-91246dcaa9e2 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:09.220918 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0678063c-9d7e-476d-b455-b2399b9cb39a None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:09.231579 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 372/755] 10.222.0.79 () {56 vars in 1148 bytes} [Tue Aug 30 01:00:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:00:09.234059 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c026abb0-ff00-4221-8390-91246dcaa9e2 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:09.240498 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:09.271799 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12826100-8ca6-4951-b806-2a18ed9b662d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:09.272410 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12826100-8ca6-4951-b806-2a18ed9b662d None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:09.272680 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12826100-8ca6-4951-b806-2a18ed9b662d None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:09.272948 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12826100-8ca6-4951-b806-2a18ed9b662d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:09.273707 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12826100-8ca6-4951-b806-2a18ed9b662d None admin] RBAC: Adding query filter params (interface=public, service_id=d15b5bbe76344d02909a73d4663633c5, region_id=RegionOne) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:00:09.274007 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12826100-8ca6-4951-b806-2a18ed9b662d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:09.275434 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12826100-8ca6-4951-b806-2a18ed9b662d None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:09.284661 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 384/756] 10.222.0.79 () {56 vars in 1251 bytes} [Tue Aug 30 01:00:09 2022] GET /identity/v3/endpoints?service_id=d15b5bbe76344d02909a73d4663633c5&interface=public®ion_id=RegionOne => generated 194 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:00:09.290196 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12826100-8ca6-4951-b806-2a18ed9b662d None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:09.394875 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c026abb0-ff00-4221-8390-91246dcaa9e2 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:09.410801 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12826100-8ca6-4951-b806-2a18ed9b662d None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:09.432567 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450af347-4b99-4c41-8fa8-f7fb1fd784d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:09.433097 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450af347-4b99-4c41-8fa8-f7fb1fd784d7 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:09.433368 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450af347-4b99-4c41-8fa8-f7fb1fd784d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:09.433632 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450af347-4b99-4c41-8fa8-f7fb1fd784d7 None admin] PATH_INFO: `/v3/projects` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:09.434380 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450af347-4b99-4c41-8fa8-f7fb1fd784d7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:00:09.434677 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450af347-4b99-4c41-8fa8-f7fb1fd784d7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:09.436328 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450af347-4b99-4c41-8fa8-f7fb1fd784d7 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:09.448160 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 373/757] 10.222.0.79 () {56 vars in 1148 bytes} [Tue Aug 30 01:00:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:00:09.448948 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450af347-4b99-4c41-8fa8-f7fb1fd784d7 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:09.457805 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47fc6dc-7f85-4a08-8bc5-1e88d284ee74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:09.458460 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47fc6dc-7f85-4a08-8bc5-1e88d284ee74 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:09.458736 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47fc6dc-7f85-4a08-8bc5-1e88d284ee74 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:09.459009 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47fc6dc-7f85-4a08-8bc5-1e88d284ee74 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:09.460129 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47fc6dc-7f85-4a08-8bc5-1e88d284ee74 None admin] RBAC: Adding query filter params (role.id=687d3359d6b2413b84ca5a54d30d5488, scope.project.id=0eec3a73673e45dc881de586b9b0fbbb, user.id=5cacaed93420436e8f423f96a8041401) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:00:09.460461 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47fc6dc-7f85-4a08-8bc5-1e88d284ee74 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:09.462176 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47fc6dc-7f85-4a08-8bc5-1e88d284ee74 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:09.468569 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 385/758] 10.222.0.79 () {56 vars in 1374 bytes} [Tue Aug 30 01:00:09 2022] GET /identity/v3/role_assignments?user.id=5cacaed93420436e8f423f96a8041401&scope.project.id=0eec3a73673e45dc881de586b9b0fbbb&role.id=687d3359d6b2413b84ca5a54d30d5488 => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:00:09.469776 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8149aa7-6c58-447c-ac1a-817ca9425fd8 None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:09.470058 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8149aa7-6c58-447c-ac1a-817ca9425fd8 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:09.470330 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8149aa7-6c58-447c-ac1a-817ca9425fd8 None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:09.471582 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 386/759] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 01:00:09 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:00:09.471582 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1d18fd-2ebf-4ab9-ad3a-51475745e60c None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:09.471582 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1d18fd-2ebf-4ab9-ad3a-51475745e60c None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:09.471582 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1d18fd-2ebf-4ab9-ad3a-51475745e60c None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:09.471582 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 387/760] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 01:00:09 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:00:09.471582 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1d18fd-2ebf-4ab9-ad3a-51475745e60c None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:09.510685 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:09.524136 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:09.576644 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450af347-4b99-4c41-8fa8-f7fb1fd784d7 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:09.601104 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1d18fd-2ebf-4ab9-ad3a-51475745e60c None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:09.617370 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb650e5-d75a-491b-97a9-42f0e827a0e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:09.618767 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb650e5-d75a-491b-97a9-42f0e827a0e0 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:09.618767 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb650e5-d75a-491b-97a9-42f0e827a0e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:09.618767 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb650e5-d75a-491b-97a9-42f0e827a0e0 None admin] PATH_INFO: `/v3/services` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:09.619255 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb650e5-d75a-491b-97a9-42f0e827a0e0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:09.620641 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb650e5-d75a-491b-97a9-42f0e827a0e0 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:09.626578 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 374/761] 10.222.0.79 () {56 vars in 1087 bytes} [Tue Aug 30 01:00:09 2022] GET /identity/v3/services => generated 772 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:00:09.628634 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5bc631-5381-44bf-9e52-ebb541ee6408 None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:09.628918 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5bc631-5381-44bf-9e52-ebb541ee6408 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:09.629184 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5bc631-5381-44bf-9e52-ebb541ee6408 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:09.648201 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b5f6aa-072e-427d-b08a-da150806375e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:09.648822 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b5f6aa-072e-427d-b08a-da150806375e None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:09.649100 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b5f6aa-072e-427d-b08a-da150806375e None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:09.649371 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b5f6aa-072e-427d-b08a-da150806375e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:09.650108 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b5f6aa-072e-427d-b08a-da150806375e None admin] RBAC: Adding query filter params (role.id=d14c3070c9184d76a7b23df69bd3db07, scope.project.id=0eec3a73673e45dc881de586b9b0fbbb, user.id=dd556fa6ba464928b1e067325792a523) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:00:09.650413 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b5f6aa-072e-427d-b08a-da150806375e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:09.651930 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b5f6aa-072e-427d-b08a-da150806375e None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:09.655632 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-cc5bc631-5381-44bf-9e52-ebb541ee6408 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:00:09.657742 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-cc5bc631-5381-44bf-9e52-ebb541ee6408 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:00:09.663739 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 388/762] 10.222.0.79 () {56 vars in 1374 bytes} [Tue Aug 30 01:00:09 2022] GET /identity/v3/role_assignments?user.id=dd556fa6ba464928b1e067325792a523&scope.project.id=0eec3a73673e45dc881de586b9b0fbbb&role.id=d14c3070c9184d76a7b23df69bd3db07 => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:00:09.665312 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12de4e7-2ad2-4400-bb38-02a1e8b5d871 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:09.665670 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12de4e7-2ad2-4400-bb38-02a1e8b5d871 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:09.666011 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12de4e7-2ad2-4400-bb38-02a1e8b5d871 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:09.707599 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-c12de4e7-2ad2-4400-bb38-02a1e8b5d871 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:00:09.708748 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-c12de4e7-2ad2-4400-bb38-02a1e8b5d871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:00:09.783515 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 375/763] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 01:00:09 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 01:00:09.818387 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 389/764] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 01:00:09 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 01:00:10.090038 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5bc631-5381-44bf-9e52-ebb541ee6408 None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:10.136058 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:10.150689 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12de4e7-2ad2-4400-bb38-02a1e8b5d871 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:10.207273 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:10.235631 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5bc631-5381-44bf-9e52-ebb541ee6408 None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:10.305443 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ecdaa4-6247-4320-8847-e1cbb824a43a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:10.306074 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ecdaa4-6247-4320-8847-e1cbb824a43a None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:10.306350 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ecdaa4-6247-4320-8847-e1cbb824a43a None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:10.306620 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ecdaa4-6247-4320-8847-e1cbb824a43a None admin] PATH_INFO: `/v3/services/network` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:10.307220 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ecdaa4-6247-4320-8847-e1cbb824a43a None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:10.308580 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ecdaa4-6247-4320-8847-e1cbb824a43a None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:10.323947 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application [None req-38ecdaa4-6247-4320-8847-e1cbb824a43a None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 30 01:00:10.323947 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:00:10.323947 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 01:00:10.323947 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 01:00:10.323947 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 01:00:10.323947 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 01:00:10.323947 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 01:00:10.323947 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 01:00:10.323947 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 30 01:00:10.323947 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Aug 30 01:00:10.323947 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 01:00:10.323947 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Aug 30 01:00:10.323947 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:00:10.323947 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:00:10.323947 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:00:10.323947 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:00:10.323947 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:00:10.325566 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:00:10.325566 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:00:10.325566 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:00:10.325566 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:00:10.325566 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:00:10.325566 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:00:10.325566 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 01:00:10.325566 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 01:00:10.325566 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 01:00:10.325566 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 01:00:10.325566 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:00:10.325566 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:00:10.325566 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:00:10.325566 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:00:10.325566 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:00:10.325566 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:00:10.326602 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:00:10.326602 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application with Lock( Aug 30 01:00:10.326602 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:00:10.326602 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:00:10.326602 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:00:10.326602 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:00:10.326602 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:00:10.326602 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:00:10.326602 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:00:10.326602 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:00:10.326602 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 01:00:10.326602 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 01:00:10.326602 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 30 01:00:10.326602 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Aug 30 01:00:10.329315 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 376/765] 10.222.0.79 () {56 vars in 1111 bytes} [Tue Aug 30 01:00:10 2022] GET /identity/v3/services/network => generated 88 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:00:10.336386 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ecdaa4-6247-4320-8847-e1cbb824a43a None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:10.357358 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12de4e7-2ad2-4400-bb38-02a1e8b5d871 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:10.399150 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5f7e38-c4df-478b-95ff-d195628d1de2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:10.400850 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5f7e38-c4df-478b-95ff-d195628d1de2 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:10.400964 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5f7e38-c4df-478b-95ff-d195628d1de2 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:10.401197 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5f7e38-c4df-478b-95ff-d195628d1de2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:10.425277 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5f7e38-c4df-478b-95ff-d195628d1de2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 01:00:10.430109 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-ab5f7e38-c4df-478b-95ff-d195628d1de2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 01:00:10.430109 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:00:10.430109 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:00:10.430109 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:00:10.430109 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:00:10.430109 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:00:10.430109 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:00:10.430109 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:00:10.430109 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:00:10.430109 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:00:10.430109 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:00:10.430109 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:00:10.430109 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 01:00:10.430109 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 01:00:10.430109 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 01:00:10.430109 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 01:00:10.431056 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 01:00:10.431056 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 01:00:10.431056 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 01:00:10.431056 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 01:00:10.431056 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:00:10.431056 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:00:10.431056 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:00:10.431056 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:00:10.431056 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:00:10.431056 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:00:10.431056 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:00:10.431056 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Aug 30 01:00:10.431056 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:00:10.431056 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:00:10.431056 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:00:10.431056 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:00:10.431920 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:00:10.431920 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:00:10.431920 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:00:10.431920 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:00:10.431920 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 01:00:10.431920 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 01:00:10.431920 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 01:00:10.431920 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 01:00:10.431920 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 01:00:10.431920 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 01:00:10.431920 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 01:00:10.431920 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Aug 30 01:00:10.433350 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 390/766] 10.222.0.79 () {56 vars in 1096 bytes} [Tue Aug 30 01:00:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:00:10.439262 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5f7e38-c4df-478b-95ff-d195628d1de2 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:10.525463 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ecdaa4-6247-4320-8847-e1cbb824a43a None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:10.539173 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:10.563705 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:10.574559 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5f7e38-c4df-478b-95ff-d195628d1de2 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:10.597153 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c18b5c-00a9-466b-8d8b-d1013cafff5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:10.598136 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c18b5c-00a9-466b-8d8b-d1013cafff5f None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:10.598608 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c18b5c-00a9-466b-8d8b-d1013cafff5f None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:10.599077 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c18b5c-00a9-466b-8d8b-d1013cafff5f None admin] PATH_INFO: `/v3/services` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:10.599919 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c18b5c-00a9-466b-8d8b-d1013cafff5f None admin] RBAC: Adding query filter params (name=network) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:00:10.600415 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c18b5c-00a9-466b-8d8b-d1013cafff5f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:10.601974 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c18b5c-00a9-466b-8d8b-d1013cafff5f None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:10.615233 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117ab6cb-b682-47bc-baad-3d71d6f1aedc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:10.615233 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117ab6cb-b682-47bc-baad-3d71d6f1aedc None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:10.615233 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117ab6cb-b682-47bc-baad-3d71d6f1aedc None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:10.615233 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117ab6cb-b682-47bc-baad-3d71d6f1aedc None admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:10.615577 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117ab6cb-b682-47bc-baad-3d71d6f1aedc None admin] RBAC: Adding query filter params (name=admin) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:00:10.615577 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117ab6cb-b682-47bc-baad-3d71d6f1aedc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:10.615577 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117ab6cb-b682-47bc-baad-3d71d6f1aedc None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:10.621118 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 377/767] 10.222.0.79 () {56 vars in 1112 bytes} [Tue Aug 30 01:00:10 2022] GET /identity/v3/services?name=network => generated 124 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:00:10.627341 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 391/768] 10.222.0.79 () {56 vars in 1099 bytes} [Tue Aug 30 01:00:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:00:10.629590 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c18b5c-00a9-466b-8d8b-d1013cafff5f None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:10.633688 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117ab6cb-b682-47bc-baad-3d71d6f1aedc None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:10.786961 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117ab6cb-b682-47bc-baad-3d71d6f1aedc None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:10.815437 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c18b5c-00a9-466b-8d8b-d1013cafff5f None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:10.823654 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b21fbb3-ca92-4f0b-af54-2e1d597af959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:10.824284 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b21fbb3-ca92-4f0b-af54-2e1d597af959 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:10.824606 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b21fbb3-ca92-4f0b-af54-2e1d597af959 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:10.824934 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b21fbb3-ca92-4f0b-af54-2e1d597af959 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:10.836487 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b21fbb3-ca92-4f0b-af54-2e1d597af959 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:10.838062 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b21fbb3-ca92-4f0b-af54-2e1d597af959 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:10.853436 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-4b21fbb3-ca92-4f0b-af54-2e1d597af959 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:00:10.853436 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:00:10.853436 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:00:10.853436 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:00:10.853436 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:00:10.853436 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:00:10.853436 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:00:10.853436 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:00:10.853436 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:00:10.853436 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:00:10.853436 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:00:10.853436 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:00:10.853436 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 01:00:10.853436 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 01:00:10.853436 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 01:00:10.853436 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 01:00:10.854480 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:00:10.854480 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:00:10.854480 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:00:10.854480 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:00:10.854480 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:00:10.854480 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:00:10.854480 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:00:10.854480 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Aug 30 01:00:10.854480 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:00:10.854480 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:00:10.854480 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:00:10.854480 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:00:10.854480 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:00:10.854480 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:00:10.854480 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:00:10.854480 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:00:10.854480 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 01:00:10.855408 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 01:00:10.855408 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:00:10.855408 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Aug 30 01:00:10.855408 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 392/769] 10.222.0.79 () {56 vars in 1108 bytes} [Tue Aug 30 01:00:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:00:10.860696 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b21fbb3-ca92-4f0b-af54-2e1d597af959 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:10.864328 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86de1d63-086b-46af-afb1-89a5373f0f10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:10.864949 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86de1d63-086b-46af-afb1-89a5373f0f10 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:10.865222 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86de1d63-086b-46af-afb1-89a5373f0f10 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:10.865538 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86de1d63-086b-46af-afb1-89a5373f0f10 None admin] PATH_INFO: `/v3/services` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:10.867762 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86de1d63-086b-46af-afb1-89a5373f0f10 None admin] RBAC: Adding query filter params (type=network) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:00:10.868084 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86de1d63-086b-46af-afb1-89a5373f0f10 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:10.869462 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86de1d63-086b-46af-afb1-89a5373f0f10 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:10.873882 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:10.879813 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 378/770] 10.222.0.79 () {56 vars in 1112 bytes} [Tue Aug 30 01:00:10 2022] GET /identity/v3/services?type=network => generated 350 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:00:10.896629 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86de1d63-086b-46af-afb1-89a5373f0f10 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:10.979578 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b21fbb3-ca92-4f0b-af54-2e1d597af959 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:10.989590 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:11.021354 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfe2867-17e5-4f70-980d-ae347534d95f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:11.022494 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfe2867-17e5-4f70-980d-ae347534d95f None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:11.023882 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfe2867-17e5-4f70-980d-ae347534d95f None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:11.026834 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfe2867-17e5-4f70-980d-ae347534d95f None admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:11.027732 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfe2867-17e5-4f70-980d-ae347534d95f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:00:11.028759 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfe2867-17e5-4f70-980d-ae347534d95f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:11.030350 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfe2867-17e5-4f70-980d-ae347534d95f None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:11.050511 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 393/771] 10.222.0.79 () {56 vars in 1109 bytes} [Tue Aug 30 01:00:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:00:11.060291 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfe2867-17e5-4f70-980d-ae347534d95f None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:11.090871 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86de1d63-086b-46af-afb1-89a5373f0f10 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:11.152034 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226aed02-93ca-4a77-a571-030b267ff959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:11.152544 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226aed02-93ca-4a77-a571-030b267ff959 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:11.152757 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226aed02-93ca-4a77-a571-030b267ff959 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:11.153623 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226aed02-93ca-4a77-a571-030b267ff959 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:11.154897 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226aed02-93ca-4a77-a571-030b267ff959 None admin] RBAC: Adding query filter params (interface=public, service_id=6102b1c5e1b64b0f882837610f9324cc, region_id=RegionOne) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:00:11.155117 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226aed02-93ca-4a77-a571-030b267ff959 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:11.156507 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226aed02-93ca-4a77-a571-030b267ff959 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:11.159739 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:11.171769 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 379/772] 10.222.0.79 () {56 vars in 1251 bytes} [Tue Aug 30 01:00:10 2022] GET /identity/v3/endpoints?service_id=6102b1c5e1b64b0f882837610f9324cc&interface=public®ion_id=RegionOne => generated 194 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:00:11.176994 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226aed02-93ca-4a77-a571-030b267ff959 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:11.197514 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfe2867-17e5-4f70-980d-ae347534d95f None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:11.241529 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8524ce0-aba4-4c94-a00a-08e98520ea48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:11.242234 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8524ce0-aba4-4c94-a00a-08e98520ea48 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:11.242572 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8524ce0-aba4-4c94-a00a-08e98520ea48 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:11.242902 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8524ce0-aba4-4c94-a00a-08e98520ea48 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:11.261819 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8524ce0-aba4-4c94-a00a-08e98520ea48 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:11.269420 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8524ce0-aba4-4c94-a00a-08e98520ea48 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:11.292979 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-c8524ce0-aba4-4c94-a00a-08e98520ea48 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 30 01:00:11.292979 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:00:11.292979 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:00:11.292979 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:00:11.292979 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:00:11.292979 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:00:11.292979 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:00:11.292979 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:00:11.292979 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:00:11.292979 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:00:11.292979 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:00:11.292979 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:00:11.292979 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 01:00:11.292979 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 01:00:11.292979 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 01:00:11.292979 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 01:00:11.294301 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:00:11.294301 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:00:11.294301 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 01:00:11.294301 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 01:00:11.294301 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 01:00:11.294301 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 01:00:11.294301 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:00:11.294301 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:00:11.294301 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:00:11.294301 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:00:11.294301 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:00:11.294301 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Aug 30 01:00:11.294301 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:00:11.294301 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:00:11.294301 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:00:11.294301 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:00:11.294301 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:00:11.294301 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:00:11.295263 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:00:11.295263 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:00:11.295263 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 01:00:11.295263 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 01:00:11.295263 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 01:00:11.295263 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 01:00:11.295263 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 01:00:11.295263 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 01:00:11.295263 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 30 01:00:11.295263 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Aug 30 01:00:11.303290 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 394/773] 10.222.0.79 () {56 vars in 1093 bytes} [Tue Aug 30 01:00:11 2022] GET /identity/v3/users/nova => generated 82 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:00:11.309003 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8524ce0-aba4-4c94-a00a-08e98520ea48 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:11.399551 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:11.407482 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226aed02-93ca-4a77-a571-030b267ff959 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:11.480269 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00c8839-3e7a-4d3e-a1c9-53156e55d927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:11.480875 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00c8839-3e7a-4d3e-a1c9-53156e55d927 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:11.481350 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00c8839-3e7a-4d3e-a1c9-53156e55d927 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:11.481671 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00c8839-3e7a-4d3e-a1c9-53156e55d927 None admin] PATH_INFO: `/v3/services` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:11.482280 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00c8839-3e7a-4d3e-a1c9-53156e55d927 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:11.483670 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00c8839-3e7a-4d3e-a1c9-53156e55d927 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:11.497787 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 380/774] 10.222.0.79 () {56 vars in 1087 bytes} [Tue Aug 30 01:00:11 2022] GET /identity/v3/services => generated 772 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:00:11.508116 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8524ce0-aba4-4c94-a00a-08e98520ea48 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:11.547585 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:11.555651 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5b3b0b-3558-4597-a193-dabbd923adf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:11.556331 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5b3b0b-3558-4597-a193-dabbd923adf4 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:11.556599 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5b3b0b-3558-4597-a193-dabbd923adf4 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:11.556862 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5b3b0b-3558-4597-a193-dabbd923adf4 None admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:11.557610 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5b3b0b-3558-4597-a193-dabbd923adf4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:00:11.557909 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5b3b0b-3558-4597-a193-dabbd923adf4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:11.559907 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5b3b0b-3558-4597-a193-dabbd923adf4 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:11.592582 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00c8839-3e7a-4d3e-a1c9-53156e55d927 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:11.603665 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 395/775] 10.222.0.79 () {56 vars in 1133 bytes} [Tue Aug 30 01:00:11 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:00:11.676978 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed905f2-ed84-413c-9162-5e19ed5fc7e3 None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:11.677261 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed905f2-ed84-413c-9162-5e19ed5fc7e3 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:11.677437 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed905f2-ed84-413c-9162-5e19ed5fc7e3 None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:11.679154 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 396/776] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 01:00:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 01:00:11.685877 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f89f03e-b08f-4a1e-859a-55ac5881225e None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:11.686172 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f89f03e-b08f-4a1e-859a-55ac5881225e None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:11.686405 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f89f03e-b08f-4a1e-859a-55ac5881225e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:11.706788 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-1f89f03e-b08f-4a1e-859a-55ac5881225e None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:00:11.708146 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-1f89f03e-b08f-4a1e-859a-55ac5881225e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:00:11.710996 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00c8839-3e7a-4d3e-a1c9-53156e55d927 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:11.758232 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24d2808-b422-4f38-af5e-ac5d6cdaa12d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:11.759177 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24d2808-b422-4f38-af5e-ac5d6cdaa12d None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:11.759459 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24d2808-b422-4f38-af5e-ac5d6cdaa12d None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:11.759727 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24d2808-b422-4f38-af5e-ac5d6cdaa12d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:11.774787 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24d2808-b422-4f38-af5e-ac5d6cdaa12d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:11.777009 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24d2808-b422-4f38-af5e-ac5d6cdaa12d None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:11.784472 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 397/777] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 01:00:11 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 01:00:11.794055 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application [None req-a24d2808-b422-4f38-af5e-ac5d6cdaa12d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:00:11.794055 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:00:11.794055 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:00:11.794055 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:00:11.794055 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:00:11.794055 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:00:11.794055 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:00:11.794055 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:00:11.794055 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:00:11.794055 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:00:11.794055 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:00:11.794055 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:00:11.794055 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 01:00:11.794055 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 01:00:11.794055 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 01:00:11.794055 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 01:00:11.796260 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:00:11.796260 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:00:11.796260 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:00:11.796260 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:00:11.796260 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:00:11.796260 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:00:11.796260 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:00:11.796260 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application with Lock( Aug 30 01:00:11.796260 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:00:11.796260 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:00:11.796260 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:00:11.796260 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:00:11.796260 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:00:11.796260 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:00:11.796260 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:00:11.796260 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:00:11.796260 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 01:00:11.798309 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 01:00:11.798309 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:00:11.798309 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Aug 30 01:00:11.798309 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 381/778] 10.222.0.79 () {56 vars in 1108 bytes} [Tue Aug 30 01:00:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:00:11.807209 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f89f03e-b08f-4a1e-859a-55ac5881225e None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:11.905386 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f89f03e-b08f-4a1e-859a-55ac5881225e None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:11.927604 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:11.942865 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cddfbd-c35e-4284-abc7-2ea7a5cdd7b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:11.943530 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cddfbd-c35e-4284-abc7-2ea7a5cdd7b4 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:11.943808 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cddfbd-c35e-4284-abc7-2ea7a5cdd7b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:11.944092 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cddfbd-c35e-4284-abc7-2ea7a5cdd7b4 None admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:11.944834 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cddfbd-c35e-4284-abc7-2ea7a5cdd7b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:00:11.945140 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cddfbd-c35e-4284-abc7-2ea7a5cdd7b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:11.946536 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cddfbd-c35e-4284-abc7-2ea7a5cdd7b4 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:11.962028 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 398/779] 10.222.0.79 () {56 vars in 1109 bytes} [Tue Aug 30 01:00:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:00:11.963508 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46520c4b-c655-48d6-a669-abdc58ae57e0 None None] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:11.963789 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46520c4b-c655-48d6-a669-abdc58ae57e0 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:11.964056 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46520c4b-c655-48d6-a669-abdc58ae57e0 None None] PATH_INFO: `/` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:11.967897 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 382/780] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 01:00:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:00:11.970789 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cddfbd-c35e-4284-abc7-2ea7a5cdd7b4 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:11.976030 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270e8e56-f2d7-47b9-b059-2f1d08d73926 None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:11.976030 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270e8e56-f2d7-47b9-b059-2f1d08d73926 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:11.976030 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270e8e56-f2d7-47b9-b059-2f1d08d73926 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:11.995563 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-270e8e56-f2d7-47b9-b059-2f1d08d73926 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:00:11.997166 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-270e8e56-f2d7-47b9-b059-2f1d08d73926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:00:12.018103 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:12.084109 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 383/781] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 01:00:11 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 01:00:12.089718 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270e8e56-f2d7-47b9-b059-2f1d08d73926 None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:12.092259 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cddfbd-c35e-4284-abc7-2ea7a5cdd7b4 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:12.141518 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a94c06c-dc0e-4463-afef-6208abae4bec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:12.142149 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a94c06c-dc0e-4463-afef-6208abae4bec None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:12.142423 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a94c06c-dc0e-4463-afef-6208abae4bec None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:12.142685 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a94c06c-dc0e-4463-afef-6208abae4bec None admin] PATH_INFO: `/v3/projects/service` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:12.157920 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a94c06c-dc0e-4463-afef-6208abae4bec None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:12.159763 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a94c06c-dc0e-4463-afef-6208abae4bec None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:12.182137 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-2a94c06c-dc0e-4463-afef-6208abae4bec None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 01:00:12.182137 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:00:12.182137 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:00:12.182137 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:00:12.182137 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:00:12.182137 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:00:12.182137 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:00:12.182137 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:00:12.182137 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:00:12.182137 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:00:12.182137 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:00:12.182137 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:00:12.182137 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 01:00:12.182137 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 01:00:12.182137 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 01:00:12.183066 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 01:00:12.183066 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:00:12.183066 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:00:12.183066 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:00:12.183066 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:00:12.183066 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:00:12.183066 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:00:12.183066 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:00:12.183066 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Aug 30 01:00:12.183066 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:00:12.183066 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:00:12.183066 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:00:12.183066 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:00:12.183066 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:00:12.183066 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:00:12.183066 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:00:12.183066 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:00:12.183985 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 01:00:12.183985 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 01:00:12.183985 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 01:00:12.183985 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 01:00:12.183985 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 01:00:12.183985 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 01:00:12.183985 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 01:00:12.183985 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Aug 30 01:00:12.185024 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 399/782] 10.222.0.79 () {56 vars in 1111 bytes} [Tue Aug 30 01:00:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:00:12.191211 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a94c06c-dc0e-4463-afef-6208abae4bec None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:12.254417 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:12.272069 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270e8e56-f2d7-47b9-b059-2f1d08d73926 None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:12.308659 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d319ead-6c3c-44de-8b6d-492d45c40346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:12.310199 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d319ead-6c3c-44de-8b6d-492d45c40346 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:12.310674 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d319ead-6c3c-44de-8b6d-492d45c40346 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:12.311208 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d319ead-6c3c-44de-8b6d-492d45c40346 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:12.322314 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d319ead-6c3c-44de-8b6d-492d45c40346 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 01:00:12.328209 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application [None req-0d319ead-6c3c-44de-8b6d-492d45c40346 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 01:00:12.328209 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:00:12.328209 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:00:12.328209 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:00:12.328209 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:00:12.328209 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:00:12.328209 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:00:12.328209 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:00:12.328209 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:00:12.328209 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:00:12.328209 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:00:12.328209 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:00:12.328209 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 01:00:12.328209 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 01:00:12.328209 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 01:00:12.328209 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 01:00:12.329158 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 01:00:12.329158 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 01:00:12.329158 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 01:00:12.329158 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 01:00:12.329158 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:00:12.329158 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:00:12.329158 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:00:12.329158 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:00:12.329158 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:00:12.329158 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:00:12.329158 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:00:12.329158 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application with Lock( Aug 30 01:00:12.329158 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:00:12.329158 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:00:12.329158 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:00:12.329158 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:00:12.334850 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:00:12.334850 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:00:12.334850 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:00:12.334850 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:00:12.334850 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 01:00:12.334850 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 01:00:12.334850 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 01:00:12.334850 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 01:00:12.334850 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 01:00:12.334850 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 01:00:12.334850 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 01:00:12.334850 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Aug 30 01:00:12.334850 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 384/783] 10.222.0.79 () {56 vars in 1102 bytes} [Tue Aug 30 01:00:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 01:00:12.334850 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135ebd53-fbf2-4917-b149-1cd487352630 None None] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:12.335633 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135ebd53-fbf2-4917-b149-1cd487352630 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:12.335633 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135ebd53-fbf2-4917-b149-1cd487352630 None None] PATH_INFO: `/` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:12.335633 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 385/784] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 01:00:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:00:12.335633 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135ebd53-fbf2-4917-b149-1cd487352630 None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:12.343535 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:12.368207 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a94c06c-dc0e-4463-afef-6208abae4bec None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:12.405073 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251d2ec7-6d44-44d5-b53a-c924ad75e5b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:12.405684 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251d2ec7-6d44-44d5-b53a-c924ad75e5b7 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:12.405957 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251d2ec7-6d44-44d5-b53a-c924ad75e5b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:12.406222 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251d2ec7-6d44-44d5-b53a-c924ad75e5b7 None admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:12.406902 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251d2ec7-6d44-44d5-b53a-c924ad75e5b7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:00:12.407229 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251d2ec7-6d44-44d5-b53a-c924ad75e5b7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:12.408670 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251d2ec7-6d44-44d5-b53a-c924ad75e5b7 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:12.420365 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 400/785] 10.222.0.79 () {56 vars in 1148 bytes} [Tue Aug 30 01:00:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:00:12.426070 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372dcdf1-f4d7-4ba5-9321-a26b08511106 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:12.426345 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372dcdf1-f4d7-4ba5-9321-a26b08511106 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:12.426622 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372dcdf1-f4d7-4ba5-9321-a26b08511106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:12.444758 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-372dcdf1-f4d7-4ba5-9321-a26b08511106 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:00:12.445846 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-372dcdf1-f4d7-4ba5-9321-a26b08511106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:00:12.462853 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135ebd53-fbf2-4917-b149-1cd487352630 None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:12.497245 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cdef76-ea70-43f2-a8c3-91f156e01aa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:12.497954 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cdef76-ea70-43f2-a8c3-91f156e01aa7 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:12.498236 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cdef76-ea70-43f2-a8c3-91f156e01aa7 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:12.498509 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cdef76-ea70-43f2-a8c3-91f156e01aa7 None admin] PATH_INFO: `/v3/roles` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:12.499205 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cdef76-ea70-43f2-a8c3-91f156e01aa7 None admin] RBAC: Adding query filter params (name=service) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:00:12.499529 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cdef76-ea70-43f2-a8c3-91f156e01aa7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:12.500888 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cdef76-ea70-43f2-a8c3-91f156e01aa7 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:12.509605 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 386/786] 10.222.0.79 () {56 vars in 1103 bytes} [Tue Aug 30 01:00:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:00:12.510492 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cdef76-ea70-43f2-a8c3-91f156e01aa7 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:12.520044 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 401/787] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 01:00:12 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 01:00:12.521362 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372dcdf1-f4d7-4ba5-9321-a26b08511106 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:12.546553 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:12.591220 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:12.624694 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cdef76-ea70-43f2-a8c3-91f156e01aa7 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:12.643974 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372dcdf1-f4d7-4ba5-9321-a26b08511106 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:12.661360 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5860b4e1-a238-4f57-b49b-16a99e699ceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:12.662066 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5860b4e1-a238-4f57-b49b-16a99e699ceb None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:12.662447 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5860b4e1-a238-4f57-b49b-16a99e699ceb None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:12.662893 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5860b4e1-a238-4f57-b49b-16a99e699ceb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:12.675171 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5860b4e1-a238-4f57-b49b-16a99e699ceb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 01:00:12.679958 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application [None req-5860b4e1-a238-4f57-b49b-16a99e699ceb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 01:00:12.679958 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:00:12.679958 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:00:12.679958 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:00:12.679958 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:00:12.679958 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:00:12.679958 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:00:12.679958 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:00:12.679958 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:00:12.679958 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:00:12.679958 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:00:12.679958 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:00:12.679958 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 01:00:12.679958 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 01:00:12.679958 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 01:00:12.679958 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 01:00:12.681093 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 01:00:12.681093 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 01:00:12.681093 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 01:00:12.681093 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 01:00:12.681093 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:00:12.681093 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:00:12.681093 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:00:12.681093 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:00:12.681093 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:00:12.681093 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:00:12.681093 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:00:12.681093 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application with Lock( Aug 30 01:00:12.681093 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:00:12.681093 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:00:12.681093 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:00:12.681093 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:00:12.682155 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:00:12.682155 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:00:12.682155 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:00:12.682155 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:00:12.682155 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 01:00:12.682155 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 01:00:12.682155 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 01:00:12.682155 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 01:00:12.682155 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 01:00:12.682155 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 01:00:12.682155 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 01:00:12.682155 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Aug 30 01:00:12.689058 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 387/788] 10.222.0.79 () {56 vars in 1096 bytes} [Tue Aug 30 01:00:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:00:12.690006 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5860b4e1-a238-4f57-b49b-16a99e699ceb None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:12.694921 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ece822f-c082-4b16-b944-206a00fb053d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:12.695776 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ece822f-c082-4b16-b944-206a00fb053d None admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:12.696218 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ece822f-c082-4b16-b944-206a00fb053d None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:12.696638 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ece822f-c082-4b16-b944-206a00fb053d None admin] PATH_INFO: `/v3/projects/0eec3a73673e45dc881de586b9b0fbbb/users/6480b2f14c37474c89df9fba48f7cd91/roles/d14c3070c9184d76a7b23df69bd3db07` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:12.698680 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ece822f-c082-4b16-b944-206a00fb053d None admin] RBAC: Authorizing `identity:create_grant(project_id=0eec3a73673e45dc881de586b9b0fbbb, user_id=6480b2f14c37474c89df9fba48f7cd91, role_id=d14c3070c9184d76a7b23df69bd3db07)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:12.701478 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ece822f-c082-4b16-b944-206a00fb053d None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:12.723164 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 402/789] 10.222.0.79 () {58 vars in 1439 bytes} [Tue Aug 30 01:00:12 2022] PUT /identity/v3/projects/0eec3a73673e45dc881de586b9b0fbbb/users/6480b2f14c37474c89df9fba48f7cd91/roles/d14c3070c9184d76a7b23df69bd3db07 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:00:12.723164 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ece822f-c082-4b16-b944-206a00fb053d None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:12.874479 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:12.898159 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ece822f-c082-4b16-b944-206a00fb053d None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:12.963796 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e9bc73-ebd2-4d96-a8a7-20be0737d501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:12.966739 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e9bc73-ebd2-4d96-a8a7-20be0737d501 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:12.967650 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e9bc73-ebd2-4d96-a8a7-20be0737d501 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:12.968725 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e9bc73-ebd2-4d96-a8a7-20be0737d501 None admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:12.970083 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e9bc73-ebd2-4d96-a8a7-20be0737d501 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:00:12.970877 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e9bc73-ebd2-4d96-a8a7-20be0737d501 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:12.974679 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e9bc73-ebd2-4d96-a8a7-20be0737d501 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:12.984214 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5860b4e1-a238-4f57-b49b-16a99e699ceb None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:13.000921 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 403/790] 10.222.0.79 () {56 vars in 1099 bytes} [Tue Aug 30 01:00:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:00:13.000921 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e9bc73-ebd2-4d96-a8a7-20be0737d501 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:13.039533 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:13.054798 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6a41a0-2176-43ad-b1f1-a85de676b99b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:13.056533 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6a41a0-2176-43ad-b1f1-a85de676b99b None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:13.057453 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6a41a0-2176-43ad-b1f1-a85de676b99b None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:13.058528 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6a41a0-2176-43ad-b1f1-a85de676b99b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:13.085399 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6a41a0-2176-43ad-b1f1-a85de676b99b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:13.088986 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6a41a0-2176-43ad-b1f1-a85de676b99b None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:13.114158 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application [None req-2f6a41a0-2176-43ad-b1f1-a85de676b99b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:00:13.114158 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:00:13.114158 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:00:13.114158 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:00:13.114158 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:00:13.114158 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:00:13.114158 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:00:13.114158 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:00:13.114158 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:00:13.114158 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:00:13.114158 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:00:13.114158 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:00:13.114158 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 01:00:13.114158 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 01:00:13.114158 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 01:00:13.114158 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 01:00:13.115392 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:00:13.115392 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:00:13.115392 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:00:13.115392 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:00:13.115392 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:00:13.115392 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:00:13.115392 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:00:13.115392 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application with Lock( Aug 30 01:00:13.115392 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:00:13.115392 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:00:13.115392 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:00:13.115392 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:00:13.115392 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:00:13.115392 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:00:13.115392 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:00:13.115392 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:00:13.115392 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 01:00:13.116389 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 01:00:13.116389 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:00:13.116389 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Aug 30 01:00:13.120141 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 388/791] 10.222.0.79 () {56 vars in 1108 bytes} [Tue Aug 30 01:00:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 426 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:00:13.120660 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e9bc73-ebd2-4d96-a8a7-20be0737d501 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:13.121120 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6a41a0-2176-43ad-b1f1-a85de676b99b None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:13.172844 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aa857e-53f0-42a3-b8d9-f3fbd5c65a94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:13.174011 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aa857e-53f0-42a3-b8d9-f3fbd5c65a94 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:13.174509 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aa857e-53f0-42a3-b8d9-f3fbd5c65a94 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:13.175196 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aa857e-53f0-42a3-b8d9-f3fbd5c65a94 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:13.176362 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93aa857e-53f0-42a3-b8d9-f3fbd5c65a94 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:13.177906 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93aa857e-53f0-42a3-b8d9-f3fbd5c65a94 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:13.194656 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-93aa857e-53f0-42a3-b8d9-f3fbd5c65a94 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 30 01:00:13.194656 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:00:13.194656 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 01:00:13.194656 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 01:00:13.194656 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 01:00:13.194656 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 01:00:13.194656 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 01:00:13.194656 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 01:00:13.194656 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 30 01:00:13.194656 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Aug 30 01:00:13.194656 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 01:00:13.194656 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Aug 30 01:00:13.194656 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:00:13.194656 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:00:13.194656 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:00:13.194656 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:00:13.194656 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:00:13.195726 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:00:13.195726 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:00:13.195726 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:00:13.195726 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:00:13.195726 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:00:13.195726 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:00:13.195726 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 01:00:13.195726 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 01:00:13.195726 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 01:00:13.195726 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 01:00:13.195726 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:00:13.195726 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:00:13.195726 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:00:13.195726 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:00:13.195726 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:00:13.195726 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:00:13.196554 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:00:13.196554 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Aug 30 01:00:13.196554 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:00:13.196554 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:00:13.196554 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:00:13.196554 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:00:13.196554 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:00:13.196554 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:00:13.196554 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:00:13.196554 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:00:13.196554 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 01:00:13.196554 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 01:00:13.196554 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 30 01:00:13.196554 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Aug 30 01:00:13.197312 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 404/792] 10.222.0.79 () {56 vars in 1129 bytes} [Tue Aug 30 01:00:12 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:00:13.198090 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aa857e-53f0-42a3-b8d9-f3fbd5c65a94 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:13.216515 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:13.240806 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6a41a0-2176-43ad-b1f1-a85de676b99b None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:13.279057 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce29f6a-5920-4693-a4df-16ef87d61f27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:13.279736 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce29f6a-5920-4693-a4df-16ef87d61f27 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:13.280010 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce29f6a-5920-4693-a4df-16ef87d61f27 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:13.280280 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce29f6a-5920-4693-a4df-16ef87d61f27 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:13.291411 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce29f6a-5920-4693-a4df-16ef87d61f27 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:13.292871 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce29f6a-5920-4693-a4df-16ef87d61f27 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:13.309762 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application [None req-4ce29f6a-5920-4693-a4df-16ef87d61f27 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:00:13.309762 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:00:13.309762 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:00:13.309762 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:00:13.309762 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:00:13.309762 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:00:13.309762 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:00:13.309762 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:00:13.309762 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:00:13.309762 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:00:13.309762 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:00:13.309762 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:00:13.309762 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 01:00:13.309762 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 01:00:13.309762 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 01:00:13.309762 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 01:00:13.311064 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:00:13.311064 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:00:13.311064 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:00:13.311064 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:00:13.311064 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:00:13.311064 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:00:13.311064 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:00:13.311064 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application with Lock( Aug 30 01:00:13.311064 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:00:13.311064 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:00:13.311064 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:00:13.311064 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:00:13.311064 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:00:13.311064 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:00:13.311064 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:00:13.311064 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:00:13.311064 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 01:00:13.311989 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 01:00:13.311989 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:00:13.311989 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Aug 30 01:00:13.315711 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 389/793] 10.222.0.79 () {56 vars in 1108 bytes} [Tue Aug 30 01:00:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:00:13.317509 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce29f6a-5920-4693-a4df-16ef87d61f27 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:13.351913 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:13.353360 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aa857e-53f0-42a3-b8d9-f3fbd5c65a94 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:13.404843 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f977988d-be92-4983-aaac-68ebadfc0aee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:13.406149 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f977988d-be92-4983-aaac-68ebadfc0aee None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:13.406901 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f977988d-be92-4983-aaac-68ebadfc0aee None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:13.407409 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f977988d-be92-4983-aaac-68ebadfc0aee None admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:13.408533 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f977988d-be92-4983-aaac-68ebadfc0aee None admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:00:13.409485 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f977988d-be92-4983-aaac-68ebadfc0aee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:13.411611 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f977988d-be92-4983-aaac-68ebadfc0aee None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:13.428453 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 405/794] 10.222.0.79 () {56 vars in 1109 bytes} [Tue Aug 30 01:00:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:00:13.429576 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f977988d-be92-4983-aaac-68ebadfc0aee None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:13.432989 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce29f6a-5920-4693-a4df-16ef87d61f27 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:13.471724 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60d3b28-885c-4679-b5a4-968995ea2658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:13.472353 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60d3b28-885c-4679-b5a4-968995ea2658 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:13.472353 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60d3b28-885c-4679-b5a4-968995ea2658 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:13.472671 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60d3b28-885c-4679-b5a4-968995ea2658 None admin] PATH_INFO: `/v3/services` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:13.473287 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60d3b28-885c-4679-b5a4-968995ea2658 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:00:13.473663 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60d3b28-885c-4679-b5a4-968995ea2658 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:13.474930 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60d3b28-885c-4679-b5a4-968995ea2658 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:13.480764 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 390/795] 10.222.0.79 () {56 vars in 1124 bytes} [Tue Aug 30 01:00:13 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:00:13.482314 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60d3b28-885c-4679-b5a4-968995ea2658 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:13.544003 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:13.573673 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f977988d-be92-4983-aaac-68ebadfc0aee None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:13.598142 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:13.609406 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60d3b28-885c-4679-b5a4-968995ea2658 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:13.611358 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1293fd5-81ff-48b8-911a-08245e502660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:13.611964 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1293fd5-81ff-48b8-911a-08245e502660 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:13.612241 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1293fd5-81ff-48b8-911a-08245e502660 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:13.612511 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1293fd5-81ff-48b8-911a-08245e502660 None admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:13.613831 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1293fd5-81ff-48b8-911a-08245e502660 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:00:13.613831 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1293fd5-81ff-48b8-911a-08245e502660 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:13.614779 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1293fd5-81ff-48b8-911a-08245e502660 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:13.632106 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 406/796] 10.222.0.79 () {56 vars in 1109 bytes} [Tue Aug 30 01:00:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:00:13.634713 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1293fd5-81ff-48b8-911a-08245e502660 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:13.658689 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83df1f3d-7eb3-40d9-8ed7-11ec0b280298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:13.659971 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83df1f3d-7eb3-40d9-8ed7-11ec0b280298 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:13.660453 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83df1f3d-7eb3-40d9-8ed7-11ec0b280298 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:13.661168 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83df1f3d-7eb3-40d9-8ed7-11ec0b280298 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:13.673271 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83df1f3d-7eb3-40d9-8ed7-11ec0b280298 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:13.674956 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83df1f3d-7eb3-40d9-8ed7-11ec0b280298 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:13.692908 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application [None req-83df1f3d-7eb3-40d9-8ed7-11ec0b280298 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 01:00:13.692908 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:00:13.692908 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:00:13.692908 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:00:13.692908 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:00:13.692908 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:00:13.692908 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:00:13.692908 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:00:13.692908 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:00:13.692908 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:00:13.692908 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:00:13.692908 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:00:13.692908 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 01:00:13.692908 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 01:00:13.692908 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 01:00:13.692908 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 01:00:13.694094 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:00:13.694094 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:00:13.694094 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 01:00:13.694094 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 01:00:13.694094 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 01:00:13.694094 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 01:00:13.694094 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:00:13.694094 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:00:13.694094 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:00:13.694094 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:00:13.694094 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:00:13.694094 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application with Lock( Aug 30 01:00:13.694094 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:00:13.694094 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:00:13.694094 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:00:13.694094 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:00:13.694094 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:00:13.694094 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:00:13.695265 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:00:13.695265 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:00:13.695265 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 01:00:13.695265 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 01:00:13.695265 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 01:00:13.695265 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 01:00:13.695265 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 01:00:13.695265 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 01:00:13.695265 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 01:00:13.695265 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Aug 30 01:00:13.701415 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 391/797] 10.222.0.79 () {56 vars in 1117 bytes} [Tue Aug 30 01:00:13 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:00:13.702334 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83df1f3d-7eb3-40d9-8ed7-11ec0b280298 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:13.760212 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1293fd5-81ff-48b8-911a-08245e502660 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:13.795050 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:13.802760 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a27aba-cfba-465d-9047-3a933bc6e7bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:13.803504 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a27aba-cfba-465d-9047-3a933bc6e7bd None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:13.803850 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a27aba-cfba-465d-9047-3a933bc6e7bd None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:13.804195 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a27aba-cfba-465d-9047-3a933bc6e7bd None admin] PATH_INFO: `/v3/services` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:13.804925 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a27aba-cfba-465d-9047-3a933bc6e7bd None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:00:13.805293 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a27aba-cfba-465d-9047-3a933bc6e7bd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:13.806723 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a27aba-cfba-465d-9047-3a933bc6e7bd None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:13.814170 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 407/798] 10.222.0.79 () {56 vars in 1124 bytes} [Tue Aug 30 01:00:13 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:00:13.815311 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a27aba-cfba-465d-9047-3a933bc6e7bd None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:13.830476 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83df1f3d-7eb3-40d9-8ed7-11ec0b280298 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:13.877506 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a8434e-7247-446c-a3cf-7dc735b3990c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:13.878589 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a8434e-7247-446c-a3cf-7dc735b3990c None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:13.879079 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a8434e-7247-446c-a3cf-7dc735b3990c None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:13.879622 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a8434e-7247-446c-a3cf-7dc735b3990c None admin] PATH_INFO: `/v3/users/swift` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:13.892468 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a8434e-7247-446c-a3cf-7dc735b3990c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:13.894883 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a8434e-7247-446c-a3cf-7dc735b3990c None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:13.912386 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application [None req-c2a8434e-7247-446c-a3cf-7dc735b3990c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 30 01:00:13.912386 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:00:13.912386 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:00:13.912386 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:00:13.912386 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:00:13.912386 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:00:13.912386 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:00:13.912386 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:00:13.912386 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:00:13.912386 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:00:13.912386 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:00:13.912386 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:00:13.912386 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 01:00:13.912386 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 01:00:13.912386 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 01:00:13.912386 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 01:00:13.913384 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:00:13.913384 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:00:13.913384 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 01:00:13.913384 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 01:00:13.913384 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 01:00:13.913384 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 01:00:13.913384 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:00:13.913384 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:00:13.913384 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:00:13.913384 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:00:13.913384 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:00:13.913384 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application with Lock( Aug 30 01:00:13.913384 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:00:13.913384 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:00:13.913384 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:00:13.913384 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:00:13.913384 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:00:13.913384 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:00:13.914392 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:00:13.914392 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:00:13.914392 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 01:00:13.914392 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 01:00:13.914392 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 01:00:13.914392 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 01:00:13.914392 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 01:00:13.914392 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 01:00:13.914392 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 30 01:00:13.914392 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Aug 30 01:00:13.914392 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 392/799] 10.222.0.79 () {56 vars in 1096 bytes} [Tue Aug 30 01:00:13 2022] GET /identity/v3/users/swift => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:00:13.915649 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a8434e-7247-446c-a3cf-7dc735b3990c None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:13.938231 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:13.941975 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a27aba-cfba-465d-9047-3a933bc6e7bd None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:13.981989 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2d0e23-3e71-4609-b2a7-c3d6a025bf84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:13.982785 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2d0e23-3e71-4609-b2a7-c3d6a025bf84 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:13.983063 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2d0e23-3e71-4609-b2a7-c3d6a025bf84 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:13.983644 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2d0e23-3e71-4609-b2a7-c3d6a025bf84 None admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:13.984409 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2d0e23-3e71-4609-b2a7-c3d6a025bf84 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:00:13.984714 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2d0e23-3e71-4609-b2a7-c3d6a025bf84 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:13.986560 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2d0e23-3e71-4609-b2a7-c3d6a025bf84 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:14.004507 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 408/800] 10.222.0.79 () {56 vars in 1149 bytes} [Tue Aug 30 01:00:13 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:00:14.006031 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec10b5d-b42a-4b19-a9d7-79f5dcbd4515 None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:14.006376 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec10b5d-b42a-4b19-a9d7-79f5dcbd4515 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:14.006714 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec10b5d-b42a-4b19-a9d7-79f5dcbd4515 None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:14.008127 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 409/801] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 01:00:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:00:14.012613 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec10b5d-b42a-4b19-a9d7-79f5dcbd4515 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:14.040771 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a8434e-7247-446c-a3cf-7dc735b3990c None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:14.069320 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:14.077066 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebe1599-1e73-4e35-a0f7-b5db9893fb56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:14.077668 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebe1599-1e73-4e35-a0f7-b5db9893fb56 None admin] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:14.077947 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebe1599-1e73-4e35-a0f7-b5db9893fb56 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:14.078307 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebe1599-1e73-4e35-a0f7-b5db9893fb56 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:14.078874 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebe1599-1e73-4e35-a0f7-b5db9893fb56 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:14.080260 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebe1599-1e73-4e35-a0f7-b5db9893fb56 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:14.103877 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 393/802] 10.222.0.79 () {60 vars in 1144 bytes} [Tue Aug 30 01:00:13 2022] POST /identity/v3/endpoints => generated 346 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:00:14.104767 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebe1599-1e73-4e35-a0f7-b5db9893fb56 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:14.150159 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec10b5d-b42a-4b19-a9d7-79f5dcbd4515 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:14.192757 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbbfdb7-5945-4f8b-99f9-8c14575c87b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:14.193382 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbbfdb7-5945-4f8b-99f9-8c14575c87b0 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:14.193667 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbbfdb7-5945-4f8b-99f9-8c14575c87b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:14.193933 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbbfdb7-5945-4f8b-99f9-8c14575c87b0 None admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:14.194675 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbbfdb7-5945-4f8b-99f9-8c14575c87b0 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:00:14.194977 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbbfdb7-5945-4f8b-99f9-8c14575c87b0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:14.196934 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbbfdb7-5945-4f8b-99f9-8c14575c87b0 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:14.221834 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:14.222028 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 410/803] 10.222.0.79 () {56 vars in 1135 bytes} [Tue Aug 30 01:00:14 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:00:14.224446 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa71956d-e770-4656-bb96-7393dc5690d1 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:14.224446 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa71956d-e770-4656-bb96-7393dc5690d1 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:14.225019 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa71956d-e770-4656-bb96-7393dc5690d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:14.256603 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-fa71956d-e770-4656-bb96-7393dc5690d1 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:00:14.258228 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-fa71956d-e770-4656-bb96-7393dc5690d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:00:14.265705 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebe1599-1e73-4e35-a0f7-b5db9893fb56 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:14.312539 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad5a7a7-ab38-4a91-8364-d3aecb37edd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:14.313175 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad5a7a7-ab38-4a91-8364-d3aecb37edd1 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:14.313447 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad5a7a7-ab38-4a91-8364-d3aecb37edd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:14.313713 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad5a7a7-ab38-4a91-8364-d3aecb37edd1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:14.329194 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad5a7a7-ab38-4a91-8364-d3aecb37edd1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:14.331480 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad5a7a7-ab38-4a91-8364-d3aecb37edd1 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:14.346868 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 411/804] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 01:00:14 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 01:00:14.347591 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa71956d-e770-4656-bb96-7393dc5690d1 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:14.350107 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application [None req-cad5a7a7-ab38-4a91-8364-d3aecb37edd1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:00:14.350107 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:00:14.350107 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:00:14.350107 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:00:14.350107 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:00:14.350107 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:00:14.350107 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:00:14.350107 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:00:14.350107 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:00:14.350107 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:00:14.350107 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:00:14.350107 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:00:14.350107 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 01:00:14.350107 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 01:00:14.350107 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 01:00:14.350107 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 01:00:14.351040 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:00:14.351040 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:00:14.351040 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:00:14.351040 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:00:14.351040 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:00:14.351040 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:00:14.351040 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:00:14.351040 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application with Lock( Aug 30 01:00:14.351040 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:00:14.351040 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:00:14.351040 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:00:14.351040 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:00:14.351040 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:00:14.351040 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:00:14.351040 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:00:14.351040 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:00:14.351040 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 01:00:14.351976 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 01:00:14.351976 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:00:14.351976 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Aug 30 01:00:14.352547 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 394/805] 10.222.0.79 () {56 vars in 1108 bytes} [Tue Aug 30 01:00:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:00:14.358200 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad5a7a7-ab38-4a91-8364-d3aecb37edd1 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:14.386752 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:14.459421 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa71956d-e770-4656-bb96-7393dc5690d1 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:14.499330 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad5a7a7-ab38-4a91-8364-d3aecb37edd1 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:14.502647 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0749f4-db87-4563-8ac7-6cbbce2d173a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:14.503424 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0749f4-db87-4563-8ac7-6cbbce2d173a None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:14.503869 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0749f4-db87-4563-8ac7-6cbbce2d173a None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:14.504230 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0749f4-db87-4563-8ac7-6cbbce2d173a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:14.517980 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0749f4-db87-4563-8ac7-6cbbce2d173a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:14.519753 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0749f4-db87-4563-8ac7-6cbbce2d173a None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:14.533650 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:14.547422 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-fa0749f4-db87-4563-8ac7-6cbbce2d173a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:00:14.547422 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:00:14.547422 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:00:14.547422 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:00:14.547422 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:00:14.547422 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:00:14.547422 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:00:14.547422 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:00:14.547422 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:00:14.547422 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:00:14.547422 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:00:14.547422 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:00:14.547422 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 01:00:14.547422 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 01:00:14.547422 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 01:00:14.547422 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 01:00:14.548629 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:00:14.548629 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:00:14.548629 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:00:14.548629 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:00:14.548629 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:00:14.548629 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:00:14.548629 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:00:14.548629 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Aug 30 01:00:14.548629 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:00:14.548629 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:00:14.548629 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:00:14.548629 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:00:14.548629 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:00:14.548629 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:00:14.548629 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:00:14.548629 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:00:14.548629 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 01:00:14.550301 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 01:00:14.550301 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:00:14.550301 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Aug 30 01:00:14.550301 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 412/806] 10.222.0.79 () {56 vars in 1108 bytes} [Tue Aug 30 01:00:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:00:14.556221 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0749f4-db87-4563-8ac7-6cbbce2d173a None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:14.557075 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7a07ed-1e73-4f2f-aad8-40ffbfdbe8b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:14.557916 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7a07ed-1e73-4f2f-aad8-40ffbfdbe8b1 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:14.558378 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7a07ed-1e73-4f2f-aad8-40ffbfdbe8b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:14.558824 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7a07ed-1e73-4f2f-aad8-40ffbfdbe8b1 None admin] PATH_INFO: `/v3/domains` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:14.560343 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7a07ed-1e73-4f2f-aad8-40ffbfdbe8b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:00:14.560832 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7a07ed-1e73-4f2f-aad8-40ffbfdbe8b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:14.562405 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7a07ed-1e73-4f2f-aad8-40ffbfdbe8b1 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:14.591251 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 395/807] 10.222.0.79 () {56 vars in 1109 bytes} [Tue Aug 30 01:00:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:00:14.595501 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7a07ed-1e73-4f2f-aad8-40ffbfdbe8b1 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:14.703047 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:14.736675 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0749f4-db87-4563-8ac7-6cbbce2d173a None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:14.767086 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7a07ed-1e73-4f2f-aad8-40ffbfdbe8b1 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:14.781521 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a598a0c2-feb0-41ba-842d-ce620b2cbcc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:14.782056 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a598a0c2-feb0-41ba-842d-ce620b2cbcc2 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:14.782334 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a598a0c2-feb0-41ba-842d-ce620b2cbcc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:14.782601 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a598a0c2-feb0-41ba-842d-ce620b2cbcc2 None admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:14.783278 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a598a0c2-feb0-41ba-842d-ce620b2cbcc2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:00:14.783577 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a598a0c2-feb0-41ba-842d-ce620b2cbcc2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:14.784965 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a598a0c2-feb0-41ba-842d-ce620b2cbcc2 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:14.797170 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 413/808] 10.222.0.79 () {56 vars in 1109 bytes} [Tue Aug 30 01:00:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:00:14.797996 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a598a0c2-feb0-41ba-842d-ce620b2cbcc2 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:14.815156 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e31e0b-0ed6-412c-a4fd-dbf4c82098d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:14.815815 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e31e0b-0ed6-412c-a4fd-dbf4c82098d8 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:14.816091 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e31e0b-0ed6-412c-a4fd-dbf4c82098d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:14.816370 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e31e0b-0ed6-412c-a4fd-dbf4c82098d8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:14.823562 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e31e0b-0ed6-412c-a4fd-dbf4c82098d8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:14.826084 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e31e0b-0ed6-412c-a4fd-dbf4c82098d8 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:14.837532 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application [None req-63e31e0b-0ed6-412c-a4fd-dbf4c82098d8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 01:00:14.837532 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:00:14.837532 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:00:14.837532 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:00:14.837532 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:00:14.837532 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:00:14.837532 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:00:14.837532 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:00:14.837532 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:00:14.837532 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:00:14.837532 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:00:14.837532 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:00:14.837532 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 01:00:14.837532 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 01:00:14.837532 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 01:00:14.838451 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 01:00:14.838451 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:00:14.838451 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:00:14.838451 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:00:14.838451 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:00:14.838451 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:00:14.838451 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:00:14.838451 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:00:14.838451 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application with Lock( Aug 30 01:00:14.838451 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:00:14.838451 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:00:14.838451 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:00:14.838451 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:00:14.838451 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:00:14.838451 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:00:14.838451 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:00:14.838451 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:00:14.839771 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 01:00:14.839771 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 01:00:14.839771 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 01:00:14.839771 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 01:00:14.839771 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 01:00:14.839771 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 01:00:14.839771 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 01:00:14.839771 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Aug 30 01:00:14.843396 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 396/809] 10.222.0.79 () {56 vars in 1111 bytes} [Tue Aug 30 01:00:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:00:14.844661 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1099938b-a3e2-4698-9874-a17d677ba578 None None] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:14.844937 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1099938b-a3e2-4698-9874-a17d677ba578 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:14.845208 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1099938b-a3e2-4698-9874-a17d677ba578 None None] PATH_INFO: `/` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:14.850728 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 397/810] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 01:00:14 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:00:14.850728 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1099938b-a3e2-4698-9874-a17d677ba578 None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:14.898426 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:14.913281 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a598a0c2-feb0-41ba-842d-ce620b2cbcc2 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:14.953538 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76bbef9-a2d4-482b-9577-fa33af3c2926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:14.954171 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76bbef9-a2d4-482b-9577-fa33af3c2926 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:14.954446 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76bbef9-a2d4-482b-9577-fa33af3c2926 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:14.955182 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76bbef9-a2d4-482b-9577-fa33af3c2926 None admin] PATH_INFO: `/v3/services/network` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:14.955777 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76bbef9-a2d4-482b-9577-fa33af3c2926 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:14.957145 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76bbef9-a2d4-482b-9577-fa33af3c2926 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:14.967026 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-b76bbef9-a2d4-482b-9577-fa33af3c2926 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 30 01:00:14.967026 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:00:14.967026 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 01:00:14.967026 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 01:00:14.967026 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 01:00:14.967026 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 01:00:14.967026 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 01:00:14.967026 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 01:00:14.967026 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 30 01:00:14.967026 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Aug 30 01:00:14.967026 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 01:00:14.967026 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Aug 30 01:00:14.967026 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:00:14.967026 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:00:14.967026 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:00:14.967026 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:00:14.967026 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:00:14.968326 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:00:14.968326 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:00:14.968326 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:00:14.968326 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:00:14.968326 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:00:14.968326 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:00:14.968326 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 01:00:14.968326 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 01:00:14.968326 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 01:00:14.968326 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 01:00:14.968326 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:00:14.968326 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:00:14.968326 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:00:14.968326 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:00:14.968326 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:00:14.968326 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:00:14.969204 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:00:14.969204 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Aug 30 01:00:14.969204 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:00:14.969204 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:00:14.969204 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:00:14.969204 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:00:14.969204 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:00:14.969204 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:00:14.969204 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:00:14.969204 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:00:14.969204 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 01:00:14.969204 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 01:00:14.969204 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 30 01:00:14.969204 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Aug 30 01:00:14.969204 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 414/811] 10.222.0.79 () {56 vars in 1111 bytes} [Tue Aug 30 01:00:14 2022] GET /identity/v3/services/network => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:00:14.970004 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76bbef9-a2d4-482b-9577-fa33af3c2926 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:14.970825 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1099938b-a3e2-4698-9874-a17d677ba578 None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:14.990730 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:15.007955 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a80715-1163-4948-af51-3a9ffdf856ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:15.008580 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a80715-1163-4948-af51-3a9ffdf856ce None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:15.008845 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a80715-1163-4948-af51-3a9ffdf856ce None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:15.009144 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a80715-1163-4948-af51-3a9ffdf856ce None admin] PATH_INFO: `/v3/projects/service` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:15.016102 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a80715-1163-4948-af51-3a9ffdf856ce None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:15.017533 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a80715-1163-4948-af51-3a9ffdf856ce None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:15.029082 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application [None req-35a80715-1163-4948-af51-3a9ffdf856ce None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 01:00:15.029082 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:00:15.029082 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:00:15.029082 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:00:15.029082 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:00:15.029082 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:00:15.029082 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:00:15.029082 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:00:15.029082 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:00:15.029082 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:00:15.029082 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:00:15.029082 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:00:15.029082 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 01:00:15.029082 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 01:00:15.029082 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 01:00:15.029997 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 01:00:15.029997 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:00:15.029997 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:00:15.029997 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:00:15.029997 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:00:15.029997 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:00:15.029997 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:00:15.029997 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:00:15.029997 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application with Lock( Aug 30 01:00:15.029997 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:00:15.029997 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:00:15.029997 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:00:15.029997 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:00:15.029997 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:00:15.029997 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:00:15.029997 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:00:15.029997 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:00:15.030872 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 01:00:15.030872 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 01:00:15.030872 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 01:00:15.030872 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 01:00:15.030872 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 01:00:15.030872 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 01:00:15.030872 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 01:00:15.030872 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Aug 30 01:00:15.030872 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 398/812] 10.222.0.79 () {56 vars in 1111 bytes} [Tue Aug 30 01:00:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:00:15.031401 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1a434c-7830-4680-bcb6-4ffa9a2d03a3 None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:15.031811 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1a434c-7830-4680-bcb6-4ffa9a2d03a3 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:15.031921 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1a434c-7830-4680-bcb6-4ffa9a2d03a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:15.049937 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-2e1a434c-7830-4680-bcb6-4ffa9a2d03a3 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:00:15.051101 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-2e1a434c-7830-4680-bcb6-4ffa9a2d03a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:00:15.095888 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76bbef9-a2d4-482b-9577-fa33af3c2926 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:15.131152 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 399/813] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 01:00:15 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 01:00:15.131152 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1a434c-7830-4680-bcb6-4ffa9a2d03a3 None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:15.143509 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bfb358-43e4-4d4b-83f2-464306e23add None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:15.144256 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bfb358-43e4-4d4b-83f2-464306e23add None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:15.144586 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bfb358-43e4-4d4b-83f2-464306e23add None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:15.144911 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bfb358-43e4-4d4b-83f2-464306e23add None admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:15.145716 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bfb358-43e4-4d4b-83f2-464306e23add None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:00:15.146074 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bfb358-43e4-4d4b-83f2-464306e23add None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:15.147708 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bfb358-43e4-4d4b-83f2-464306e23add None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:15.165685 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 415/814] 10.222.0.79 () {56 vars in 1148 bytes} [Tue Aug 30 01:00:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:00:15.166554 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bfb358-43e4-4d4b-83f2-464306e23add None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:15.168229 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:15.249554 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:15.266070 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1a434c-7830-4680-bcb6-4ffa9a2d03a3 None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:15.281603 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bfb358-43e4-4d4b-83f2-464306e23add None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:15.317966 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9370f041-fa98-44f6-ac71-f0b9cc95b3e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:15.319578 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9370f041-fa98-44f6-ac71-f0b9cc95b3e7 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:15.320144 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9370f041-fa98-44f6-ac71-f0b9cc95b3e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:15.320848 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9370f041-fa98-44f6-ac71-f0b9cc95b3e7 None admin] PATH_INFO: `/v3/services` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:15.321883 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9370f041-fa98-44f6-ac71-f0b9cc95b3e7 None admin] RBAC: Adding query filter params (name=network) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:00:15.322756 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9370f041-fa98-44f6-ac71-f0b9cc95b3e7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:15.324625 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9370f041-fa98-44f6-ac71-f0b9cc95b3e7 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:15.328365 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57019522-31f2-47d9-ab19-19175fa2fe5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:15.329335 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57019522-31f2-47d9-ab19-19175fa2fe5f None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:15.329708 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57019522-31f2-47d9-ab19-19175fa2fe5f None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:15.330071 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57019522-31f2-47d9-ab19-19175fa2fe5f None admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:15.330850 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57019522-31f2-47d9-ab19-19175fa2fe5f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:00:15.331271 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57019522-31f2-47d9-ab19-19175fa2fe5f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:15.331574 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 400/815] 10.222.0.79 () {56 vars in 1112 bytes} [Tue Aug 30 01:00:15 2022] GET /identity/v3/services?name=network => generated 124 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:00:15.332488 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9370f041-fa98-44f6-ac71-f0b9cc95b3e7 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:15.333132 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57019522-31f2-47d9-ab19-19175fa2fe5f None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:15.350890 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 416/816] 10.222.0.79 () {56 vars in 1148 bytes} [Tue Aug 30 01:00:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:00:15.352045 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57019522-31f2-47d9-ab19-19175fa2fe5f None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:15.440899 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:15.448440 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9370f041-fa98-44f6-ac71-f0b9cc95b3e7 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:15.467835 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57019522-31f2-47d9-ab19-19175fa2fe5f None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:15.489039 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca72ad9-b5c3-46aa-9dc6-e268e8daa616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:15.489701 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca72ad9-b5c3-46aa-9dc6-e268e8daa616 None admin] REQUEST_METHOD: `PUT` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:15.489976 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca72ad9-b5c3-46aa-9dc6-e268e8daa616 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:15.490867 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca72ad9-b5c3-46aa-9dc6-e268e8daa616 None admin] PATH_INFO: `/v3/projects/0eec3a73673e45dc881de586b9b0fbbb/users/5cacaed93420436e8f423f96a8041401/roles/687d3359d6b2413b84ca5a54d30d5488` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:15.501912 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:15.508124 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d49168c-94c0-410a-b087-69f5a708479f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:15.508277 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca72ad9-b5c3-46aa-9dc6-e268e8daa616 None admin] RBAC: Authorizing `identity:create_grant(project_id=0eec3a73673e45dc881de586b9b0fbbb, user_id=5cacaed93420436e8f423f96a8041401, role_id=687d3359d6b2413b84ca5a54d30d5488)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:15.508820 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d49168c-94c0-410a-b087-69f5a708479f None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:15.509124 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d49168c-94c0-410a-b087-69f5a708479f None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:15.509477 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d49168c-94c0-410a-b087-69f5a708479f None admin] PATH_INFO: `/v3/services` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:15.509737 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca72ad9-b5c3-46aa-9dc6-e268e8daa616 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:15.510195 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d49168c-94c0-410a-b087-69f5a708479f None admin] RBAC: Adding query filter params (type=network) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:00:15.510591 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d49168c-94c0-410a-b087-69f5a708479f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:15.512159 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d49168c-94c0-410a-b087-69f5a708479f None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:15.522981 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 417/817] 10.222.0.79 () {56 vars in 1112 bytes} [Tue Aug 30 01:00:15 2022] GET /identity/v3/services?type=network => generated 350 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:00:15.523841 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d49168c-94c0-410a-b087-69f5a708479f None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:15.523947 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 401/818] 10.222.0.79 () {58 vars in 1439 bytes} [Tue Aug 30 01:00:15 2022] PUT /identity/v3/projects/0eec3a73673e45dc881de586b9b0fbbb/users/5cacaed93420436e8f423f96a8041401/roles/687d3359d6b2413b84ca5a54d30d5488 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:00:15.524720 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca72ad9-b5c3-46aa-9dc6-e268e8daa616 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:15.693152 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d49168c-94c0-410a-b087-69f5a708479f None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:15.711177 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca72ad9-b5c3-46aa-9dc6-e268e8daa616 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:15.750019 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25726a73-f424-4e81-af23-14e204c076f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:15.750645 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25726a73-f424-4e81-af23-14e204c076f7 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:15.750919 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25726a73-f424-4e81-af23-14e204c076f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:15.751218 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25726a73-f424-4e81-af23-14e204c076f7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:15.754887 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f711f71-d35e-438a-8df5-78a186336363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:15.755824 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f711f71-d35e-438a-8df5-78a186336363 None admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:15.756579 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f711f71-d35e-438a-8df5-78a186336363 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:15.757139 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f711f71-d35e-438a-8df5-78a186336363 None admin] PATH_INFO: `/v3/projects/0eec3a73673e45dc881de586b9b0fbbb/users/dd556fa6ba464928b1e067325792a523/roles/d14c3070c9184d76a7b23df69bd3db07` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:15.759921 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f711f71-d35e-438a-8df5-78a186336363 None admin] RBAC: Authorizing `identity:create_grant(project_id=0eec3a73673e45dc881de586b9b0fbbb, user_id=dd556fa6ba464928b1e067325792a523, role_id=d14c3070c9184d76a7b23df69bd3db07)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:15.761892 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f711f71-d35e-438a-8df5-78a186336363 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:15.762702 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25726a73-f424-4e81-af23-14e204c076f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 01:00:15.769421 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application [None req-25726a73-f424-4e81-af23-14e204c076f7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 01:00:15.769421 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:00:15.769421 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:00:15.769421 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:00:15.769421 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:00:15.769421 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:00:15.769421 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:00:15.769421 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:00:15.769421 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:00:15.769421 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:00:15.769421 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:00:15.769421 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:00:15.769421 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 01:00:15.769421 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 01:00:15.769421 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 01:00:15.769421 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 01:00:15.770450 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 01:00:15.770450 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 01:00:15.770450 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 01:00:15.770450 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 01:00:15.770450 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:00:15.770450 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:00:15.770450 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:00:15.770450 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:00:15.770450 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:00:15.770450 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:00:15.770450 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:00:15.770450 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application with Lock( Aug 30 01:00:15.770450 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:00:15.770450 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:00:15.770450 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:00:15.770450 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:00:15.771308 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:00:15.771308 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:00:15.771308 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:00:15.771308 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:00:15.771308 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 01:00:15.771308 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 01:00:15.771308 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 01:00:15.771308 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 01:00:15.771308 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 01:00:15.771308 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 01:00:15.771308 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 01:00:15.771308 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Aug 30 01:00:15.775215 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 402/819] 10.222.0.79 () {56 vars in 1096 bytes} [Tue Aug 30 01:00:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:00:15.776545 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25726a73-f424-4e81-af23-14e204c076f7 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:15.786403 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 418/820] 10.222.0.79 () {58 vars in 1439 bytes} [Tue Aug 30 01:00:15 2022] PUT /identity/v3/projects/0eec3a73673e45dc881de586b9b0fbbb/users/dd556fa6ba464928b1e067325792a523/roles/d14c3070c9184d76a7b23df69bd3db07 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:00:15.787416 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f711f71-d35e-438a-8df5-78a186336363 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:15.791288 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:15.951279 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:15.977237 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25726a73-f424-4e81-af23-14e204c076f7 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:15.990759 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f711f71-d35e-438a-8df5-78a186336363 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:16.029729 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6b4d14-d1c1-4e8f-804f-46267b5726f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:16.030339 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6b4d14-d1c1-4e8f-804f-46267b5726f6 None admin] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:16.030613 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6b4d14-d1c1-4e8f-804f-46267b5726f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:16.030874 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6b4d14-d1c1-4e8f-804f-46267b5726f6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:16.031576 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6b4d14-d1c1-4e8f-804f-46267b5726f6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:16.032947 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6b4d14-d1c1-4e8f-804f-46267b5726f6 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:16.034576 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3867e59-337a-4cad-a878-4561839b1480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:16.035403 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3867e59-337a-4cad-a878-4561839b1480 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:16.035823 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3867e59-337a-4cad-a878-4561839b1480 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:16.036256 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3867e59-337a-4cad-a878-4561839b1480 None admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:16.037074 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3867e59-337a-4cad-a878-4561839b1480 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:00:16.037525 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3867e59-337a-4cad-a878-4561839b1480 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:16.039591 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3867e59-337a-4cad-a878-4561839b1480 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:16.051166 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 419/821] 10.222.0.79 () {56 vars in 1099 bytes} [Tue Aug 30 01:00:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:00:16.059499 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 403/822] 10.222.0.79 () {60 vars in 1144 bytes} [Tue Aug 30 01:00:15 2022] POST /identity/v3/endpoints => generated 337 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:00:16.060687 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3867e59-337a-4cad-a878-4561839b1480 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:16.184626 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3867e59-337a-4cad-a878-4561839b1480 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:16.205763 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:16.246247 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b00261-b664-493c-b083-315c920ebe15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:16.247549 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b00261-b664-493c-b083-315c920ebe15 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:16.247893 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b00261-b664-493c-b083-315c920ebe15 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:16.248229 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b00261-b664-493c-b083-315c920ebe15 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:16.267612 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b00261-b664-493c-b083-315c920ebe15 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:16.269179 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b00261-b664-493c-b083-315c920ebe15 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:16.290802 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-c0b00261-b664-493c-b083-315c920ebe15 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:00:16.290802 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:00:16.290802 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:00:16.290802 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:00:16.290802 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:00:16.290802 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:00:16.290802 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:00:16.290802 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:00:16.290802 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:00:16.290802 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:00:16.290802 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:00:16.290802 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:00:16.290802 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 01:00:16.290802 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 01:00:16.290802 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 01:00:16.290802 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 01:00:16.292005 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:00:16.292005 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:00:16.292005 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:00:16.292005 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:00:16.292005 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:00:16.292005 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:00:16.292005 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:00:16.292005 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Aug 30 01:00:16.292005 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:00:16.292005 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:00:16.292005 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:00:16.292005 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:00:16.292005 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:00:16.292005 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:00:16.292005 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:00:16.292005 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:00:16.292005 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 01:00:16.293119 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 01:00:16.293119 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:00:16.293119 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Aug 30 01:00:16.294342 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 420/823] 10.222.0.79 () {56 vars in 1108 bytes} [Tue Aug 30 01:00:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:00:16.300270 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6b4d14-d1c1-4e8f-804f-46267b5726f6 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:16.373053 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:16.416592 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6b4d14-d1c1-4e8f-804f-46267b5726f6 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:16.445161 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df5fa45-cdef-485c-ac88-77db093e66bf None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:16.445413 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df5fa45-cdef-485c-ac88-77db093e66bf None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:16.445713 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df5fa45-cdef-485c-ac88-77db093e66bf None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:16.447239 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 421/824] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 01:00:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 01:00:16.456425 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0932e4-42fd-4c8a-b35c-1f04131ee0b0 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:16.457044 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0932e4-42fd-4c8a-b35c-1f04131ee0b0 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:16.457513 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0932e4-42fd-4c8a-b35c-1f04131ee0b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:16.462068 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f792960-e120-40d3-b11b-dd70442864ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:16.462068 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f792960-e120-40d3-b11b-dd70442864ac None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:16.462309 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f792960-e120-40d3-b11b-dd70442864ac None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:16.462510 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f792960-e120-40d3-b11b-dd70442864ac None admin] PATH_INFO: `/v3/domains` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:16.463157 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f792960-e120-40d3-b11b-dd70442864ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:00:16.463546 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f792960-e120-40d3-b11b-dd70442864ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:16.464942 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f792960-e120-40d3-b11b-dd70442864ac None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:16.479186 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 404/825] 10.222.0.79 () {56 vars in 1109 bytes} [Tue Aug 30 01:00:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:00:16.480429 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-9f0932e4-42fd-4c8a-b35c-1f04131ee0b0 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:00:16.482226 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-9f0932e4-42fd-4c8a-b35c-1f04131ee0b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:00:16.486028 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f792960-e120-40d3-b11b-dd70442864ac None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:16.574986 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 422/826] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 01:00:16 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (3 switches on core 0) Aug 30 01:00:16.615938 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f792960-e120-40d3-b11b-dd70442864ac None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:16.647400 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:16.659656 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf5ffff-09f0-429a-b1ce-7c6ae862179e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:16.660279 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf5ffff-09f0-429a-b1ce-7c6ae862179e None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:16.660558 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf5ffff-09f0-429a-b1ce-7c6ae862179e None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:16.660829 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf5ffff-09f0-429a-b1ce-7c6ae862179e None admin] PATH_INFO: `/v3/users/nova` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:16.668253 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf5ffff-09f0-429a-b1ce-7c6ae862179e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:16.670232 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf5ffff-09f0-429a-b1ce-7c6ae862179e None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:16.682345 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application [None req-6bf5ffff-09f0-429a-b1ce-7c6ae862179e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 30 01:00:16.682345 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:00:16.682345 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:00:16.682345 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:00:16.682345 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:00:16.682345 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:00:16.682345 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:00:16.682345 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:00:16.682345 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:00:16.682345 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:00:16.682345 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:00:16.682345 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:00:16.682345 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 01:00:16.682345 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 01:00:16.682345 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 01:00:16.682345 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 01:00:16.683336 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:00:16.683336 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:00:16.683336 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 01:00:16.683336 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 01:00:16.683336 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 01:00:16.683336 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 01:00:16.683336 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:00:16.683336 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:00:16.683336 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:00:16.683336 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:00:16.683336 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:00:16.683336 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application with Lock( Aug 30 01:00:16.683336 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:00:16.683336 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:00:16.683336 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:00:16.683336 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:00:16.683336 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:00:16.683336 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:00:16.684831 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:00:16.684831 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:00:16.684831 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 01:00:16.684831 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 01:00:16.684831 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 01:00:16.684831 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 01:00:16.684831 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 01:00:16.684831 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 01:00:16.684831 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 30 01:00:16.684831 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Aug 30 01:00:16.684831 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 405/827] 10.222.0.79 () {56 vars in 1093 bytes} [Tue Aug 30 01:00:16 2022] GET /identity/v3/users/nova => generated 82 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 01:00:16.689784 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0932e4-42fd-4c8a-b35c-1f04131ee0b0 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:16.795115 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:16.801069 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0932e4-42fd-4c8a-b35c-1f04131ee0b0 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:16.836687 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc7b117-d251-4d56-9ff4-c1a549ac5c74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:16.837293 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc7b117-d251-4d56-9ff4-c1a549ac5c74 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:16.837567 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc7b117-d251-4d56-9ff4-c1a549ac5c74 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:16.837838 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc7b117-d251-4d56-9ff4-c1a549ac5c74 None admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:16.838566 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc7b117-d251-4d56-9ff4-c1a549ac5c74 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:00:16.838866 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc7b117-d251-4d56-9ff4-c1a549ac5c74 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:16.840838 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc7b117-d251-4d56-9ff4-c1a549ac5c74 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:16.859170 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 423/828] 10.222.0.79 () {56 vars in 1133 bytes} [Tue Aug 30 01:00:16 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:00:16.868335 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf5ffff-09f0-429a-b1ce-7c6ae862179e None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:16.886771 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc7b117-d251-4d56-9ff4-c1a549ac5c74 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:16.982277 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf5ffff-09f0-429a-b1ce-7c6ae862179e None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:17.016821 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc7b117-d251-4d56-9ff4-c1a549ac5c74 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:17.024256 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01afdcd0-2abb-47ee-a444-548e2289eeb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:17.025170 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01afdcd0-2abb-47ee-a444-548e2289eeb9 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:17.026145 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01afdcd0-2abb-47ee-a444-548e2289eeb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:17.026684 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01afdcd0-2abb-47ee-a444-548e2289eeb9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:17.055249 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9edf75b-5112-4844-8a91-bfc9bca567ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:17.055809 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9edf75b-5112-4844-8a91-bfc9bca567ee None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:17.056081 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9edf75b-5112-4844-8a91-bfc9bca567ee None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:17.056346 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9edf75b-5112-4844-8a91-bfc9bca567ee None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:17.056941 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9edf75b-5112-4844-8a91-bfc9bca567ee None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:17.058281 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9edf75b-5112-4844-8a91-bfc9bca567ee None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:17.068282 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-a9edf75b-5112-4844-8a91-bfc9bca567ee None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 30 01:00:17.068282 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:00:17.068282 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 01:00:17.068282 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 01:00:17.068282 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 01:00:17.068282 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 01:00:17.068282 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 01:00:17.068282 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 01:00:17.068282 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 30 01:00:17.068282 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Aug 30 01:00:17.068282 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 01:00:17.068282 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Aug 30 01:00:17.068282 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:00:17.068282 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:00:17.068282 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:00:17.068282 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:00:17.068282 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:00:17.069306 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:00:17.069306 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:00:17.069306 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:00:17.069306 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:00:17.069306 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:00:17.069306 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:00:17.069306 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 01:00:17.069306 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 01:00:17.069306 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 01:00:17.069306 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 01:00:17.069306 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:00:17.069306 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:00:17.069306 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:00:17.069306 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:00:17.069306 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:00:17.069306 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:00:17.070120 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:00:17.070120 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Aug 30 01:00:17.070120 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:00:17.070120 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:00:17.070120 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:00:17.070120 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:00:17.070120 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:00:17.070120 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:00:17.070120 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:00:17.070120 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:00:17.070120 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 01:00:17.070120 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 01:00:17.070120 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 30 01:00:17.070120 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Aug 30 01:00:17.070120 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 424/829] 10.222.0.79 () {56 vars in 1114 bytes} [Tue Aug 30 01:00:16 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 01:00:17.077479 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9edf75b-5112-4844-8a91-bfc9bca567ee None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:17.100939 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:17.104050 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:17.130493 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01afdcd0-2abb-47ee-a444-548e2289eeb9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:17.132311 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01afdcd0-2abb-47ee-a444-548e2289eeb9 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:17.217650 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9edf75b-5112-4844-8a91-bfc9bca567ee None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:17.255001 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64465cd2-dcb8-4895-add3-024b2339b14d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:17.255931 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64465cd2-dcb8-4895-add3-024b2339b14d None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:17.256381 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64465cd2-dcb8-4895-add3-024b2339b14d None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:17.256923 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64465cd2-dcb8-4895-add3-024b2339b14d None admin] PATH_INFO: `/v3/services` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:17.257739 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64465cd2-dcb8-4895-add3-024b2339b14d None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:00:17.258208 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64465cd2-dcb8-4895-add3-024b2339b14d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:17.259754 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64465cd2-dcb8-4895-add3-024b2339b14d None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:17.269852 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 406/831] 10.222.0.79 () {58 vars in 1282 bytes} [Tue Aug 30 01:00:16 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 01:00:17.269852 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01afdcd0-2abb-47ee-a444-548e2289eeb9 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:17.270248 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 425/831] 10.222.0.79 () {56 vars in 1114 bytes} [Tue Aug 30 01:00:17 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:00:17.271316 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64465cd2-dcb8-4895-add3-024b2339b14d None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:17.354910 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:17.358609 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:17.376438 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01afdcd0-2abb-47ee-a444-548e2289eeb9 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:17.379302 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64465cd2-dcb8-4895-add3-024b2339b14d None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:17.413626 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8cb4ed-4fa2-44e9-82f1-41036002f206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:17.414385 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8cb4ed-4fa2-44e9-82f1-41036002f206 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:17.414751 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8cb4ed-4fa2-44e9-82f1-41036002f206 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:17.415023 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8cb4ed-4fa2-44e9-82f1-41036002f206 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:17.417635 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e45f270-c5a3-46a5-906d-06d53574484f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:17.418512 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e45f270-c5a3-46a5-906d-06d53574484f None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:17.418999 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e45f270-c5a3-46a5-906d-06d53574484f None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:17.419490 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e45f270-c5a3-46a5-906d-06d53574484f None admin] PATH_INFO: `/v3/services` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:17.420311 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e45f270-c5a3-46a5-906d-06d53574484f None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:00:17.420962 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e45f270-c5a3-46a5-906d-06d53574484f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:17.422500 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e45f270-c5a3-46a5-906d-06d53574484f None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:17.426234 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8cb4ed-4fa2-44e9-82f1-41036002f206 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:17.427798 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8cb4ed-4fa2-44e9-82f1-41036002f206 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:17.435659 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 426/832] 10.222.0.79 () {56 vars in 1114 bytes} [Tue Aug 30 01:00:17 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:00:17.444562 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application [None req-2d8cb4ed-4fa2-44e9-82f1-41036002f206 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:00:17.444562 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:00:17.444562 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:00:17.444562 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:00:17.444562 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:00:17.444562 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:00:17.444562 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:00:17.444562 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:00:17.444562 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:00:17.444562 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:00:17.444562 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:00:17.444562 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:00:17.444562 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 01:00:17.444562 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 01:00:17.444562 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 01:00:17.444562 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 01:00:17.445579 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:00:17.445579 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:00:17.445579 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:00:17.445579 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:00:17.445579 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:00:17.445579 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:00:17.445579 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:00:17.445579 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application with Lock( Aug 30 01:00:17.445579 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:00:17.445579 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:00:17.445579 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:00:17.445579 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:00:17.445579 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:00:17.445579 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:00:17.445579 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:00:17.445579 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:00:17.445579 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 01:00:17.446512 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 01:00:17.446512 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:00:17.446512 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Aug 30 01:00:17.450970 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 407/833] 10.222.0.79 () {56 vars in 1108 bytes} [Tue Aug 30 01:00:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:00:17.452415 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e45f270-c5a3-46a5-906d-06d53574484f None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:17.572854 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e45f270-c5a3-46a5-906d-06d53574484f None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:17.609790 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbbc893-74c3-423b-8b73-10edb3af1b63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:17.610674 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbbc893-74c3-423b-8b73-10edb3af1b63 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:17.611149 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbbc893-74c3-423b-8b73-10edb3af1b63 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:17.611612 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbbc893-74c3-423b-8b73-10edb3af1b63 None admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:17.612437 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbbc893-74c3-423b-8b73-10edb3af1b63 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:00:17.612905 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbbc893-74c3-423b-8b73-10edb3af1b63 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:17.614417 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbbc893-74c3-423b-8b73-10edb3af1b63 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:17.628716 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 427/834] 10.222.0.79 () {56 vars in 1109 bytes} [Tue Aug 30 01:00:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:00:17.643175 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8cb4ed-4fa2-44e9-82f1-41036002f206 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:17.735731 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90380c37-8f5f-4397-85e0-e715b8ecca03 None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:17.736083 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90380c37-8f5f-4397-85e0-e715b8ecca03 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:17.736279 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90380c37-8f5f-4397-85e0-e715b8ecca03 None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:17.737857 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 428/835] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 01:00:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 01:00:17.742799 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49ed18a-3b6e-4a7c-859b-0f64e3ff4628 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:17.743072 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49ed18a-3b6e-4a7c-859b-0f64e3ff4628 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:17.743375 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49ed18a-3b6e-4a7c-859b-0f64e3ff4628 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:17.749055 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8cb4ed-4fa2-44e9-82f1-41036002f206 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:17.758583 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:17.763049 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-a49ed18a-3b6e-4a7c-859b-0f64e3ff4628 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:00:17.765320 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-a49ed18a-3b6e-4a7c-859b-0f64e3ff4628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:00:17.787483 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce1f409-d5a5-41e6-a91f-42d392908ef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:17.788121 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce1f409-d5a5-41e6-a91f-42d392908ef4 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:17.788504 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce1f409-d5a5-41e6-a91f-42d392908ef4 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:17.788777 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce1f409-d5a5-41e6-a91f-42d392908ef4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:17.790789 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:17.798935 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce1f409-d5a5-41e6-a91f-42d392908ef4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:17.800440 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce1f409-d5a5-41e6-a91f-42d392908ef4 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:17.813963 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application [None req-6ce1f409-d5a5-41e6-a91f-42d392908ef4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 01:00:17.813963 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:00:17.813963 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:00:17.813963 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:00:17.813963 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:00:17.813963 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:00:17.813963 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:00:17.813963 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:00:17.813963 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:00:17.813963 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:00:17.813963 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:00:17.813963 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:00:17.813963 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 01:00:17.813963 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 01:00:17.813963 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 01:00:17.814916 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 01:00:17.814916 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:00:17.814916 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:00:17.814916 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:00:17.814916 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:00:17.814916 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:00:17.814916 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:00:17.814916 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:00:17.814916 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application with Lock( Aug 30 01:00:17.814916 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:00:17.814916 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:00:17.814916 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:00:17.814916 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:00:17.814916 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:00:17.814916 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:00:17.814916 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:00:17.814916 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:00:17.815841 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 01:00:17.815841 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 01:00:17.815841 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 01:00:17.815841 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 01:00:17.815841 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 01:00:17.815841 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 01:00:17.815841 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 01:00:17.815841 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Aug 30 01:00:17.820096 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 408/836] 10.222.0.79 () {56 vars in 1111 bytes} [Tue Aug 30 01:00:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:00:17.821664 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce1f409-d5a5-41e6-a91f-42d392908ef4 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:17.859352 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 429/837] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 01:00:17 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 01:00:17.927668 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce1f409-d5a5-41e6-a91f-42d392908ef4 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:17.962622 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52364ca-8a9c-4a1b-9d11-e4bbfa453116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:17.963249 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52364ca-8a9c-4a1b-9d11-e4bbfa453116 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:17.963525 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52364ca-8a9c-4a1b-9d11-e4bbfa453116 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:17.963786 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52364ca-8a9c-4a1b-9d11-e4bbfa453116 None admin] PATH_INFO: `/v3/projects` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:17.964464 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52364ca-8a9c-4a1b-9d11-e4bbfa453116 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:00:17.964760 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52364ca-8a9c-4a1b-9d11-e4bbfa453116 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:17.966938 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52364ca-8a9c-4a1b-9d11-e4bbfa453116 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:17.979519 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 409/838] 10.222.0.79 () {56 vars in 1148 bytes} [Tue Aug 30 01:00:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:00:17.985643 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49ed18a-3b6e-4a7c-859b-0f64e3ff4628 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:18.066282 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a79329-0590-4117-a63d-c66dae36e171 None None] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:18.066595 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a79329-0590-4117-a63d-c66dae36e171 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:18.066829 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a79329-0590-4117-a63d-c66dae36e171 None None] PATH_INFO: `/` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:18.068731 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 410/839] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 01:00:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 01:00:18.073709 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4406a4b8-fce5-4e45-8483-255b9293423b None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:18.074229 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4406a4b8-fce5-4e45-8483-255b9293423b None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:18.075270 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4406a4b8-fce5-4e45-8483-255b9293423b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:18.093806 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-4406a4b8-fce5-4e45-8483-255b9293423b None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:00:18.095343 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-4406a4b8-fce5-4e45-8483-255b9293423b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:00:18.100362 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49ed18a-3b6e-4a7c-859b-0f64e3ff4628 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:18.144366 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0e7152-caa5-4d17-9194-c6ee9e9a7375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:18.144977 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0e7152-caa5-4d17-9194-c6ee9e9a7375 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:18.145247 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0e7152-caa5-4d17-9194-c6ee9e9a7375 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:18.145513 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0e7152-caa5-4d17-9194-c6ee9e9a7375 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:18.146255 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0e7152-caa5-4d17-9194-c6ee9e9a7375 None admin] RBAC: Adding query filter params (role.id=d14c3070c9184d76a7b23df69bd3db07, scope.project.id=0eec3a73673e45dc881de586b9b0fbbb, user.id=6480b2f14c37474c89df9fba48f7cd91) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:00:18.146534 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0e7152-caa5-4d17-9194-c6ee9e9a7375 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:18.147967 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0e7152-caa5-4d17-9194-c6ee9e9a7375 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:18.148180 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:18.150909 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:18.163334 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 430/840] 10.222.0.79 () {56 vars in 1374 bytes} [Tue Aug 30 01:00:17 2022] GET /identity/v3/role_assignments?user.id=6480b2f14c37474c89df9fba48f7cd91&scope.project.id=0eec3a73673e45dc881de586b9b0fbbb&role.id=d14c3070c9184d76a7b23df69bd3db07 => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:00:18.164479 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0e7152-caa5-4d17-9194-c6ee9e9a7375 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:18.179254 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 411/841] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 01:00:18 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 01:00:18.298076 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0e7152-caa5-4d17-9194-c6ee9e9a7375 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:18.335396 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1543138-d28c-42ab-9209-8d4c774f518c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:18.336029 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1543138-d28c-42ab-9209-8d4c774f518c None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:18.336303 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1543138-d28c-42ab-9209-8d4c774f518c None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:18.336568 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1543138-d28c-42ab-9209-8d4c774f518c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:18.348397 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1543138-d28c-42ab-9209-8d4c774f518c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 01:00:18.353715 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-c1543138-d28c-42ab-9209-8d4c774f518c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 01:00:18.353715 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:00:18.353715 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:00:18.353715 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:00:18.353715 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:00:18.353715 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:00:18.353715 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:00:18.353715 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:00:18.353715 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:00:18.353715 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:00:18.353715 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:00:18.353715 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:00:18.353715 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 01:00:18.353715 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 01:00:18.353715 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 01:00:18.353715 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 01:00:18.354664 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 01:00:18.354664 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 01:00:18.354664 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 01:00:18.354664 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 01:00:18.354664 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:00:18.354664 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:00:18.354664 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:00:18.354664 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:00:18.354664 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:00:18.354664 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:00:18.354664 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:00:18.354664 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Aug 30 01:00:18.354664 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:00:18.354664 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:00:18.354664 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:00:18.354664 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:00:18.355539 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:00:18.355539 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:00:18.355539 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:00:18.355539 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:00:18.355539 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 01:00:18.355539 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 01:00:18.355539 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 01:00:18.355539 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 01:00:18.355539 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 01:00:18.355539 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 01:00:18.355539 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 01:00:18.355539 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Aug 30 01:00:18.355539 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 431/842] 10.222.0.79 () {56 vars in 1102 bytes} [Tue Aug 30 01:00:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:00:18.361188 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4406a4b8-fce5-4e45-8483-255b9293423b None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:18.462136 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1543138-d28c-42ab-9209-8d4c774f518c None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:18.477710 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4406a4b8-fce5-4e45-8483-255b9293423b None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:18.518063 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12158ad9-9001-44a0-acb4-3acdb064cab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:18.518673 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12158ad9-9001-44a0-acb4-3acdb064cab2 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:18.518948 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12158ad9-9001-44a0-acb4-3acdb064cab2 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:18.519240 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12158ad9-9001-44a0-acb4-3acdb064cab2 None admin] PATH_INFO: `/v3/roles` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:18.519907 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12158ad9-9001-44a0-acb4-3acdb064cab2 None admin] RBAC: Adding query filter params (name=service) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:00:18.520201 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12158ad9-9001-44a0-acb4-3acdb064cab2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:18.521567 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12158ad9-9001-44a0-acb4-3acdb064cab2 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:18.531160 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:18.532401 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 412/843] 10.222.0.79 () {56 vars in 1103 bytes} [Tue Aug 30 01:00:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:00:18.537720 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12158ad9-9001-44a0-acb4-3acdb064cab2 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:18.587750 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1543138-d28c-42ab-9209-8d4c774f518c None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:18.605238 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:18.640563 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd5114e-7de3-4ad6-a34a-665ceb0a05d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:18.642223 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd5114e-7de3-4ad6-a34a-665ceb0a05d2 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:18.643537 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd5114e-7de3-4ad6-a34a-665ceb0a05d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:18.643919 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd5114e-7de3-4ad6-a34a-665ceb0a05d2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:18.658203 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd5114e-7de3-4ad6-a34a-665ceb0a05d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 01:00:18.665037 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-9fd5114e-7de3-4ad6-a34a-665ceb0a05d2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 01:00:18.665037 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:00:18.665037 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:00:18.665037 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:00:18.665037 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:00:18.665037 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:00:18.665037 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:00:18.665037 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:00:18.665037 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:00:18.665037 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:00:18.665037 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:00:18.665037 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:00:18.665037 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 01:00:18.665037 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 01:00:18.665037 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 01:00:18.665037 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 01:00:18.666098 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 01:00:18.666098 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 01:00:18.666098 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 01:00:18.666098 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 01:00:18.666098 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:00:18.666098 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:00:18.666098 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:00:18.666098 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:00:18.666098 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:00:18.666098 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:00:18.666098 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:00:18.666098 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Aug 30 01:00:18.666098 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:00:18.666098 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:00:18.666098 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:00:18.666098 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:00:18.666953 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:00:18.666953 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:00:18.666953 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:00:18.666953 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:00:18.666953 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 01:00:18.666953 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 01:00:18.666953 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 01:00:18.666953 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 01:00:18.666953 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 01:00:18.666953 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 01:00:18.666953 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 01:00:18.666953 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Aug 30 01:00:18.667623 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 432/844] 10.222.0.79 () {56 vars in 1096 bytes} [Tue Aug 30 01:00:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 01:00:18.673927 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd5114e-7de3-4ad6-a34a-665ceb0a05d2 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:18.682215 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12158ad9-9001-44a0-acb4-3acdb064cab2 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:18.721638 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9e24f6-5c4a-4fdb-bda8-9e6340371806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:18.722976 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9e24f6-5c4a-4fdb-bda8-9e6340371806 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:18.723466 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9e24f6-5c4a-4fdb-bda8-9e6340371806 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:18.723911 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9e24f6-5c4a-4fdb-bda8-9e6340371806 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:18.737111 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9e24f6-5c4a-4fdb-bda8-9e6340371806 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:18.738837 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9e24f6-5c4a-4fdb-bda8-9e6340371806 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:18.755468 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application [None req-7c9e24f6-5c4a-4fdb-bda8-9e6340371806 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:00:18.755468 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:00:18.755468 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:00:18.755468 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:00:18.755468 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:00:18.755468 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:00:18.755468 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:00:18.755468 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:00:18.755468 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:00:18.755468 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:00:18.755468 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:00:18.755468 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:00:18.755468 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 01:00:18.755468 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 01:00:18.755468 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 01:00:18.755468 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 01:00:18.756436 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:00:18.756436 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:00:18.756436 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:00:18.756436 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:00:18.756436 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:00:18.756436 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:00:18.756436 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:00:18.756436 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application with Lock( Aug 30 01:00:18.756436 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:00:18.756436 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:00:18.756436 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:00:18.756436 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:00:18.756436 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:00:18.756436 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:00:18.756436 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:00:18.756436 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:00:18.756436 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 01:00:18.757323 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 01:00:18.757323 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:00:18.757323 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Aug 30 01:00:18.759432 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 413/845] 10.222.0.79 () {56 vars in 1108 bytes} [Tue Aug 30 01:00:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 01:00:18.765454 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9e24f6-5c4a-4fdb-bda8-9e6340371806 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:18.794928 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd5114e-7de3-4ad6-a34a-665ceb0a05d2 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:18.822325 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:18.844644 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c75493a-f936-45da-9405-24eb87f5d741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:18.845263 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c75493a-f936-45da-9405-24eb87f5d741 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:18.845543 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c75493a-f936-45da-9405-24eb87f5d741 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:18.845815 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c75493a-f936-45da-9405-24eb87f5d741 None admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:18.846550 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c75493a-f936-45da-9405-24eb87f5d741 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:00:18.846890 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c75493a-f936-45da-9405-24eb87f5d741 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:18.849428 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c75493a-f936-45da-9405-24eb87f5d741 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:18.867178 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 433/846] 10.222.0.79 () {56 vars in 1099 bytes} [Tue Aug 30 01:00:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:00:18.870967 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c75493a-f936-45da-9405-24eb87f5d741 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:18.907623 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:18.912854 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9e24f6-5c4a-4fdb-bda8-9e6340371806 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:18.957376 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae4322e-6d8d-482a-a703-5a5903e5685e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:18.958155 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae4322e-6d8d-482a-a703-5a5903e5685e None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:18.958577 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae4322e-6d8d-482a-a703-5a5903e5685e None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:18.958938 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae4322e-6d8d-482a-a703-5a5903e5685e None admin] PATH_INFO: `/v3/domains` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:18.959855 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae4322e-6d8d-482a-a703-5a5903e5685e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:00:18.960249 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae4322e-6d8d-482a-a703-5a5903e5685e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:18.961804 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae4322e-6d8d-482a-a703-5a5903e5685e None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:18.976211 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 414/847] 10.222.0.79 () {56 vars in 1109 bytes} [Tue Aug 30 01:00:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:00:18.981998 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae4322e-6d8d-482a-a703-5a5903e5685e None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:18.997991 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c75493a-f936-45da-9405-24eb87f5d741 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:19.035003 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827cb7d4-701a-4ffd-b5fd-8bf9e05c4b67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:19.035900 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827cb7d4-701a-4ffd-b5fd-8bf9e05c4b67 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:19.036424 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827cb7d4-701a-4ffd-b5fd-8bf9e05c4b67 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:19.036899 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827cb7d4-701a-4ffd-b5fd-8bf9e05c4b67 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:19.047623 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827cb7d4-701a-4ffd-b5fd-8bf9e05c4b67 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:19.049461 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827cb7d4-701a-4ffd-b5fd-8bf9e05c4b67 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:19.065153 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-827cb7d4-701a-4ffd-b5fd-8bf9e05c4b67 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:00:19.065153 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:00:19.065153 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:00:19.065153 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:00:19.065153 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:00:19.065153 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:00:19.065153 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:00:19.065153 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:00:19.065153 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:00:19.065153 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:00:19.065153 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:00:19.065153 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:00:19.065153 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 01:00:19.065153 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 01:00:19.065153 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 01:00:19.065153 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 01:00:19.066151 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:00:19.066151 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:00:19.066151 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:00:19.066151 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:00:19.066151 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:00:19.066151 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:00:19.066151 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:00:19.066151 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Aug 30 01:00:19.066151 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:00:19.066151 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:00:19.066151 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:00:19.066151 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:00:19.066151 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:00:19.066151 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:00:19.066151 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:00:19.066151 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:00:19.066151 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 01:00:19.067047 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 01:00:19.067047 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:00:19.067047 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Aug 30 01:00:19.073846 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 434/848] 10.222.0.79 () {56 vars in 1108 bytes} [Tue Aug 30 01:00:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:00:19.075569 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827cb7d4-701a-4ffd-b5fd-8bf9e05c4b67 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:19.096188 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae4322e-6d8d-482a-a703-5a5903e5685e None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:19.114000 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:19.139288 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e910066-0da9-4de9-8581-05ae4cc9df1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:19.139818 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e910066-0da9-4de9-8581-05ae4cc9df1e None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:19.140463 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e910066-0da9-4de9-8581-05ae4cc9df1e None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:19.140463 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e910066-0da9-4de9-8581-05ae4cc9df1e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:19.149229 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e910066-0da9-4de9-8581-05ae4cc9df1e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:19.150934 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e910066-0da9-4de9-8581-05ae4cc9df1e None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:19.164817 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application [None req-2e910066-0da9-4de9-8581-05ae4cc9df1e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 01:00:19.164817 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:00:19.164817 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:00:19.164817 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:00:19.164817 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:00:19.164817 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:00:19.164817 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:00:19.164817 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:00:19.164817 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:00:19.164817 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:00:19.164817 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:00:19.164817 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:00:19.164817 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 01:00:19.164817 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 01:00:19.164817 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 01:00:19.164817 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 01:00:19.165827 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:00:19.165827 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:00:19.165827 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 01:00:19.165827 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 01:00:19.165827 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 01:00:19.165827 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 01:00:19.165827 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:00:19.165827 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:00:19.165827 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:00:19.165827 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:00:19.165827 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:00:19.165827 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application with Lock( Aug 30 01:00:19.165827 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:00:19.165827 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:00:19.165827 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:00:19.165827 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:00:19.165827 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:00:19.165827 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:00:19.166762 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:00:19.166762 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:00:19.166762 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 01:00:19.166762 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 01:00:19.166762 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 01:00:19.166762 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 01:00:19.166762 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 01:00:19.166762 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 01:00:19.166762 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 01:00:19.166762 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Aug 30 01:00:19.170560 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 415/849] 10.222.0.79 () {56 vars in 1117 bytes} [Tue Aug 30 01:00:18 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:00:19.171733 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e910066-0da9-4de9-8581-05ae4cc9df1e None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:19.194775 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:19.202670 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827cb7d4-701a-4ffd-b5fd-8bf9e05c4b67 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:19.238382 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ab8b77-f0f9-4a40-bfc8-055b9945a552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:19.240037 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ab8b77-f0f9-4a40-bfc8-055b9945a552 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:19.240542 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ab8b77-f0f9-4a40-bfc8-055b9945a552 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:19.241013 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ab8b77-f0f9-4a40-bfc8-055b9945a552 None admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:19.241862 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ab8b77-f0f9-4a40-bfc8-055b9945a552 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:00:19.242361 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ab8b77-f0f9-4a40-bfc8-055b9945a552 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:19.243963 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ab8b77-f0f9-4a40-bfc8-055b9945a552 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:19.261854 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 435/850] 10.222.0.79 () {56 vars in 1109 bytes} [Tue Aug 30 01:00:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:00:19.263743 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ab8b77-f0f9-4a40-bfc8-055b9945a552 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:19.300989 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e910066-0da9-4de9-8581-05ae4cc9df1e None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:19.340114 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6895a40c-5391-497b-b7d2-9b860f55cdd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:19.340798 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6895a40c-5391-497b-b7d2-9b860f55cdd3 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:19.341096 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6895a40c-5391-497b-b7d2-9b860f55cdd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:19.341610 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6895a40c-5391-497b-b7d2-9b860f55cdd3 None admin] PATH_INFO: `/v3/users` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:19.342342 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6895a40c-5391-497b-b7d2-9b860f55cdd3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:00:19.342640 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6895a40c-5391-497b-b7d2-9b860f55cdd3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:19.344338 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6895a40c-5391-497b-b7d2-9b860f55cdd3 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:19.368751 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 416/851] 10.222.0.79 () {56 vars in 1149 bytes} [Tue Aug 30 01:00:19 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:00:19.369717 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6895a40c-5391-497b-b7d2-9b860f55cdd3 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:19.376945 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:19.386819 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ab8b77-f0f9-4a40-bfc8-055b9945a552 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:19.440716 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c77ebb8-c193-4a8d-bfaa-f2b452abc533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:19.441924 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c77ebb8-c193-4a8d-bfaa-f2b452abc533 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:19.442788 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c77ebb8-c193-4a8d-bfaa-f2b452abc533 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:19.443254 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c77ebb8-c193-4a8d-bfaa-f2b452abc533 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:19.452751 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c77ebb8-c193-4a8d-bfaa-f2b452abc533 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:19.454045 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c77ebb8-c193-4a8d-bfaa-f2b452abc533 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:19.459935 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:19.467285 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-7c77ebb8-c193-4a8d-bfaa-f2b452abc533 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 30 01:00:19.467285 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:00:19.467285 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:00:19.467285 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:00:19.467285 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:00:19.467285 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:00:19.467285 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:00:19.467285 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:00:19.467285 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:00:19.467285 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:00:19.467285 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:00:19.467285 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:00:19.467285 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 01:00:19.467285 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 01:00:19.467285 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 01:00:19.467285 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 01:00:19.468321 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:00:19.468321 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:00:19.468321 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 01:00:19.468321 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 01:00:19.468321 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 01:00:19.468321 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 01:00:19.468321 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:00:19.468321 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:00:19.468321 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:00:19.468321 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:00:19.468321 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:00:19.468321 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Aug 30 01:00:19.468321 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:00:19.468321 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:00:19.468321 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:00:19.468321 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:00:19.468321 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:00:19.468321 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:00:19.469278 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:00:19.469278 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:00:19.469278 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 01:00:19.469278 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 01:00:19.469278 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 01:00:19.469278 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 01:00:19.469278 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 01:00:19.469278 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 01:00:19.469278 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 30 01:00:19.469278 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Aug 30 01:00:19.469278 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 436/852] 10.222.0.79 () {56 vars in 1096 bytes} [Tue Aug 30 01:00:19 2022] GET /identity/v3/users/swift => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:00:19.469921 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35c52ba-88fb-4ee3-a6f3-0fd41ff5b0dc None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:19.469921 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35c52ba-88fb-4ee3-a6f3-0fd41ff5b0dc None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:19.470742 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35c52ba-88fb-4ee3-a6f3-0fd41ff5b0dc None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:19.475289 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 437/853] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 01:00:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:00:19.475289 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35c52ba-88fb-4ee3-a6f3-0fd41ff5b0dc None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:19.498399 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6895a40c-5391-497b-b7d2-9b860f55cdd3 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:19.539510 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e38e22-6f9f-439e-85d8-19140f7d2e19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:19.540131 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e38e22-6f9f-439e-85d8-19140f7d2e19 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:19.540569 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e38e22-6f9f-439e-85d8-19140f7d2e19 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:19.540844 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e38e22-6f9f-439e-85d8-19140f7d2e19 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:19.586832 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35c52ba-88fb-4ee3-a6f3-0fd41ff5b0dc None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:19.620136 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e38e22-6f9f-439e-85d8-19140f7d2e19 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:19.622349 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e38e22-6f9f-439e-85d8-19140f7d2e19 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:19.626960 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc95e50-9650-4c72-87fd-b4549dc7d91e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:19.627602 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc95e50-9650-4c72-87fd-b4549dc7d91e None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:19.627881 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc95e50-9650-4c72-87fd-b4549dc7d91e None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:19.628151 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc95e50-9650-4c72-87fd-b4549dc7d91e None admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:19.628888 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc95e50-9650-4c72-87fd-b4549dc7d91e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:00:19.629187 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc95e50-9650-4c72-87fd-b4549dc7d91e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:19.630603 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc95e50-9650-4c72-87fd-b4549dc7d91e None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:19.650462 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 438/854] 10.222.0.79 () {56 vars in 1135 bytes} [Tue Aug 30 01:00:19 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:00:19.651839 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d05845b-644c-4c74-a073-f2c3e3653592 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:19.652125 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d05845b-644c-4c74-a073-f2c3e3653592 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:19.652396 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d05845b-644c-4c74-a073-f2c3e3653592 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:19.671573 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-1d05845b-644c-4c74-a073-f2c3e3653592 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:00:19.672777 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-1d05845b-644c-4c74-a073-f2c3e3653592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:00:19.681165 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:19.712635 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:19.747291 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 417/855] 10.222.0.79 () {58 vars in 1282 bytes} [Tue Aug 30 01:00:19 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 01:00:19.747291 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e38e22-6f9f-439e-85d8-19140f7d2e19 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:19.759515 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 439/856] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 01:00:19 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 01:00:19.760887 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d05845b-644c-4c74-a073-f2c3e3653592 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:19.862205 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e38e22-6f9f-439e-85d8-19140f7d2e19 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:19.897032 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d05845b-644c-4c74-a073-f2c3e3653592 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:19.917725 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460dbd4f-cb58-4e33-ba86-ddd74e39c615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:19.918798 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460dbd4f-cb58-4e33-ba86-ddd74e39c615 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:19.919169 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460dbd4f-cb58-4e33-ba86-ddd74e39c615 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:19.919552 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460dbd4f-cb58-4e33-ba86-ddd74e39c615 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:19.944035 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484516c4-1f82-4675-b8f9-df4881cc5632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:19.945588 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484516c4-1f82-4675-b8f9-df4881cc5632 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:19.946355 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484516c4-1f82-4675-b8f9-df4881cc5632 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:19.946829 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484516c4-1f82-4675-b8f9-df4881cc5632 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:19.962505 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484516c4-1f82-4675-b8f9-df4881cc5632 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:19.964342 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484516c4-1f82-4675-b8f9-df4881cc5632 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:19.967171 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:19.973506 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:19.987960 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-484516c4-1f82-4675-b8f9-df4881cc5632 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:00:19.987960 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:00:19.987960 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:00:19.987960 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:00:19.987960 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:00:19.987960 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:00:19.987960 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:00:19.987960 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:00:19.987960 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:00:19.987960 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:00:19.987960 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:00:19.987960 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:00:19.987960 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 01:00:19.987960 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 01:00:19.987960 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 01:00:19.987960 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 01:00:19.988989 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:00:19.988989 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:00:19.988989 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:00:19.988989 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:00:19.988989 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:00:19.988989 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:00:19.988989 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:00:19.988989 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Aug 30 01:00:19.988989 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:00:19.988989 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:00:19.988989 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:00:19.988989 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:00:19.988989 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:00:19.988989 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:00:19.988989 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:00:19.988989 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:00:19.988989 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 01:00:19.989874 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 01:00:19.989874 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:00:19.989874 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Aug 30 01:00:19.996150 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 440/857] 10.222.0.79 () {56 vars in 1108 bytes} [Tue Aug 30 01:00:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:00:19.998505 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484516c4-1f82-4675-b8f9-df4881cc5632 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:20.009272 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460dbd4f-cb58-4e33-ba86-ddd74e39c615 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:20.010783 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460dbd4f-cb58-4e33-ba86-ddd74e39c615 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:20.120280 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484516c4-1f82-4675-b8f9-df4881cc5632 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:20.131247 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 418/858] 10.222.0.79 () {58 vars in 1282 bytes} [Tue Aug 30 01:00:19 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 01:00:20.131247 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460dbd4f-cb58-4e33-ba86-ddd74e39c615 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:20.158583 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab9a40a-9896-4765-a713-c8a58a3ce62e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:20.159305 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab9a40a-9896-4765-a713-c8a58a3ce62e None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:20.159585 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab9a40a-9896-4765-a713-c8a58a3ce62e None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:20.159864 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab9a40a-9896-4765-a713-c8a58a3ce62e None admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:20.160509 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab9a40a-9896-4765-a713-c8a58a3ce62e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:00:20.160810 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab9a40a-9896-4765-a713-c8a58a3ce62e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:20.162430 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab9a40a-9896-4765-a713-c8a58a3ce62e None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:20.175961 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 441/859] 10.222.0.79 () {56 vars in 1109 bytes} [Tue Aug 30 01:00:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:00:20.176900 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab9a40a-9896-4765-a713-c8a58a3ce62e None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:20.219917 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:20.239223 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:20.252436 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460dbd4f-cb58-4e33-ba86-ddd74e39c615 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:20.288554 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdce5fff-bbc5-4651-ba86-0f9ca5f6f1a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:20.289067 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab9a40a-9896-4765-a713-c8a58a3ce62e None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:20.289175 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdce5fff-bbc5-4651-ba86-0f9ca5f6f1a1 None admin] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:20.289353 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdce5fff-bbc5-4651-ba86-0f9ca5f6f1a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:20.289628 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdce5fff-bbc5-4651-ba86-0f9ca5f6f1a1 None admin] PATH_INFO: `/v3/services` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:20.290282 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdce5fff-bbc5-4651-ba86-0f9ca5f6f1a1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:20.291693 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdce5fff-bbc5-4651-ba86-0f9ca5f6f1a1 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:20.308103 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 419/860] 10.222.0.79 () {60 vars in 1141 bytes} [Tue Aug 30 01:00:20 2022] POST /identity/v3/services => generated 251 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:00:20.309746 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdce5fff-bbc5-4651-ba86-0f9ca5f6f1a1 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:20.338880 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dd07c5-db4f-41e7-a5ae-ce2d70d3eeaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:20.339752 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dd07c5-db4f-41e7-a5ae-ce2d70d3eeaf None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:20.340035 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dd07c5-db4f-41e7-a5ae-ce2d70d3eeaf None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:20.340356 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dd07c5-db4f-41e7-a5ae-ce2d70d3eeaf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:20.353810 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dd07c5-db4f-41e7-a5ae-ce2d70d3eeaf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:20.357135 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dd07c5-db4f-41e7-a5ae-ce2d70d3eeaf None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:20.377052 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-f1dd07c5-db4f-41e7-a5ae-ce2d70d3eeaf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:00:20.377052 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:00:20.377052 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:00:20.377052 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:00:20.377052 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:00:20.377052 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:00:20.377052 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:00:20.377052 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:00:20.377052 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:00:20.377052 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:00:20.377052 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:00:20.377052 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:00:20.377052 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 01:00:20.377052 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 01:00:20.377052 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 01:00:20.377052 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 01:00:20.378093 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:00:20.378093 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:00:20.378093 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:00:20.378093 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:00:20.378093 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:00:20.378093 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:00:20.378093 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:00:20.378093 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Aug 30 01:00:20.378093 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:00:20.378093 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:00:20.378093 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:00:20.378093 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:00:20.378093 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:00:20.378093 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:00:20.378093 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:00:20.378093 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:00:20.378093 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 01:00:20.379011 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 01:00:20.379011 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:00:20.379011 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Aug 30 01:00:20.379011 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 442/861] 10.222.0.79 () {56 vars in 1108 bytes} [Tue Aug 30 01:00:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:00:20.379957 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e59a02-0b5e-42e8-8d4c-2229eb946e1f None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:20.379957 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e59a02-0b5e-42e8-8d4c-2229eb946e1f None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:20.380091 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e59a02-0b5e-42e8-8d4c-2229eb946e1f None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:20.381610 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 443/862] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 01:00:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:00:20.384280 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e59a02-0b5e-42e8-8d4c-2229eb946e1f None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:20.442607 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdce5fff-bbc5-4651-ba86-0f9ca5f6f1a1 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:20.484240 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ba0f1e-b60a-4c0e-8213-8ba8791f21ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:20.484876 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ba0f1e-b60a-4c0e-8213-8ba8791f21ab None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:20.485152 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ba0f1e-b60a-4c0e-8213-8ba8791f21ab None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:20.485422 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ba0f1e-b60a-4c0e-8213-8ba8791f21ab None admin] PATH_INFO: `/v3/projects/service` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:20.489774 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:20.495379 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ba0f1e-b60a-4c0e-8213-8ba8791f21ab None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:20.498383 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ba0f1e-b60a-4c0e-8213-8ba8791f21ab None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:20.512311 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application [None req-19ba0f1e-b60a-4c0e-8213-8ba8791f21ab None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 01:00:20.512311 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:00:20.512311 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:00:20.512311 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:00:20.512311 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:00:20.512311 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:00:20.512311 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:00:20.512311 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:00:20.512311 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:00:20.512311 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:00:20.512311 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:00:20.512311 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:00:20.512311 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 01:00:20.512311 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 01:00:20.512311 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 01:00:20.513534 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 01:00:20.513534 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:00:20.513534 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:00:20.513534 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:00:20.513534 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:00:20.513534 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:00:20.513534 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:00:20.513534 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:00:20.513534 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application with Lock( Aug 30 01:00:20.513534 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:00:20.513534 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:00:20.513534 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:00:20.513534 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:00:20.513534 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:00:20.513534 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:00:20.513534 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:00:20.513534 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:00:20.514603 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 01:00:20.514603 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 01:00:20.514603 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 01:00:20.514603 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 01:00:20.514603 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 01:00:20.514603 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 01:00:20.514603 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 01:00:20.514603 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Aug 30 01:00:20.514603 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 420/863] 10.222.0.79 () {56 vars in 1111 bytes} [Tue Aug 30 01:00:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:00:20.519261 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b736da3b-1445-4eb4-b902-85ee8013b984 None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:20.519793 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e59a02-0b5e-42e8-8d4c-2229eb946e1f None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:20.519927 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b736da3b-1445-4eb4-b902-85ee8013b984 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:20.520206 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b736da3b-1445-4eb4-b902-85ee8013b984 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:20.521644 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:20.542230 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-b736da3b-1445-4eb4-b902-85ee8013b984 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:00:20.543898 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-b736da3b-1445-4eb4-b902-85ee8013b984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:00:20.562670 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016c97df-999e-4f49-b2c9-3725912453e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:20.563308 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016c97df-999e-4f49-b2c9-3725912453e5 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:20.563584 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016c97df-999e-4f49-b2c9-3725912453e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:20.563847 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016c97df-999e-4f49-b2c9-3725912453e5 None admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:20.564480 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016c97df-999e-4f49-b2c9-3725912453e5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:00:20.564772 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016c97df-999e-4f49-b2c9-3725912453e5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:20.566120 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016c97df-999e-4f49-b2c9-3725912453e5 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:20.577969 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 444/864] 10.222.0.79 () {56 vars in 1109 bytes} [Tue Aug 30 01:00:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:00:20.578798 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016c97df-999e-4f49-b2c9-3725912453e5 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:20.628571 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 421/865] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 01:00:20 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 01:00:20.632390 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b736da3b-1445-4eb4-b902-85ee8013b984 None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:20.688676 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016c97df-999e-4f49-b2c9-3725912453e5 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:20.730646 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c302722-36bf-41fe-8015-2cf8bb3c56c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:20.732129 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c302722-36bf-41fe-8015-2cf8bb3c56c9 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:20.732477 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c302722-36bf-41fe-8015-2cf8bb3c56c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:20.732839 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c302722-36bf-41fe-8015-2cf8bb3c56c9 None admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:20.733597 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c302722-36bf-41fe-8015-2cf8bb3c56c9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:00:20.734025 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c302722-36bf-41fe-8015-2cf8bb3c56c9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:20.735741 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c302722-36bf-41fe-8015-2cf8bb3c56c9 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:20.748498 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 445/866] 10.222.0.79 () {56 vars in 1148 bytes} [Tue Aug 30 01:00:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:00:20.754253 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c302722-36bf-41fe-8015-2cf8bb3c56c9 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:20.774531 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b736da3b-1445-4eb4-b902-85ee8013b984 None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:20.785646 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:20.817029 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:20.831001 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2b3157-8e6c-4173-b765-0cafaee689cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:20.832659 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2b3157-8e6c-4173-b765-0cafaee689cd None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:20.833122 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2b3157-8e6c-4173-b765-0cafaee689cd None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:20.833565 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2b3157-8e6c-4173-b765-0cafaee689cd None admin] PATH_INFO: `/v3/projects/service` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:20.843831 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2b3157-8e6c-4173-b765-0cafaee689cd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:20.845493 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2b3157-8e6c-4173-b765-0cafaee689cd None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:20.858174 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application [None req-6c2b3157-8e6c-4173-b765-0cafaee689cd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 01:00:20.858174 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:00:20.858174 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:00:20.858174 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:00:20.858174 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:00:20.858174 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:00:20.858174 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:00:20.858174 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:00:20.858174 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:00:20.858174 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:00:20.858174 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:00:20.858174 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:00:20.858174 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 01:00:20.858174 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 01:00:20.858174 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 01:00:20.859382 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 01:00:20.859382 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:00:20.859382 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:00:20.859382 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:00:20.859382 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:00:20.859382 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:00:20.859382 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:00:20.859382 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:00:20.859382 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application with Lock( Aug 30 01:00:20.859382 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:00:20.859382 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:00:20.859382 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:00:20.859382 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:00:20.859382 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:00:20.859382 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:00:20.859382 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:00:20.859382 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:00:20.860494 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 01:00:20.860494 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 01:00:20.860494 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 01:00:20.860494 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 01:00:20.860494 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 01:00:20.860494 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 01:00:20.860494 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 01:00:20.860494 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Aug 30 01:00:20.866600 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 422/867] 10.222.0.79 () {56 vars in 1111 bytes} [Tue Aug 30 01:00:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:00:20.867622 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2b3157-8e6c-4173-b765-0cafaee689cd None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:20.890127 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c302722-36bf-41fe-8015-2cf8bb3c56c9 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:20.929021 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc65551-398c-4b88-9f93-84d308f4c568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:20.929629 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc65551-398c-4b88-9f93-84d308f4c568 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:20.929908 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc65551-398c-4b88-9f93-84d308f4c568 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:20.930183 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc65551-398c-4b88-9f93-84d308f4c568 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:20.930911 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc65551-398c-4b88-9f93-84d308f4c568 None admin] RBAC: Adding query filter params (role.id=687d3359d6b2413b84ca5a54d30d5488, scope.project.id=0eec3a73673e45dc881de586b9b0fbbb, user.id=5cacaed93420436e8f423f96a8041401) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:00:20.931245 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc65551-398c-4b88-9f93-84d308f4c568 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:20.932668 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc65551-398c-4b88-9f93-84d308f4c568 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:20.939040 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 446/868] 10.222.0.79 () {56 vars in 1374 bytes} [Tue Aug 30 01:00:20 2022] GET /identity/v3/role_assignments?user.id=5cacaed93420436e8f423f96a8041401&scope.project.id=0eec3a73673e45dc881de586b9b0fbbb&role.id=687d3359d6b2413b84ca5a54d30d5488 => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:00:20.939905 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc65551-398c-4b88-9f93-84d308f4c568 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:20.988196 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2b3157-8e6c-4173-b765-0cafaee689cd None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:21.031150 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6074ed48-d599-4754-a1fe-7e0ff06d1dc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:21.032272 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6074ed48-d599-4754-a1fe-7e0ff06d1dc7 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:21.032883 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6074ed48-d599-4754-a1fe-7e0ff06d1dc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:21.033388 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6074ed48-d599-4754-a1fe-7e0ff06d1dc7 None admin] PATH_INFO: `/v3/projects` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:21.034292 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6074ed48-d599-4754-a1fe-7e0ff06d1dc7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:00:21.034776 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6074ed48-d599-4754-a1fe-7e0ff06d1dc7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:21.036562 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6074ed48-d599-4754-a1fe-7e0ff06d1dc7 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:21.056771 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 423/869] 10.222.0.79 () {56 vars in 1148 bytes} [Tue Aug 30 01:00:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:00:21.058165 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6074ed48-d599-4754-a1fe-7e0ff06d1dc7 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:21.062087 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:21.085399 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc65551-398c-4b88-9f93-84d308f4c568 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:21.122550 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:21.126279 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a9146c-da3d-4970-a9a9-28287556f6ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:21.126918 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a9146c-da3d-4970-a9a9-28287556f6ce None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:21.128125 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a9146c-da3d-4970-a9a9-28287556f6ce None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:21.128125 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a9146c-da3d-4970-a9a9-28287556f6ce None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:21.128125 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a9146c-da3d-4970-a9a9-28287556f6ce None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:21.129512 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a9146c-da3d-4970-a9a9-28287556f6ce None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:21.139612 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-a4a9146c-da3d-4970-a9a9-28287556f6ce None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 30 01:00:21.139612 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:00:21.139612 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 01:00:21.139612 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 01:00:21.139612 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 01:00:21.139612 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 01:00:21.139612 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 01:00:21.139612 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 01:00:21.139612 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 30 01:00:21.139612 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Aug 30 01:00:21.139612 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 01:00:21.139612 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Aug 30 01:00:21.139612 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:00:21.139612 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:00:21.139612 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:00:21.139612 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:00:21.140586 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:00:21.140586 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:00:21.140586 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:00:21.140586 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:00:21.140586 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:00:21.140586 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:00:21.140586 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:00:21.140586 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 01:00:21.140586 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 01:00:21.140586 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 01:00:21.140586 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 01:00:21.140586 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:00:21.140586 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:00:21.140586 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:00:21.140586 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:00:21.140586 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:00:21.140586 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:00:21.141460 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:00:21.141460 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Aug 30 01:00:21.141460 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:00:21.141460 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:00:21.141460 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:00:21.141460 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:00:21.141460 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:00:21.141460 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:00:21.141460 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:00:21.141460 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:00:21.141460 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 01:00:21.141460 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 01:00:21.141460 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 30 01:00:21.141460 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Aug 30 01:00:21.141460 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 447/870] 10.222.0.79 () {56 vars in 1132 bytes} [Tue Aug 30 01:00:20 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:00:21.148372 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a9146c-da3d-4970-a9a9-28287556f6ce None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:21.190102 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6074ed48-d599-4754-a1fe-7e0ff06d1dc7 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:21.238889 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207ca528-265d-45ef-bec7-dc4a82819418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:21.240345 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207ca528-265d-45ef-bec7-dc4a82819418 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:21.240617 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207ca528-265d-45ef-bec7-dc4a82819418 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:21.241673 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207ca528-265d-45ef-bec7-dc4a82819418 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:21.241673 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207ca528-265d-45ef-bec7-dc4a82819418 None admin] RBAC: Adding query filter params (role.id=d14c3070c9184d76a7b23df69bd3db07, scope.project.id=0eec3a73673e45dc881de586b9b0fbbb, user.id=dd556fa6ba464928b1e067325792a523) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:00:21.241958 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207ca528-265d-45ef-bec7-dc4a82819418 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:21.243333 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207ca528-265d-45ef-bec7-dc4a82819418 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:21.255217 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 424/871] 10.222.0.79 () {56 vars in 1374 bytes} [Tue Aug 30 01:00:21 2022] GET /identity/v3/role_assignments?user.id=dd556fa6ba464928b1e067325792a523&scope.project.id=0eec3a73673e45dc881de586b9b0fbbb&role.id=d14c3070c9184d76a7b23df69bd3db07 => generated 608 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:00:21.294583 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a9146c-da3d-4970-a9a9-28287556f6ce None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:21.335651 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e72b81-6bdb-4db3-be7b-036689127a60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:21.336531 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e72b81-6bdb-4db3-be7b-036689127a60 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:21.336958 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e72b81-6bdb-4db3-be7b-036689127a60 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:21.337379 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e72b81-6bdb-4db3-be7b-036689127a60 None admin] PATH_INFO: `/v3/services` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:21.338247 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e72b81-6bdb-4db3-be7b-036689127a60 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:00:21.338707 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e72b81-6bdb-4db3-be7b-036689127a60 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:21.340455 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e72b81-6bdb-4db3-be7b-036689127a60 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:21.346080 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 448/872] 10.222.0.79 () {56 vars in 1126 bytes} [Tue Aug 30 01:00:21 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:00:21.352286 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207ca528-265d-45ef-bec7-dc4a82819418 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:21.482370 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207ca528-265d-45ef-bec7-dc4a82819418 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:21.493746 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:21.520164 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5293cfcf-8750-4773-9107-53e5e734ef39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:21.520777 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5293cfcf-8750-4773-9107-53e5e734ef39 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:21.521054 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5293cfcf-8750-4773-9107-53e5e734ef39 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:21.521323 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5293cfcf-8750-4773-9107-53e5e734ef39 None admin] PATH_INFO: `/v3/services` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:21.522017 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5293cfcf-8750-4773-9107-53e5e734ef39 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:00:21.522320 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5293cfcf-8750-4773-9107-53e5e734ef39 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:21.523710 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5293cfcf-8750-4773-9107-53e5e734ef39 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:21.528970 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 425/873] 10.222.0.79 () {56 vars in 1126 bytes} [Tue Aug 30 01:00:21 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:00:22.347091 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0446670d-2444-4667-95aa-c4b4af97228a None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:22.347657 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0446670d-2444-4667-95aa-c4b4af97228a None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:22.347969 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0446670d-2444-4667-95aa-c4b4af97228a None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:22.349650 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 449/874] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 01:00:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:00:22.354858 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c80045-418d-4a37-a853-14a654f2cd6f None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:22.355272 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c80045-418d-4a37-a853-14a654f2cd6f None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:22.355459 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c80045-418d-4a37-a853-14a654f2cd6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:22.374590 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-26c80045-418d-4a37-a853-14a654f2cd6f None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:00:22.375808 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-26c80045-418d-4a37-a853-14a654f2cd6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:00:22.448220 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 426/875] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 01:00:22 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 01:00:22.717229 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0446670d-2444-4667-95aa-c4b4af97228a None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:22.733281 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:22.822519 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0446670d-2444-4667-95aa-c4b4af97228a None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:22.858031 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a845ffb-c8cb-4efd-b231-10a6ac31485f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:22.858662 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a845ffb-c8cb-4efd-b231-10a6ac31485f None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:22.858939 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a845ffb-c8cb-4efd-b231-10a6ac31485f None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:22.859241 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a845ffb-c8cb-4efd-b231-10a6ac31485f None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:22.859822 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a845ffb-c8cb-4efd-b231-10a6ac31485f None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:22.861175 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a845ffb-c8cb-4efd-b231-10a6ac31485f None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:22.870361 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-2a845ffb-c8cb-4efd-b231-10a6ac31485f None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 30 01:00:22.870361 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:00:22.870361 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 01:00:22.870361 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 01:00:22.870361 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 01:00:22.870361 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 01:00:22.870361 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 01:00:22.870361 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 01:00:22.870361 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 30 01:00:22.870361 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Aug 30 01:00:22.870361 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 01:00:22.870361 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Aug 30 01:00:22.870361 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:00:22.870361 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:00:22.870361 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:00:22.870361 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:00:22.870361 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:00:22.871981 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:00:22.871981 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:00:22.871981 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:00:22.871981 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:00:22.871981 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:00:22.871981 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:00:22.871981 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 01:00:22.871981 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 01:00:22.871981 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 01:00:22.871981 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 01:00:22.871981 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:00:22.871981 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:00:22.871981 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:00:22.871981 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:00:22.871981 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:00:22.871981 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:00:22.872960 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:00:22.872960 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Aug 30 01:00:22.872960 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:00:22.872960 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:00:22.872960 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:00:22.872960 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:00:22.872960 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:00:22.872960 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:00:22.872960 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:00:22.872960 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:00:22.872960 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 01:00:22.872960 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 01:00:22.872960 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 30 01:00:22.872960 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Aug 30 01:00:22.872960 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 450/876] 10.222.0.79 () {56 vars in 1114 bytes} [Tue Aug 30 01:00:22 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:00:22.878289 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c80045-418d-4a37-a853-14a654f2cd6f None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:22.988431 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c80045-418d-4a37-a853-14a654f2cd6f None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:22.990832 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:23.030611 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9d6c81-98e9-4399-b14a-73673a1d6543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:23.031248 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9d6c81-98e9-4399-b14a-73673a1d6543 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:23.031524 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9d6c81-98e9-4399-b14a-73673a1d6543 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:23.031789 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9d6c81-98e9-4399-b14a-73673a1d6543 None admin] PATH_INFO: `/v3/services` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:23.032424 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9d6c81-98e9-4399-b14a-73673a1d6543 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:00:23.032721 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9d6c81-98e9-4399-b14a-73673a1d6543 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:23.034079 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9d6c81-98e9-4399-b14a-73673a1d6543 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:23.039586 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 427/877] 10.222.0.79 () {56 vars in 1114 bytes} [Tue Aug 30 01:00:22 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:00:23.045648 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a845ffb-c8cb-4efd-b231-10a6ac31485f None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:23.068032 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdc6ed6-f365-4d2d-8584-ad6ed98f655c None None] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:23.068369 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdc6ed6-f365-4d2d-8584-ad6ed98f655c None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:23.068587 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdc6ed6-f365-4d2d-8584-ad6ed98f655c None None] PATH_INFO: `/` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:23.070194 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 428/878] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 01:00:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 01:00:23.075942 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f258659b-182b-4f0d-a21d-7a4060f8342b None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:23.076224 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f258659b-182b-4f0d-a21d-7a4060f8342b None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:23.076495 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f258659b-182b-4f0d-a21d-7a4060f8342b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:23.096426 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-f258659b-182b-4f0d-a21d-7a4060f8342b None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:00:23.097620 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-f258659b-182b-4f0d-a21d-7a4060f8342b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:00:23.140910 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:23.165135 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a845ffb-c8cb-4efd-b231-10a6ac31485f None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:23.179411 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 429/879] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 01:00:23 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 01:00:23.202369 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4091521-209f-4c59-bff1-95b1f6c2d961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:23.203276 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4091521-209f-4c59-bff1-95b1f6c2d961 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:23.203716 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4091521-209f-4c59-bff1-95b1f6c2d961 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:23.204138 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4091521-209f-4c59-bff1-95b1f6c2d961 None admin] PATH_INFO: `/v3/services` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:23.204911 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4091521-209f-4c59-bff1-95b1f6c2d961 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:00:23.205352 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4091521-209f-4c59-bff1-95b1f6c2d961 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:23.206857 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4091521-209f-4c59-bff1-95b1f6c2d961 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:23.212630 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 451/880] 10.222.0.79 () {56 vars in 1114 bytes} [Tue Aug 30 01:00:23 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:00:23.218590 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f258659b-182b-4f0d-a21d-7a4060f8342b None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:23.291756 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965d7a7e-ad20-4d35-9b49-461cd1c3b9b8 None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:23.292152 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965d7a7e-ad20-4d35-9b49-461cd1c3b9b8 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:23.292587 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965d7a7e-ad20-4d35-9b49-461cd1c3b9b8 None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:23.295607 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 452/881] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 01:00:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 01:00:23.300706 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aff3c0d-bda0-4623-96e3-52d0d1d57cf2 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:23.301111 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aff3c0d-bda0-4623-96e3-52d0d1d57cf2 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:23.301465 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aff3c0d-bda0-4623-96e3-52d0d1d57cf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:23.327512 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-6aff3c0d-bda0-4623-96e3-52d0d1d57cf2 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:00:23.328817 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-6aff3c0d-bda0-4623-96e3-52d0d1d57cf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:00:23.339465 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:23.344963 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f258659b-182b-4f0d-a21d-7a4060f8342b None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:23.385885 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce08d64-2797-4278-bb19-6d63570bcc70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:23.386669 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce08d64-2797-4278-bb19-6d63570bcc70 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:23.387103 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce08d64-2797-4278-bb19-6d63570bcc70 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:23.388112 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce08d64-2797-4278-bb19-6d63570bcc70 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:23.388897 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce08d64-2797-4278-bb19-6d63570bcc70 None admin] RBAC: Adding query filter params (interface=public, service_id=7acbb66cd9af4df3a42f01d3b08aa5fa, region_id=RegionOne) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:00:23.389302 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce08d64-2797-4278-bb19-6d63570bcc70 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:23.391010 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce08d64-2797-4278-bb19-6d63570bcc70 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:23.400951 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 430/882] 10.222.0.79 () {56 vars in 1251 bytes} [Tue Aug 30 01:00:23 2022] GET /identity/v3/endpoints?service_id=7acbb66cd9af4df3a42f01d3b08aa5fa&interface=public®ion_id=RegionOne => generated 194 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:00:23.403231 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce08d64-2797-4278-bb19-6d63570bcc70 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:23.426737 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 453/883] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 01:00:23 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 01:00:23.471633 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd2a0d2-a785-4fd1-ba06-ff64bbc703f9 None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:23.472144 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd2a0d2-a785-4fd1-ba06-ff64bbc703f9 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:23.472633 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd2a0d2-a785-4fd1-ba06-ff64bbc703f9 None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:23.474272 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 454/884] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 01:00:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:00:23.479420 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72c5c96-ab56-4307-948f-596d34f79572 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:23.479704 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72c5c96-ab56-4307-948f-596d34f79572 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:23.479971 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72c5c96-ab56-4307-948f-596d34f79572 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:23.499279 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-f72c5c96-ab56-4307-948f-596d34f79572 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:00:23.500353 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-f72c5c96-ab56-4307-948f-596d34f79572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:00:23.532117 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce08d64-2797-4278-bb19-6d63570bcc70 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:23.571182 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 455/885] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 01:00:23 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 01:00:23.571182 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72c5c96-ab56-4307-948f-596d34f79572 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:23.573095 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc2bd98-93f6-40ab-b24f-b03c2d9eeac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:23.573701 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc2bd98-93f6-40ab-b24f-b03c2d9eeac9 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:23.573972 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc2bd98-93f6-40ab-b24f-b03c2d9eeac9 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:23.574235 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc2bd98-93f6-40ab-b24f-b03c2d9eeac9 None admin] PATH_INFO: `/v3/services` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:23.574903 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc2bd98-93f6-40ab-b24f-b03c2d9eeac9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:23.576286 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc2bd98-93f6-40ab-b24f-b03c2d9eeac9 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:23.577651 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:23.591769 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 431/886] 10.222.0.79 () {56 vars in 1087 bytes} [Tue Aug 30 01:00:23 2022] GET /identity/v3/services => generated 1011 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:00:23.692303 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72c5c96-ab56-4307-948f-596d34f79572 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:23.697560 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc2bd98-93f6-40ab-b24f-b03c2d9eeac9 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:23.732029 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:23.732375 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f044d0ba-07b1-4795-a01f-620b7cac8bc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:23.733182 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f044d0ba-07b1-4795-a01f-620b7cac8bc4 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:23.733293 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f044d0ba-07b1-4795-a01f-620b7cac8bc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:23.733523 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f044d0ba-07b1-4795-a01f-620b7cac8bc4 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:23.750201 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f044d0ba-07b1-4795-a01f-620b7cac8bc4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 01:00:23.756090 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-f044d0ba-07b1-4795-a01f-620b7cac8bc4 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 01:00:23.756090 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:00:23.756090 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:00:23.756090 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:00:23.756090 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:00:23.756090 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:00:23.756090 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:00:23.756090 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:00:23.756090 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:00:23.756090 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:00:23.756090 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:00:23.756090 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:00:23.756090 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 01:00:23.756090 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 01:00:23.756090 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 01:00:23.756090 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 01:00:23.757038 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 01:00:23.757038 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 01:00:23.757038 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 01:00:23.757038 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 01:00:23.757038 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:00:23.757038 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:00:23.757038 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:00:23.757038 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:00:23.757038 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:00:23.757038 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:00:23.757038 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:00:23.757038 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Aug 30 01:00:23.757038 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:00:23.757038 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:00:23.757038 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:00:23.757038 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:00:23.757886 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:00:23.757886 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:00:23.757886 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:00:23.757886 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:00:23.757886 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 01:00:23.757886 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 01:00:23.757886 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 01:00:23.757886 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 01:00:23.757886 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 01:00:23.757886 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 01:00:23.757886 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 01:00:23.757886 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Aug 30 01:00:23.757886 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 456/887] 10.222.0.79 () {56 vars in 1120 bytes} [Tue Aug 30 01:00:23 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:00:23.764657 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f044d0ba-07b1-4795-a01f-620b7cac8bc4 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:23.836811 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc2bd98-93f6-40ab-b24f-b03c2d9eeac9 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:23.844011 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:23.876340 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6a69e6-692c-4dd3-a7f6-cd8a46ec3680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:23.877324 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6a69e6-692c-4dd3-a7f6-cd8a46ec3680 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:23.877805 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6a69e6-692c-4dd3-a7f6-cd8a46ec3680 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:23.878074 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6a69e6-692c-4dd3-a7f6-cd8a46ec3680 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:23.878767 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6a69e6-692c-4dd3-a7f6-cd8a46ec3680 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:23.880220 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6a69e6-692c-4dd3-a7f6-cd8a46ec3680 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:23.889737 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application [None req-bd6a69e6-692c-4dd3-a7f6-cd8a46ec3680 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 01:00:23.889737 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:00:23.889737 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 01:00:23.889737 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 01:00:23.889737 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 01:00:23.889737 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 01:00:23.889737 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 01:00:23.889737 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 01:00:23.889737 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 01:00:23.889737 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Aug 30 01:00:23.889737 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 01:00:23.889737 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Aug 30 01:00:23.889737 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:00:23.889737 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:00:23.889737 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:00:23.889737 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:00:23.889737 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:00:23.890752 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:00:23.890752 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:00:23.890752 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:00:23.890752 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:00:23.890752 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:00:23.890752 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:00:23.890752 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 01:00:23.890752 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 01:00:23.890752 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 01:00:23.890752 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 01:00:23.890752 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:00:23.890752 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:00:23.890752 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:00:23.890752 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:00:23.890752 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:00:23.890752 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:00:23.896544 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:00:23.896544 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application with Lock( Aug 30 01:00:23.896544 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:00:23.896544 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:00:23.896544 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:00:23.896544 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:00:23.896544 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:00:23.896544 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:00:23.896544 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:00:23.896544 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:00:23.896544 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 01:00:23.896544 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 01:00:23.896544 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 01:00:23.896544 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Aug 30 01:00:23.897455 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f044d0ba-07b1-4795-a01f-620b7cac8bc4 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:23.897544 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 432/888] 10.222.0.79 () {56 vars in 1126 bytes} [Tue Aug 30 01:00:23 2022] GET /identity/v3/services/object-store => generated 93 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 01:00:23.897544 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6a69e6-692c-4dd3-a7f6-cd8a46ec3680 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:23.934676 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558420a7-38ed-41a1-8d56-6f14a0e0d94f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:23.935287 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558420a7-38ed-41a1-8d56-6f14a0e0d94f None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:23.935563 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558420a7-38ed-41a1-8d56-6f14a0e0d94f None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:23.935830 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558420a7-38ed-41a1-8d56-6f14a0e0d94f None admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:23.936498 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558420a7-38ed-41a1-8d56-6f14a0e0d94f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:00:23.936796 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558420a7-38ed-41a1-8d56-6f14a0e0d94f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:23.938292 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558420a7-38ed-41a1-8d56-6f14a0e0d94f None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:23.947957 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 457/889] 10.222.0.79 () {56 vars in 1115 bytes} [Tue Aug 30 01:00:23 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:00:23.948789 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558420a7-38ed-41a1-8d56-6f14a0e0d94f None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:24.002611 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:24.013856 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6a69e6-692c-4dd3-a7f6-cd8a46ec3680 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:24.053342 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37df2f6f-041b-4c98-880a-10a18c297779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:24.054188 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37df2f6f-041b-4c98-880a-10a18c297779 None admin] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:24.054617 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37df2f6f-041b-4c98-880a-10a18c297779 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:24.054938 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37df2f6f-041b-4c98-880a-10a18c297779 None admin] PATH_INFO: `/v3/services` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:24.055619 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37df2f6f-041b-4c98-880a-10a18c297779 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:24.057026 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37df2f6f-041b-4c98-880a-10a18c297779 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:24.060161 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558420a7-38ed-41a1-8d56-6f14a0e0d94f None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:24.075185 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 433/890] 10.222.0.79 () {60 vars in 1141 bytes} [Tue Aug 30 01:00:23 2022] POST /identity/v3/services => generated 269 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:00:24.085083 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37df2f6f-041b-4c98-880a-10a18c297779 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:24.089251 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:24.115606 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803a99bd-41d2-4162-886c-beb074f09750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:24.116227 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803a99bd-41d2-4162-886c-beb074f09750 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:24.116608 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803a99bd-41d2-4162-886c-beb074f09750 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:24.116884 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803a99bd-41d2-4162-886c-beb074f09750 None admin] PATH_INFO: `/v3/services` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:24.117526 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803a99bd-41d2-4162-886c-beb074f09750 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:00:24.117825 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803a99bd-41d2-4162-886c-beb074f09750 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:24.119315 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803a99bd-41d2-4162-886c-beb074f09750 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:24.125808 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 458/891] 10.222.0.79 () {56 vars in 1122 bytes} [Tue Aug 30 01:00:23 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:00:24.131969 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803a99bd-41d2-4162-886c-beb074f09750 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:24.216269 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37df2f6f-041b-4c98-880a-10a18c297779 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:24.252195 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803a99bd-41d2-4162-886c-beb074f09750 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:24.256585 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0309432-1ee4-44fe-a342-8c4591d2ff4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:24.257159 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0309432-1ee4-44fe-a342-8c4591d2ff4c None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:24.257433 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0309432-1ee4-44fe-a342-8c4591d2ff4c None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:24.257700 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0309432-1ee4-44fe-a342-8c4591d2ff4c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:24.270035 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0309432-1ee4-44fe-a342-8c4591d2ff4c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:24.271512 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0309432-1ee4-44fe-a342-8c4591d2ff4c None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:24.288841 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application [None req-a0309432-1ee4-44fe-a342-8c4591d2ff4c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:00:24.288841 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:00:24.288841 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:00:24.288841 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:00:24.288841 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:00:24.288841 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:00:24.288841 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:00:24.288841 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:00:24.288841 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:00:24.288841 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:00:24.288841 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:00:24.288841 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:00:24.288841 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 01:00:24.288841 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 01:00:24.288841 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 01:00:24.288841 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 01:00:24.290054 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:00:24.290054 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:00:24.290054 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:00:24.290054 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:00:24.290054 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:00:24.290054 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:00:24.290054 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:00:24.290054 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application with Lock( Aug 30 01:00:24.290054 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:00:24.290054 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:00:24.290054 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:00:24.290054 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:00:24.290054 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:00:24.290054 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:00:24.290054 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:00:24.290054 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:00:24.290054 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 01:00:24.291434 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 01:00:24.291434 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:00:24.291434 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Aug 30 01:00:24.291434 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 434/892] 10.222.0.79 () {56 vars in 1108 bytes} [Tue Aug 30 01:00:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:00:24.294957 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16dbde4-df88-4f62-9d7f-f6d2821cfbe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:24.295987 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16dbde4-df88-4f62-9d7f-f6d2821cfbe0 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:24.296266 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16dbde4-df88-4f62-9d7f-f6d2821cfbe0 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:24.296537 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16dbde4-df88-4f62-9d7f-f6d2821cfbe0 None admin] PATH_INFO: `/v3/services` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:24.296869 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0309432-1ee4-44fe-a342-8c4591d2ff4c None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:24.297183 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16dbde4-df88-4f62-9d7f-f6d2821cfbe0 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:00:24.297484 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16dbde4-df88-4f62-9d7f-f6d2821cfbe0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:24.298844 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16dbde4-df88-4f62-9d7f-f6d2821cfbe0 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:24.307228 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 459/893] 10.222.0.79 () {56 vars in 1122 bytes} [Tue Aug 30 01:00:24 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:00:24.307760 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:24.421571 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0309432-1ee4-44fe-a342-8c4591d2ff4c None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:24.460760 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5498aa-4473-4d87-8f89-5354fd564953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:24.461752 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5498aa-4473-4d87-8f89-5354fd564953 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:24.462039 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5498aa-4473-4d87-8f89-5354fd564953 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:24.462313 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5498aa-4473-4d87-8f89-5354fd564953 None admin] PATH_INFO: `/v3/domains` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:24.462966 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5498aa-4473-4d87-8f89-5354fd564953 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:00:24.463305 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5498aa-4473-4d87-8f89-5354fd564953 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:24.464675 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5498aa-4473-4d87-8f89-5354fd564953 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:24.479065 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 435/894] 10.222.0.79 () {56 vars in 1109 bytes} [Tue Aug 30 01:00:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:00:24.485496 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16dbde4-df88-4f62-9d7f-f6d2821cfbe0 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:24.544610 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:24.616954 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16dbde4-df88-4f62-9d7f-f6d2821cfbe0 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:24.656064 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fb1d74-dfec-4ca3-82cc-3ecf32312e45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:24.656696 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fb1d74-dfec-4ca3-82cc-3ecf32312e45 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:24.656969 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fb1d74-dfec-4ca3-82cc-3ecf32312e45 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:24.657235 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fb1d74-dfec-4ca3-82cc-3ecf32312e45 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:24.665264 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fb1d74-dfec-4ca3-82cc-3ecf32312e45 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:24.666683 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fb1d74-dfec-4ca3-82cc-3ecf32312e45 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:24.678328 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-87fb1d74-dfec-4ca3-82cc-3ecf32312e45 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 01:00:24.678328 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:00:24.678328 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:00:24.678328 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:00:24.678328 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:00:24.678328 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:00:24.678328 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:00:24.678328 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:00:24.678328 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:00:24.678328 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:00:24.678328 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:00:24.678328 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:00:24.678328 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 01:00:24.678328 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 01:00:24.678328 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 01:00:24.678328 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 01:00:24.679332 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:00:24.679332 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:00:24.679332 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 01:00:24.679332 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 01:00:24.679332 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 01:00:24.679332 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 01:00:24.679332 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:00:24.679332 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:00:24.679332 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:00:24.679332 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:00:24.679332 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:00:24.679332 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Aug 30 01:00:24.679332 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:00:24.679332 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:00:24.679332 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:00:24.679332 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:00:24.679332 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:00:24.679332 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:00:24.680264 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:00:24.680264 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:00:24.680264 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 01:00:24.680264 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 01:00:24.680264 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 01:00:24.680264 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 01:00:24.680264 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 01:00:24.680264 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 01:00:24.680264 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 01:00:24.680264 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Aug 30 01:00:24.680264 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 460/895] 10.222.0.79 () {56 vars in 1117 bytes} [Tue Aug 30 01:00:24 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:00:24.686466 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5498aa-4473-4d87-8f89-5354fd564953 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:24.756317 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:24.797177 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5498aa-4473-4d87-8f89-5354fd564953 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:24.833841 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042246ba-ea33-457c-a78c-091ed77c16a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:24.834446 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042246ba-ea33-457c-a78c-091ed77c16a0 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:24.834718 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042246ba-ea33-457c-a78c-091ed77c16a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:24.834984 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042246ba-ea33-457c-a78c-091ed77c16a0 None admin] PATH_INFO: `/v3/users` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:24.835731 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042246ba-ea33-457c-a78c-091ed77c16a0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:00:24.836027 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042246ba-ea33-457c-a78c-091ed77c16a0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:24.837434 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042246ba-ea33-457c-a78c-091ed77c16a0 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:24.855610 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 436/896] 10.222.0.79 () {56 vars in 1149 bytes} [Tue Aug 30 01:00:24 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:00:24.861450 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fb1d74-dfec-4ca3-82cc-3ecf32312e45 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:24.970200 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fb1d74-dfec-4ca3-82cc-3ecf32312e45 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:24.979511 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:25.009891 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ae841d-0e1c-459a-be46-69b7dd823917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:25.010843 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ae841d-0e1c-459a-be46-69b7dd823917 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:25.011366 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ae841d-0e1c-459a-be46-69b7dd823917 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:25.011826 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ae841d-0e1c-459a-be46-69b7dd823917 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:25.081863 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ae841d-0e1c-459a-be46-69b7dd823917 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:25.083751 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ae841d-0e1c-459a-be46-69b7dd823917 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:25.186547 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 461/897] 10.222.0.79 () {58 vars in 1282 bytes} [Tue Aug 30 01:00:24 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 01:00:25.195243 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042246ba-ea33-457c-a78c-091ed77c16a0 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:25.313229 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042246ba-ea33-457c-a78c-091ed77c16a0 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:25.336144 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:25.358116 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8632d35-6912-4d18-93bb-2594335644a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:25.359109 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8632d35-6912-4d18-93bb-2594335644a6 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:25.359604 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8632d35-6912-4d18-93bb-2594335644a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:25.360064 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8632d35-6912-4d18-93bb-2594335644a6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:25.373168 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8632d35-6912-4d18-93bb-2594335644a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:25.373168 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8632d35-6912-4d18-93bb-2594335644a6 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:25.388332 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application [None req-a8632d35-6912-4d18-93bb-2594335644a6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:00:25.388332 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:00:25.388332 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:00:25.388332 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:00:25.388332 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:00:25.388332 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:00:25.388332 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:00:25.388332 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:00:25.388332 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:00:25.388332 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:00:25.388332 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:00:25.388332 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:00:25.388332 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 01:00:25.388332 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 01:00:25.388332 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 01:00:25.388332 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 01:00:25.389497 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:00:25.389497 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:00:25.389497 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:00:25.389497 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:00:25.389497 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:00:25.389497 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:00:25.389497 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:00:25.389497 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application with Lock( Aug 30 01:00:25.389497 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:00:25.389497 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:00:25.389497 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:00:25.389497 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:00:25.389497 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:00:25.389497 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:00:25.389497 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:00:25.389497 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:00:25.389497 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 01:00:25.390587 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 01:00:25.390587 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:00:25.390587 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Aug 30 01:00:25.392350 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 437/898] 10.222.0.79 () {56 vars in 1108 bytes} [Tue Aug 30 01:00:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:00:25.397667 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ae841d-0e1c-459a-be46-69b7dd823917 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:25.409340 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:25.509748 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ae841d-0e1c-459a-be46-69b7dd823917 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:25.547472 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2783165-325c-44bb-b827-dfa11ff3950b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:25.548070 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2783165-325c-44bb-b827-dfa11ff3950b None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:25.548341 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2783165-325c-44bb-b827-dfa11ff3950b None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:25.548606 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2783165-325c-44bb-b827-dfa11ff3950b None admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:25.549241 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2783165-325c-44bb-b827-dfa11ff3950b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:00:25.549533 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2783165-325c-44bb-b827-dfa11ff3950b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:25.550893 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2783165-325c-44bb-b827-dfa11ff3950b None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:25.562988 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 462/899] 10.222.0.79 () {56 vars in 1109 bytes} [Tue Aug 30 01:00:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:00:25.568626 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8632d35-6912-4d18-93bb-2594335644a6 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:25.598557 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded7dd6d-3f47-43d6-88e0-53d749f0af1e None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:25.598859 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded7dd6d-3f47-43d6-88e0-53d749f0af1e None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:25.599158 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded7dd6d-3f47-43d6-88e0-53d749f0af1e None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:25.600522 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 463/900] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 01:00:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 01:00:25.607156 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2795ae-d4f6-4e85-89a7-01260cebf502 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:25.607444 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2795ae-d4f6-4e85-89a7-01260cebf502 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:25.607753 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2795ae-d4f6-4e85-89a7-01260cebf502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:25.635902 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-4c2795ae-d4f6-4e85-89a7-01260cebf502 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:00:25.638796 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-4c2795ae-d4f6-4e85-89a7-01260cebf502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:00:25.687016 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8632d35-6912-4d18-93bb-2594335644a6 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:25.725447 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144a665e-ff64-4df8-a30f-267e71f5c22c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:25.726179 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144a665e-ff64-4df8-a30f-267e71f5c22c None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:25.726523 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144a665e-ff64-4df8-a30f-267e71f5c22c None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:25.727074 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144a665e-ff64-4df8-a30f-267e71f5c22c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:25.727474 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:25.735204 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 464/901] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 01:00:25 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 01:00:25.740482 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144a665e-ff64-4df8-a30f-267e71f5c22c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:25.742128 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144a665e-ff64-4df8-a30f-267e71f5c22c None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:25.754463 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application [None req-144a665e-ff64-4df8-a30f-267e71f5c22c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 01:00:25.754463 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:00:25.754463 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:00:25.754463 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:00:25.754463 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:00:25.754463 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:00:25.754463 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:00:25.754463 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:00:25.754463 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:00:25.754463 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:00:25.754463 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:00:25.754463 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:00:25.754463 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 01:00:25.754463 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 01:00:25.754463 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 01:00:25.755581 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 01:00:25.755581 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:00:25.755581 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:00:25.755581 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:00:25.755581 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:00:25.755581 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:00:25.755581 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:00:25.755581 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:00:25.755581 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application with Lock( Aug 30 01:00:25.755581 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:00:25.755581 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:00:25.755581 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:00:25.755581 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:00:25.755581 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:00:25.755581 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:00:25.755581 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:00:25.755581 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:00:25.756674 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 01:00:25.756674 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 01:00:25.756674 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 01:00:25.756674 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 01:00:25.756674 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 01:00:25.756674 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 01:00:25.756674 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 01:00:25.756674 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Aug 30 01:00:25.758772 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 438/902] 10.222.0.79 () {56 vars in 1111 bytes} [Tue Aug 30 01:00:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:00:25.767287 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2795ae-d4f6-4e85-89a7-01260cebf502 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:25.870429 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2795ae-d4f6-4e85-89a7-01260cebf502 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:25.908931 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4ecb25-678f-4d39-b468-459fda9e7f00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:25.909837 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4ecb25-678f-4d39-b468-459fda9e7f00 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:25.910346 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4ecb25-678f-4d39-b468-459fda9e7f00 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:25.910769 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4ecb25-678f-4d39-b468-459fda9e7f00 None admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:25.911640 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4ecb25-678f-4d39-b468-459fda9e7f00 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:00:25.912093 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4ecb25-678f-4d39-b468-459fda9e7f00 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:25.913664 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4ecb25-678f-4d39-b468-459fda9e7f00 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:25.927052 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 465/903] 10.222.0.79 () {56 vars in 1148 bytes} [Tue Aug 30 01:00:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:00:25.933432 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144a665e-ff64-4df8-a30f-267e71f5c22c None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:25.968549 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:26.046891 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144a665e-ff64-4df8-a30f-267e71f5c22c None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:26.068237 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4ecb25-678f-4d39-b468-459fda9e7f00 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:26.092032 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb653141-2cfa-4998-8229-7606af52a2d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:26.093310 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb653141-2cfa-4998-8229-7606af52a2d8 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:26.093771 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb653141-2cfa-4998-8229-7606af52a2d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:26.094226 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb653141-2cfa-4998-8229-7606af52a2d8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:26.095162 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb653141-2cfa-4998-8229-7606af52a2d8 None admin] RBAC: Adding query filter params (role.id=3ff248f562e2493b8a0c8f21fe0a08a8, scope.project.id=0eec3a73673e45dc881de586b9b0fbbb, user.id=5cacaed93420436e8f423f96a8041401) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:00:26.095656 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb653141-2cfa-4998-8229-7606af52a2d8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:26.098040 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb653141-2cfa-4998-8229-7606af52a2d8 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:26.105315 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 439/904] 10.222.0.79 () {56 vars in 1374 bytes} [Tue Aug 30 01:00:25 2022] GET /identity/v3/role_assignments?user.id=5cacaed93420436e8f423f96a8041401&scope.project.id=0eec3a73673e45dc881de586b9b0fbbb&role.id=3ff248f562e2493b8a0c8f21fe0a08a8 => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:00:26.144746 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:26.201849 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4ecb25-678f-4d39-b468-459fda9e7f00 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:26.250871 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ae74f3-1107-43c2-896c-bdf685a697c7 None None] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:26.251160 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ae74f3-1107-43c2-896c-bdf685a697c7 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:26.251443 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ae74f3-1107-43c2-896c-bdf685a697c7 None None] PATH_INFO: `/` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:26.252776 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 440/905] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 01:00:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 01:00:26.254767 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a717ec0c-7d89-4053-b2ec-fb8e358b4280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:26.255452 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a717ec0c-7d89-4053-b2ec-fb8e358b4280 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:26.255788 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a717ec0c-7d89-4053-b2ec-fb8e358b4280 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:26.256063 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a717ec0c-7d89-4053-b2ec-fb8e358b4280 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:26.256668 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a717ec0c-7d89-4053-b2ec-fb8e358b4280 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:26.258188 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a717ec0c-7d89-4053-b2ec-fb8e358b4280 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:26.258434 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317bb030-dbda-44dd-94ec-d12d0c5c0125 None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:26.258717 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317bb030-dbda-44dd-94ec-d12d0c5c0125 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:26.258989 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317bb030-dbda-44dd-94ec-d12d0c5c0125 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:26.269263 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-a717ec0c-7d89-4053-b2ec-fb8e358b4280 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 30 01:00:26.269263 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:00:26.269263 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 01:00:26.269263 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 01:00:26.269263 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 01:00:26.269263 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 01:00:26.269263 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 01:00:26.269263 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 01:00:26.269263 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 30 01:00:26.269263 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Aug 30 01:00:26.269263 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 01:00:26.269263 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Aug 30 01:00:26.269263 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:00:26.269263 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:00:26.269263 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:00:26.269263 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:00:26.269263 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:00:26.270330 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:00:26.270330 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:00:26.270330 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:00:26.270330 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:00:26.270330 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:00:26.270330 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:00:26.270330 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 01:00:26.270330 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 01:00:26.270330 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 01:00:26.270330 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 01:00:26.270330 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:00:26.270330 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:00:26.270330 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:00:26.270330 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:00:26.270330 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:00:26.270330 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:00:26.271256 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:00:26.271256 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Aug 30 01:00:26.271256 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:00:26.271256 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:00:26.271256 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:00:26.271256 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:00:26.271256 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:00:26.271256 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:00:26.271256 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:00:26.271256 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:00:26.271256 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 01:00:26.271256 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 01:00:26.271256 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 30 01:00:26.271256 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Aug 30 01:00:26.271256 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 466/906] 10.222.0.79 () {56 vars in 1114 bytes} [Tue Aug 30 01:00:26 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:00:26.276706 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a717ec0c-7d89-4053-b2ec-fb8e358b4280 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:26.281536 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-317bb030-dbda-44dd-94ec-d12d0c5c0125 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:00:26.282969 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-317bb030-dbda-44dd-94ec-d12d0c5c0125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:00:26.367347 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 441/907] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 01:00:26 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 01:00:26.368824 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d3efa2-a0b2-4bed-928c-240ecf821cad None None] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:26.369110 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d3efa2-a0b2-4bed-928c-240ecf821cad None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:26.369378 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d3efa2-a0b2-4bed-928c-240ecf821cad None None] PATH_INFO: `/` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:26.370758 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 442/908] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 01:00:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:00:26.376034 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7e99a7-5af0-4e65-b86c-dac3af1d3f8d None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:26.376309 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7e99a7-5af0-4e65-b86c-dac3af1d3f8d None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:26.376580 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7e99a7-5af0-4e65-b86c-dac3af1d3f8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:26.394536 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a717ec0c-7d89-4053-b2ec-fb8e358b4280 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:26.395901 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-fe7e99a7-5af0-4e65-b86c-dac3af1d3f8d None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:00:26.397086 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-fe7e99a7-5af0-4e65-b86c-dac3af1d3f8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:00:26.422005 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:26.429625 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:26.444912 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b68af1-d860-4aed-a6d9-ccbe5dd1de52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:26.445634 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b68af1-d860-4aed-a6d9-ccbe5dd1de52 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:26.445978 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b68af1-d860-4aed-a6d9-ccbe5dd1de52 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:26.446304 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b68af1-d860-4aed-a6d9-ccbe5dd1de52 None admin] PATH_INFO: `/v3/services` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:26.447713 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b68af1-d860-4aed-a6d9-ccbe5dd1de52 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:00:26.447713 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b68af1-d860-4aed-a6d9-ccbe5dd1de52 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:26.448774 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b68af1-d860-4aed-a6d9-ccbe5dd1de52 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:26.458986 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 467/909] 10.222.0.79 () {56 vars in 1114 bytes} [Tue Aug 30 01:00:26 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:00:26.460119 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b68af1-d860-4aed-a6d9-ccbe5dd1de52 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:26.489915 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 443/910] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 01:00:26 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 01:00:26.574230 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b68af1-d860-4aed-a6d9-ccbe5dd1de52 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:26.615924 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580bc252-d930-4b31-9643-d1ae67ca2825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:26.616525 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580bc252-d930-4b31-9643-d1ae67ca2825 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:26.616800 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580bc252-d930-4b31-9643-d1ae67ca2825 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:26.617068 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580bc252-d930-4b31-9643-d1ae67ca2825 None admin] PATH_INFO: `/v3/services` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:26.617695 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580bc252-d930-4b31-9643-d1ae67ca2825 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:00:26.617988 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580bc252-d930-4b31-9643-d1ae67ca2825 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:26.619362 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580bc252-d930-4b31-9643-d1ae67ca2825 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:26.628326 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 468/911] 10.222.0.79 () {56 vars in 1114 bytes} [Tue Aug 30 01:00:26 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:00:26.636355 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7e99a7-5af0-4e65-b86c-dac3af1d3f8d None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:26.642310 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580bc252-d930-4b31-9643-d1ae67ca2825 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:26.694635 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:26.751823 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7e99a7-5af0-4e65-b86c-dac3af1d3f8d None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:26.763784 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580bc252-d930-4b31-9643-d1ae67ca2825 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:26.793558 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e963046d-df07-42da-86f6-e9249ab65e73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:26.794294 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e963046d-df07-42da-86f6-e9249ab65e73 None admin] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:26.794578 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e963046d-df07-42da-86f6-e9249ab65e73 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:26.795215 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e963046d-df07-42da-86f6-e9249ab65e73 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:26.796183 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e963046d-df07-42da-86f6-e9249ab65e73 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:26.798022 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e963046d-df07-42da-86f6-e9249ab65e73 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:26.802373 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d96cc0-56e1-4792-a3fd-981605477171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:26.803007 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d96cc0-56e1-4792-a3fd-981605477171 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:26.803323 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d96cc0-56e1-4792-a3fd-981605477171 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:26.803596 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d96cc0-56e1-4792-a3fd-981605477171 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:26.804204 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d96cc0-56e1-4792-a3fd-981605477171 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:26.805548 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d96cc0-56e1-4792-a3fd-981605477171 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:26.815604 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-46d96cc0-56e1-4792-a3fd-981605477171 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 30 01:00:26.815604 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:00:26.815604 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 01:00:26.815604 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 01:00:26.815604 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 01:00:26.815604 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 01:00:26.815604 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 01:00:26.815604 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 01:00:26.815604 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 30 01:00:26.815604 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Aug 30 01:00:26.815604 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 01:00:26.815604 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Aug 30 01:00:26.815604 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:00:26.815604 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:00:26.815604 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:00:26.815604 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:00:26.816722 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:00:26.816722 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:00:26.816722 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:00:26.816722 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:00:26.816722 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:00:26.816722 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:00:26.816722 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:00:26.816722 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 01:00:26.816722 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 01:00:26.816722 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 01:00:26.816722 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 01:00:26.816722 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:00:26.816722 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:00:26.816722 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:00:26.816722 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:00:26.816722 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:00:26.816722 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:00:26.817892 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:00:26.817892 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Aug 30 01:00:26.817892 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:00:26.817892 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:00:26.817892 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:00:26.817892 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:00:26.817892 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:00:26.817892 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:00:26.817892 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:00:26.817892 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:00:26.817892 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 01:00:26.817892 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 01:00:26.817892 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 30 01:00:26.817892 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Aug 30 01:00:26.817892 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 469/912] 10.222.0.79 () {56 vars in 1132 bytes} [Tue Aug 30 01:00:26 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 01:00:26.818706 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d96cc0-56e1-4792-a3fd-981605477171 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:26.830137 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 444/913] 10.222.0.79 () {60 vars in 1144 bytes} [Tue Aug 30 01:00:26 2022] POST /identity/v3/endpoints => generated 346 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:00:26.830137 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e963046d-df07-42da-86f6-e9249ab65e73 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:26.849868 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:26.977939 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e963046d-df07-42da-86f6-e9249ab65e73 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:26.981359 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d96cc0-56e1-4792-a3fd-981605477171 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:26.996977 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:27.027334 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025c5a7c-5fde-4e47-8199-3e17c99d5659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:27.028363 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025c5a7c-5fde-4e47-8199-3e17c99d5659 None admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:27.028891 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5fa3c1-6fe0-4f42-b075-11888ed1e287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:27.029116 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025c5a7c-5fde-4e47-8199-3e17c99d5659 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:27.029514 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5fa3c1-6fe0-4f42-b075-11888ed1e287 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:27.029779 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025c5a7c-5fde-4e47-8199-3e17c99d5659 None admin] PATH_INFO: `/v3/services` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:27.029882 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5fa3c1-6fe0-4f42-b075-11888ed1e287 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:27.030046 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5fa3c1-6fe0-4f42-b075-11888ed1e287 None admin] PATH_INFO: `/v3/services` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:27.030692 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5fa3c1-6fe0-4f42-b075-11888ed1e287 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:00:27.030993 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5fa3c1-6fe0-4f42-b075-11888ed1e287 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:27.031284 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025c5a7c-5fde-4e47-8199-3e17c99d5659 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:27.032394 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5fa3c1-6fe0-4f42-b075-11888ed1e287 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:27.033031 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025c5a7c-5fde-4e47-8199-3e17c99d5659 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:27.038335 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 445/914] 10.222.0.79 () {56 vars in 1126 bytes} [Tue Aug 30 01:00:26 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:00:27.045000 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5fa3c1-6fe0-4f42-b075-11888ed1e287 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:27.052076 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 470/915] 10.222.0.79 () {60 vars in 1141 bytes} [Tue Aug 30 01:00:26 2022] POST /identity/v3/services => generated 241 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:00:27.138551 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:27.174510 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5fa3c1-6fe0-4f42-b075-11888ed1e287 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:27.220556 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f46e9f-94d6-40c0-b7ae-9d3fce4ddbf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:27.221536 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f46e9f-94d6-40c0-b7ae-9d3fce4ddbf6 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:27.222011 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f46e9f-94d6-40c0-b7ae-9d3fce4ddbf6 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:27.222497 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f46e9f-94d6-40c0-b7ae-9d3fce4ddbf6 None admin] PATH_INFO: `/v3/services` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:27.223352 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f46e9f-94d6-40c0-b7ae-9d3fce4ddbf6 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:00:27.223905 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f46e9f-94d6-40c0-b7ae-9d3fce4ddbf6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:27.225460 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f46e9f-94d6-40c0-b7ae-9d3fce4ddbf6 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:27.232088 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 446/916] 10.222.0.79 () {56 vars in 1126 bytes} [Tue Aug 30 01:00:27 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:00:27.243159 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025c5a7c-5fde-4e47-8199-3e17c99d5659 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:27.357527 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025c5a7c-5fde-4e47-8199-3e17c99d5659 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:27.393021 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708d5488-7ec8-4050-9386-96fe175f8f3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:27.393625 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708d5488-7ec8-4050-9386-96fe175f8f3b None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:27.393904 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708d5488-7ec8-4050-9386-96fe175f8f3b None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:27.394176 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708d5488-7ec8-4050-9386-96fe175f8f3b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:27.394874 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708d5488-7ec8-4050-9386-96fe175f8f3b None admin] RBAC: Adding query filter params (interface=public, service_id=88ad7dfbb6074df284fab2a8b8996333, region_id=RegionOne) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:00:27.395202 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708d5488-7ec8-4050-9386-96fe175f8f3b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:27.396560 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708d5488-7ec8-4050-9386-96fe175f8f3b None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:27.402194 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 471/917] 10.222.0.79 () {56 vars in 1251 bytes} [Tue Aug 30 01:00:27 2022] GET /identity/v3/endpoints?service_id=88ad7dfbb6074df284fab2a8b8996333&interface=public®ion_id=RegionOne => generated 194 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:00:27.407794 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f46e9f-94d6-40c0-b7ae-9d3fce4ddbf6 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:27.513662 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f46e9f-94d6-40c0-b7ae-9d3fce4ddbf6 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:27.549284 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:27.554749 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3d0b4c-419a-471a-9978-34cb649ffbf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:27.555389 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3d0b4c-419a-471a-9978-34cb649ffbf2 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:27.555667 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3d0b4c-419a-471a-9978-34cb649ffbf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:27.555941 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3d0b4c-419a-471a-9978-34cb649ffbf2 None admin] PATH_INFO: `/v3/services` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:27.556551 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3d0b4c-419a-471a-9978-34cb649ffbf2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:27.557908 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3d0b4c-419a-471a-9978-34cb649ffbf2 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:27.564698 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 447/918] 10.222.0.79 () {56 vars in 1087 bytes} [Tue Aug 30 01:00:27 2022] GET /identity/v3/services => generated 1497 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 01:00:28.141898 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e0b1a9-00d5-45ff-af29-e9899a790ca2 None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:28.142471 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e0b1a9-00d5-45ff-af29-e9899a790ca2 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:28.142471 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e0b1a9-00d5-45ff-af29-e9899a790ca2 None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:28.144098 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 472/919] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 01:00:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:00:28.149688 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901a3b24-1ffc-4b23-b6ff-b14adeb80aa2 None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:28.150221 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901a3b24-1ffc-4b23-b6ff-b14adeb80aa2 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:28.150221 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901a3b24-1ffc-4b23-b6ff-b14adeb80aa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:28.171095 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-901a3b24-1ffc-4b23-b6ff-b14adeb80aa2 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:00:28.172336 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-901a3b24-1ffc-4b23-b6ff-b14adeb80aa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:00:28.248263 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 448/920] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 01:00:28 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 01:00:28.527280 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e0b1a9-00d5-45ff-af29-e9899a790ca2 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:28.577275 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:28.643253 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e0b1a9-00d5-45ff-af29-e9899a790ca2 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:28.683275 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe03c2c-008b-4c50-af31-972eb8da4221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:28.684079 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe03c2c-008b-4c50-af31-972eb8da4221 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:28.684530 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe03c2c-008b-4c50-af31-972eb8da4221 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:28.684811 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe03c2c-008b-4c50-af31-972eb8da4221 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:28.697580 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe03c2c-008b-4c50-af31-972eb8da4221 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 01:00:28.703384 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-afe03c2c-008b-4c50-af31-972eb8da4221 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 01:00:28.703384 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:00:28.703384 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:00:28.703384 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:00:28.703384 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:00:28.703384 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:00:28.703384 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:00:28.703384 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:00:28.703384 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:00:28.703384 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:00:28.703384 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:00:28.703384 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:00:28.703384 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 01:00:28.703384 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 01:00:28.703384 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 01:00:28.703384 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 01:00:28.704411 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 01:00:28.704411 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 01:00:28.704411 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 01:00:28.704411 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 01:00:28.704411 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:00:28.704411 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:00:28.704411 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:00:28.704411 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:00:28.704411 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:00:28.704411 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:00:28.704411 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:00:28.704411 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Aug 30 01:00:28.704411 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:00:28.704411 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:00:28.704411 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:00:28.704411 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:00:28.705311 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:00:28.705311 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:00:28.705311 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:00:28.705311 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:00:28.705311 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 01:00:28.705311 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 01:00:28.705311 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 01:00:28.705311 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 01:00:28.705311 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 01:00:28.705311 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 01:00:28.705311 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 01:00:28.705311 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Aug 30 01:00:28.708943 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 473/921] 10.222.0.79 () {56 vars in 1120 bytes} [Tue Aug 30 01:00:28 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:00:28.711033 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901a3b24-1ffc-4b23-b6ff-b14adeb80aa2 None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:28.818080 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901a3b24-1ffc-4b23-b6ff-b14adeb80aa2 None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:28.846598 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:28.856456 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715c5452-1ca2-43d1-8357-384c7d9eb535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:28.857562 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715c5452-1ca2-43d1-8357-384c7d9eb535 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:28.857841 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715c5452-1ca2-43d1-8357-384c7d9eb535 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:28.858114 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715c5452-1ca2-43d1-8357-384c7d9eb535 None admin] PATH_INFO: `/v3/roles` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:28.858800 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715c5452-1ca2-43d1-8357-384c7d9eb535 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:00:28.859099 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715c5452-1ca2-43d1-8357-384c7d9eb535 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:28.860509 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715c5452-1ca2-43d1-8357-384c7d9eb535 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:28.869789 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 449/922] 10.222.0.79 () {56 vars in 1115 bytes} [Tue Aug 30 01:00:28 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:00:28.876100 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe03c2c-008b-4c50-af31-972eb8da4221 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:28.929261 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ecdf48-3159-435a-9ee0-101f33b3c1d7 None None] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:28.929537 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ecdf48-3159-435a-9ee0-101f33b3c1d7 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:28.929805 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ecdf48-3159-435a-9ee0-101f33b3c1d7 None None] PATH_INFO: `/` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:28.932149 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 450/923] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 01:00:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 01:00:28.941024 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9b3d6e-6d18-46f2-90a9-c7f3d6cfdcac None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:28.941510 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9b3d6e-6d18-46f2-90a9-c7f3d6cfdcac None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:28.941873 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9b3d6e-6d18-46f2-90a9-c7f3d6cfdcac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:28.973178 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-7e9b3d6e-6d18-46f2-90a9-c7f3d6cfdcac None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:00:28.974680 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-7e9b3d6e-6d18-46f2-90a9-c7f3d6cfdcac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:00:28.990422 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:28.995261 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe03c2c-008b-4c50-af31-972eb8da4221 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:29.036148 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a39da25-7f97-4001-93f9-34a23faf207e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:29.037265 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a39da25-7f97-4001-93f9-34a23faf207e None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:29.037766 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a39da25-7f97-4001-93f9-34a23faf207e None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:29.038245 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a39da25-7f97-4001-93f9-34a23faf207e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:29.053348 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a39da25-7f97-4001-93f9-34a23faf207e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:29.055413 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a39da25-7f97-4001-93f9-34a23faf207e None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:29.074318 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-4a39da25-7f97-4001-93f9-34a23faf207e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:00:29.074318 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:00:29.074318 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:00:29.074318 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:00:29.074318 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:00:29.074318 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:00:29.074318 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:00:29.074318 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:00:29.074318 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:00:29.074318 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:00:29.074318 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:00:29.074318 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:00:29.074318 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 01:00:29.074318 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 01:00:29.074318 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 01:00:29.074318 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 01:00:29.076033 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:00:29.076033 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:00:29.076033 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:00:29.076033 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:00:29.076033 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:00:29.076033 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:00:29.076033 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:00:29.076033 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Aug 30 01:00:29.076033 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:00:29.076033 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:00:29.076033 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:00:29.076033 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:00:29.076033 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:00:29.076033 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:00:29.076033 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:00:29.076033 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:00:29.076033 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 01:00:29.076912 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 01:00:29.076912 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:00:29.076912 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Aug 30 01:00:29.078971 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 474/924] 10.222.0.79 () {56 vars in 1108 bytes} [Tue Aug 30 01:00:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:00:29.085262 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a39da25-7f97-4001-93f9-34a23faf207e None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:29.086173 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 451/925] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 01:00:28 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 01:00:29.120360 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54c888c-2236-4052-8213-e4aa7bfc5c31 None None] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:29.120691 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54c888c-2236-4052-8213-e4aa7bfc5c31 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:29.120909 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54c888c-2236-4052-8213-e4aa7bfc5c31 None None] PATH_INFO: `/` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:29.123519 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 452/926] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 01:00:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 01:00:29.128840 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2b6391-01de-4c57-a836-0ef38c54b34d None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:29.129119 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2b6391-01de-4c57-a836-0ef38c54b34d None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:29.129390 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2b6391-01de-4c57-a836-0ef38c54b34d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:29.149605 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-8c2b6391-01de-4c57-a836-0ef38c54b34d None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:00:29.151068 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-8c2b6391-01de-4c57-a836-0ef38c54b34d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:00:29.211828 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a39da25-7f97-4001-93f9-34a23faf207e None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:29.246082 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 453/927] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 01:00:29 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 01:00:29.253221 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786d9e4f-ca5c-4e65-9b06-3d78634ed728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:29.253812 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786d9e4f-ca5c-4e65-9b06-3d78634ed728 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:29.254086 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786d9e4f-ca5c-4e65-9b06-3d78634ed728 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:29.254352 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786d9e4f-ca5c-4e65-9b06-3d78634ed728 None admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:29.255000 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786d9e4f-ca5c-4e65-9b06-3d78634ed728 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:00:29.255318 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786d9e4f-ca5c-4e65-9b06-3d78634ed728 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:29.256673 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786d9e4f-ca5c-4e65-9b06-3d78634ed728 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:29.270931 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 475/928] 10.222.0.79 () {56 vars in 1109 bytes} [Tue Aug 30 01:00:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:00:29.278927 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2b6391-01de-4c57-a836-0ef38c54b34d None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:29.339637 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:29.374464 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786d9e4f-ca5c-4e65-9b06-3d78634ed728 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:29.388894 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:29.391494 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2b6391-01de-4c57-a836-0ef38c54b34d None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:29.439937 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba54290-3533-44fa-a38a-e7ad77d1673f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:29.440673 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba54290-3533-44fa-a38a-e7ad77d1673f None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:29.440952 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba54290-3533-44fa-a38a-e7ad77d1673f None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:29.441221 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba54290-3533-44fa-a38a-e7ad77d1673f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:29.452727 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba54290-3533-44fa-a38a-e7ad77d1673f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:29.454872 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba54290-3533-44fa-a38a-e7ad77d1673f None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:29.471285 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application [None req-0ba54290-3533-44fa-a38a-e7ad77d1673f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 01:00:29.471285 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:00:29.471285 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:00:29.471285 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:00:29.471285 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:00:29.471285 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:00:29.471285 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:00:29.471285 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:00:29.471285 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:00:29.471285 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:00:29.471285 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:00:29.471285 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:00:29.471285 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 01:00:29.471285 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 01:00:29.471285 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 01:00:29.471285 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 01:00:29.472340 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:00:29.472340 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:00:29.472340 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 01:00:29.472340 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 01:00:29.472340 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 01:00:29.472340 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 01:00:29.472340 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:00:29.472340 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:00:29.472340 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:00:29.472340 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:00:29.472340 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:00:29.472340 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application with Lock( Aug 30 01:00:29.472340 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:00:29.472340 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:00:29.472340 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:00:29.472340 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:00:29.472340 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:00:29.472340 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:00:29.473975 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:00:29.473975 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:00:29.473975 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 01:00:29.473975 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 01:00:29.473975 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 01:00:29.473975 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 01:00:29.473975 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 01:00:29.473975 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 01:00:29.473975 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 01:00:29.473975 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Aug 30 01:00:29.477720 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 454/929] 10.222.0.79 () {56 vars in 1117 bytes} [Tue Aug 30 01:00:29 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:00:29.478788 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba54290-3533-44fa-a38a-e7ad77d1673f None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:29.510629 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786d9e4f-ca5c-4e65-9b06-3d78634ed728 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:29.560789 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09840dd-366e-47be-abd1-d33bd912b4f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:29.561400 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09840dd-366e-47be-abd1-d33bd912b4f9 None admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:29.561705 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09840dd-366e-47be-abd1-d33bd912b4f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:29.562070 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09840dd-366e-47be-abd1-d33bd912b4f9 None admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:29.562736 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09840dd-366e-47be-abd1-d33bd912b4f9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:29.564322 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09840dd-366e-47be-abd1-d33bd912b4f9 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:29.567251 dv-cinder-819667-6-smb devstack@keystone.service[81999]: WARNING keystone.server.flask.common [None req-f09840dd-366e-47be-abd1-d33bd912b4f9 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 30 01:00:29.586957 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.sql.core [None req-f09840dd-366e-47be-abd1-d33bd912b4f9 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 30 01:00:29.586957 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 30 01:00:29.586957 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [parameters: {'id': '0c180813fa8f42a49b17f7e29473c61b', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 30 01:00:29.586957 dv-cinder-819667-6-smb devstack@keystone.service[81999]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81999) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 30 01:00:29.603716 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-f09840dd-366e-47be-abd1-d33bd912b4f9 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 0c180813fa8f42a49b17f7e29473c61b.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 0c180813fa8f42a49b17f7e29473c61b. Aug 30 01:00:29.603716 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:00:29.603716 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 30 01:00:29.603716 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 30 01:00:29.603716 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 30 01:00:29.603716 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 30 01:00:29.603716 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 30 01:00:29.603716 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application result = self._query(query) Aug 30 01:00:29.603716 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 30 01:00:29.603716 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application conn.query(q) Aug 30 01:00:29.603716 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 30 01:00:29.603716 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 30 01:00:29.603716 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 30 01:00:29.604778 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application result.read() Aug 30 01:00:29.604778 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 30 01:00:29.604778 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 30 01:00:29.604778 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 30 01:00:29.604778 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 30 01:00:29.604778 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 30 01:00:29.604778 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 30 01:00:29.604778 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 30 01:00:29.604778 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 30 01:00:29.604778 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 30 01:00:29.604778 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Aug 30 01:00:29.604778 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 30 01:00:29.604778 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Aug 30 01:00:29.604778 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:00:29.604778 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 30 01:00:29.604778 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 30 01:00:29.604778 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 30 01:00:29.604778 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 30 01:00:29.606043 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 30 01:00:29.606043 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application next(self.gen) Aug 30 01:00:29.606043 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 30 01:00:29.606043 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application yield resource Aug 30 01:00:29.606043 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 30 01:00:29.606043 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application next(self.gen) Aug 30 01:00:29.606043 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 30 01:00:29.606043 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application self.session.rollback() Aug 30 01:00:29.606043 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 01:00:29.606043 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application self.force_reraise() Aug 30 01:00:29.606043 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 01:00:29.606043 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise self.value Aug 30 01:00:29.606043 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 30 01:00:29.606043 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 30 01:00:29.606043 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 30 01:00:29.606043 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application session.commit() Aug 30 01:00:29.606043 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 30 01:00:29.607143 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 30 01:00:29.607143 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 30 01:00:29.607143 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application self._prepare_impl() Aug 30 01:00:29.607143 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 30 01:00:29.607143 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application self.session.flush() Aug 30 01:00:29.607143 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 30 01:00:29.607143 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application self._flush(objects) Aug 30 01:00:29.607143 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 30 01:00:29.607143 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 30 01:00:29.607143 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 30 01:00:29.607143 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application compat.raise_( Aug 30 01:00:29.607143 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 30 01:00:29.607143 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception Aug 30 01:00:29.607143 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 30 01:00:29.607143 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application flush_context.execute() Aug 30 01:00:29.607143 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 30 01:00:29.607143 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application rec.execute(self) Aug 30 01:00:29.608204 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 30 01:00:29.608204 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 30 01:00:29.608204 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 30 01:00:29.608204 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 30 01:00:29.608204 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 30 01:00:29.608204 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 30 01:00:29.608204 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 30 01:00:29.608204 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 30 01:00:29.608204 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 30 01:00:29.608204 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 30 01:00:29.608204 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 30 01:00:29.608204 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 30 01:00:29.608204 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 30 01:00:29.608204 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 30 01:00:29.608204 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 30 01:00:29.609121 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 30 01:00:29.609121 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 30 01:00:29.609121 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception Aug 30 01:00:29.609121 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 30 01:00:29.609121 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 30 01:00:29.609121 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 30 01:00:29.609121 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 30 01:00:29.609121 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 30 01:00:29.609121 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application result = self._query(query) Aug 30 01:00:29.609121 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 30 01:00:29.609121 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application conn.query(q) Aug 30 01:00:29.609121 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 30 01:00:29.609121 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 30 01:00:29.609121 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 30 01:00:29.609121 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application result.read() Aug 30 01:00:29.609121 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 30 01:00:29.609121 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 30 01:00:29.610473 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 30 01:00:29.610473 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 30 01:00:29.610473 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 30 01:00:29.610473 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 30 01:00:29.610473 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 30 01:00:29.610473 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 30 01:00:29.610473 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 30 01:00:29.610473 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 30 01:00:29.610473 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application [parameters: {'id': '0c180813fa8f42a49b17f7e29473c61b', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 30 01:00:29.610473 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 30 01:00:29.610473 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Aug 30 01:00:29.610473 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 01:00:29.610473 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Aug 30 01:00:29.610473 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:00:29.610473 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 30 01:00:29.611603 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 30 01:00:29.611603 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 30 01:00:29.611603 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 30 01:00:29.611603 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 30 01:00:29.611603 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Aug 30 01:00:29.611603 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 01:00:29.611603 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Aug 30 01:00:29.611603 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:00:29.611603 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:00:29.611603 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:00:29.611603 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:00:29.611603 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:00:29.611603 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:00:29.611603 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:00:29.611603 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:00:29.611603 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:00:29.611603 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:00:29.612739 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:00:29.612739 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 30 01:00:29.612739 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 30 01:00:29.612739 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:00:29.612739 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:00:29.612739 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 30 01:00:29.612739 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 30 01:00:29.612739 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 0c180813fa8f42a49b17f7e29473c61b. Aug 30 01:00:29.612739 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Aug 30 01:00:29.612739 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 476/930] 10.222.0.79 () {60 vars in 1140 bytes} [Tue Aug 30 01:00:29 2022] POST /identity/v3/projects => generated 262 bytes in 231 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:00:29.612739 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09840dd-366e-47be-abd1-d33bd912b4f9 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:29.629143 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba54290-3533-44fa-a38a-e7ad77d1673f None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:29.639423 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:29.669564 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d7c2d1-6090-4a97-ba4f-d625b35723c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:29.670473 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d7c2d1-6090-4a97-ba4f-d625b35723c0 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:29.670901 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d7c2d1-6090-4a97-ba4f-d625b35723c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:29.671345 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d7c2d1-6090-4a97-ba4f-d625b35723c0 None admin] PATH_INFO: `/v3/users` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:29.672479 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d7c2d1-6090-4a97-ba4f-d625b35723c0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:00:29.672946 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d7c2d1-6090-4a97-ba4f-d625b35723c0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:29.675269 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d7c2d1-6090-4a97-ba4f-d625b35723c0 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:29.677793 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:29.697958 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 455/931] 10.222.0.79 () {56 vars in 1149 bytes} [Tue Aug 30 01:00:29 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:00:29.700615 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd24dd9e-8e01-4b04-9d36-c3bf14e7aafb None None] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:29.701103 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd24dd9e-8e01-4b04-9d36-c3bf14e7aafb None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:29.701552 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd24dd9e-8e01-4b04-9d36-c3bf14e7aafb None None] PATH_INFO: `/` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:29.702891 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 456/932] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 01:00:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:00:29.703767 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd24dd9e-8e01-4b04-9d36-c3bf14e7aafb None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:29.721082 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09840dd-366e-47be-abd1-d33bd912b4f9 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:29.761143 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4ce0dc-1436-47c4-bcf5-a2f43a570077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:29.761773 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4ce0dc-1436-47c4-bcf5-a2f43a570077 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:29.763266 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4ce0dc-1436-47c4-bcf5-a2f43a570077 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:29.763266 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4ce0dc-1436-47c4-bcf5-a2f43a570077 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:29.763867 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4ce0dc-1436-47c4-bcf5-a2f43a570077 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:29.765429 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4ce0dc-1436-47c4-bcf5-a2f43a570077 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:29.774804 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-2b4ce0dc-1436-47c4-bcf5-a2f43a570077 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 01:00:29.774804 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:00:29.774804 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 01:00:29.774804 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 01:00:29.774804 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 01:00:29.774804 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 01:00:29.774804 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 01:00:29.774804 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 01:00:29.774804 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 01:00:29.774804 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Aug 30 01:00:29.774804 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 01:00:29.774804 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Aug 30 01:00:29.774804 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:00:29.774804 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:00:29.774804 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:00:29.774804 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:00:29.774804 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:00:29.776069 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:00:29.776069 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:00:29.776069 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:00:29.776069 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:00:29.776069 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:00:29.776069 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:00:29.776069 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 01:00:29.776069 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 01:00:29.776069 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 01:00:29.776069 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 01:00:29.776069 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:00:29.776069 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:00:29.776069 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:00:29.776069 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:00:29.776069 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:00:29.776069 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:00:29.777356 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:00:29.777356 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Aug 30 01:00:29.777356 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:00:29.777356 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:00:29.777356 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:00:29.777356 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:00:29.777356 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:00:29.777356 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:00:29.777356 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:00:29.777356 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:00:29.777356 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 01:00:29.777356 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 01:00:29.777356 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 01:00:29.777356 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Aug 30 01:00:29.777356 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 477/933] 10.222.0.79 () {56 vars in 1126 bytes} [Tue Aug 30 01:00:29 2022] GET /identity/v3/services/object-store => generated 93 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:00:29.778718 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4ce0dc-1436-47c4-bcf5-a2f43a570077 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:29.815338 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd24dd9e-8e01-4b04-9d36-c3bf14e7aafb None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:29.851244 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b882ba67-0b90-4d53-84db-758386459cb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:29.851861 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b882ba67-0b90-4d53-84db-758386459cb2 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:29.852136 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b882ba67-0b90-4d53-84db-758386459cb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:29.852401 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b882ba67-0b90-4d53-84db-758386459cb2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:29.859954 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b882ba67-0b90-4d53-84db-758386459cb2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:29.861319 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b882ba67-0b90-4d53-84db-758386459cb2 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:29.873090 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application [None req-b882ba67-0b90-4d53-84db-758386459cb2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 01:00:29.873090 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:00:29.873090 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:00:29.873090 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:00:29.873090 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:00:29.873090 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:00:29.873090 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:00:29.873090 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:00:29.873090 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:00:29.873090 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:00:29.873090 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:00:29.873090 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:00:29.873090 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 01:00:29.873090 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 01:00:29.873090 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 01:00:29.874077 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 01:00:29.874077 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:00:29.874077 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:00:29.874077 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:00:29.874077 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:00:29.874077 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:00:29.874077 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:00:29.874077 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:00:29.874077 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application with Lock( Aug 30 01:00:29.874077 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:00:29.874077 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:00:29.874077 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:00:29.874077 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:00:29.874077 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:00:29.874077 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:00:29.874077 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:00:29.874077 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:00:29.875411 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 01:00:29.875411 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 01:00:29.875411 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 01:00:29.875411 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 01:00:29.875411 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 01:00:29.875411 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 01:00:29.875411 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 01:00:29.875411 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Aug 30 01:00:29.875411 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 457/934] 10.222.0.79 () {56 vars in 1111 bytes} [Tue Aug 30 01:00:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:00:29.876047 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31652795-686a-438d-a653-7e8ebb894dec None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:29.876047 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31652795-686a-438d-a653-7e8ebb894dec None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:29.876208 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31652795-686a-438d-a653-7e8ebb894dec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:29.885139 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4ce0dc-1436-47c4-bcf5-a2f43a570077 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:29.896254 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-31652795-686a-438d-a653-7e8ebb894dec None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:00:29.897821 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-31652795-686a-438d-a653-7e8ebb894dec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:00:29.917845 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:29.920970 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:29.924419 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68130837-ebab-41a6-bf81-1d81b2b0b26e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:29.925044 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68130837-ebab-41a6-bf81-1d81b2b0b26e None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:29.925330 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68130837-ebab-41a6-bf81-1d81b2b0b26e None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:29.925597 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68130837-ebab-41a6-bf81-1d81b2b0b26e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:29.936740 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68130837-ebab-41a6-bf81-1d81b2b0b26e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:29.938181 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68130837-ebab-41a6-bf81-1d81b2b0b26e None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:29.954238 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-68130837-ebab-41a6-bf81-1d81b2b0b26e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:00:29.954238 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:00:29.954238 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:00:29.954238 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:00:29.954238 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:00:29.954238 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:00:29.954238 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:00:29.954238 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:00:29.954238 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:00:29.954238 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:00:29.954238 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:00:29.954238 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:00:29.954238 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 01:00:29.954238 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 01:00:29.954238 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 01:00:29.954238 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 01:00:29.955697 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:00:29.955697 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:00:29.955697 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:00:29.955697 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:00:29.955697 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:00:29.955697 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:00:29.955697 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:00:29.955697 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Aug 30 01:00:29.955697 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:00:29.955697 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:00:29.955697 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:00:29.955697 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:00:29.955697 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:00:29.955697 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:00:29.955697 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:00:29.955697 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:00:29.955697 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 01:00:29.956608 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 01:00:29.956608 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:00:29.956608 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Aug 30 01:00:29.956608 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 478/935] 10.222.0.79 () {56 vars in 1108 bytes} [Tue Aug 30 01:00:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:00:29.956608 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68130837-ebab-41a6-bf81-1d81b2b0b26e None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:29.983121 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 458/936] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 01:00:29 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 01:00:29.983977 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31652795-686a-438d-a653-7e8ebb894dec None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:30.097035 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68130837-ebab-41a6-bf81-1d81b2b0b26e None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:30.130664 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31652795-686a-438d-a653-7e8ebb894dec None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:30.142451 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3c2962-cbb6-4735-b326-cc71ab39484d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:30.143062 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3c2962-cbb6-4735-b326-cc71ab39484d None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:30.143377 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3c2962-cbb6-4735-b326-cc71ab39484d None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:30.143652 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3c2962-cbb6-4735-b326-cc71ab39484d None admin] PATH_INFO: `/v3/services` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:30.144291 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3c2962-cbb6-4735-b326-cc71ab39484d None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:00:30.144587 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3c2962-cbb6-4735-b326-cc71ab39484d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:30.145949 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3c2962-cbb6-4735-b326-cc71ab39484d None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:30.156388 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 479/937] 10.222.0.79 () {56 vars in 1122 bytes} [Tue Aug 30 01:00:29 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:00:30.157319 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3c2962-cbb6-4735-b326-cc71ab39484d None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:30.182056 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c199ee97-2e00-48a7-b999-4355aca8ffbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:30.182807 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c199ee97-2e00-48a7-b999-4355aca8ffbd None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:30.183263 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c199ee97-2e00-48a7-b999-4355aca8ffbd None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:30.183543 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c199ee97-2e00-48a7-b999-4355aca8ffbd None admin] PATH_INFO: `/v3/projects` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:30.184825 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c199ee97-2e00-48a7-b999-4355aca8ffbd None admin] RBAC: Adding query filter params (name=service) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:00:30.185219 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c199ee97-2e00-48a7-b999-4355aca8ffbd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:30.187240 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c199ee97-2e00-48a7-b999-4355aca8ffbd None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:30.215166 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 459/938] 10.222.0.79 () {56 vars in 1112 bytes} [Tue Aug 30 01:00:29 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:00:30.215166 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c199ee97-2e00-48a7-b999-4355aca8ffbd None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:30.223333 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:30.252067 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:30.307316 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3c2962-cbb6-4735-b326-cc71ab39484d None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:30.362858 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd91eaa4-0228-4f28-b31d-22a0086408da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:30.363818 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd91eaa4-0228-4f28-b31d-22a0086408da None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:30.364236 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd91eaa4-0228-4f28-b31d-22a0086408da None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:30.364646 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd91eaa4-0228-4f28-b31d-22a0086408da None admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:30.364759 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c199ee97-2e00-48a7-b999-4355aca8ffbd None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:30.365651 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd91eaa4-0228-4f28-b31d-22a0086408da None admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:00:30.366122 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd91eaa4-0228-4f28-b31d-22a0086408da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:30.368468 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd91eaa4-0228-4f28-b31d-22a0086408da None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:30.387047 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 480/939] 10.222.0.79 () {56 vars in 1109 bytes} [Tue Aug 30 01:00:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:00:30.393052 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd91eaa4-0228-4f28-b31d-22a0086408da None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:30.420443 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71037ea-6e06-47b8-ac50-42d9af6e9954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:30.421340 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71037ea-6e06-47b8-ac50-42d9af6e9954 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:30.421618 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71037ea-6e06-47b8-ac50-42d9af6e9954 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:30.421885 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71037ea-6e06-47b8-ac50-42d9af6e9954 None admin] PATH_INFO: `/v3/services` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:30.423834 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71037ea-6e06-47b8-ac50-42d9af6e9954 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:00:30.423834 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71037ea-6e06-47b8-ac50-42d9af6e9954 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:30.424221 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71037ea-6e06-47b8-ac50-42d9af6e9954 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:30.429894 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 460/940] 10.222.0.79 () {56 vars in 1122 bytes} [Tue Aug 30 01:00:30 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:00:30.430557 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71037ea-6e06-47b8-ac50-42d9af6e9954 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:30.527351 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd91eaa4-0228-4f28-b31d-22a0086408da None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:30.532569 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:30.535814 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:30.558176 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71037ea-6e06-47b8-ac50-42d9af6e9954 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:30.566643 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5b2b22-b5e9-4bb0-8602-1edc3981ac5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:30.567333 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5b2b22-b5e9-4bb0-8602-1edc3981ac5d None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:30.567865 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5b2b22-b5e9-4bb0-8602-1edc3981ac5d None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:30.568130 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5b2b22-b5e9-4bb0-8602-1edc3981ac5d None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:30.568710 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5b2b22-b5e9-4bb0-8602-1edc3981ac5d None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:30.570482 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5b2b22-b5e9-4bb0-8602-1edc3981ac5d None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:30.580462 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-1b5b2b22-b5e9-4bb0-8602-1edc3981ac5d None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 30 01:00:30.580462 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:00:30.580462 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 01:00:30.580462 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 01:00:30.580462 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 01:00:30.580462 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 01:00:30.580462 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 01:00:30.580462 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 01:00:30.580462 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 30 01:00:30.580462 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Aug 30 01:00:30.580462 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 01:00:30.580462 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Aug 30 01:00:30.580462 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:00:30.580462 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:00:30.580462 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:00:30.580462 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:00:30.581493 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:00:30.581493 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:00:30.581493 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:00:30.581493 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:00:30.581493 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:00:30.581493 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:00:30.581493 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:00:30.581493 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 01:00:30.581493 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 01:00:30.581493 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 01:00:30.581493 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 01:00:30.581493 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:00:30.581493 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:00:30.581493 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:00:30.581493 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:00:30.581493 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:00:30.581493 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:00:30.582390 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:00:30.582390 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Aug 30 01:00:30.582390 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:00:30.582390 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:00:30.582390 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:00:30.582390 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:00:30.582390 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:00:30.582390 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:00:30.582390 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:00:30.582390 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:00:30.582390 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 01:00:30.582390 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 01:00:30.582390 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 30 01:00:30.582390 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Aug 30 01:00:30.582390 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 481/941] 10.222.0.79 () {56 vars in 1132 bytes} [Tue Aug 30 01:00:30 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:00:30.583866 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5b2b22-b5e9-4bb0-8602-1edc3981ac5d None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:30.601508 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b1d36a-da9d-46be-b8ad-698285fad308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:30.602140 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b1d36a-da9d-46be-b8ad-698285fad308 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:30.602412 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b1d36a-da9d-46be-b8ad-698285fad308 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:30.602674 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b1d36a-da9d-46be-b8ad-698285fad308 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:30.611928 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b1d36a-da9d-46be-b8ad-698285fad308 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:30.613390 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b1d36a-da9d-46be-b8ad-698285fad308 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:30.626124 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application [None req-75b1d36a-da9d-46be-b8ad-698285fad308 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 01:00:30.626124 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:00:30.626124 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:00:30.626124 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:00:30.626124 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:00:30.626124 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:00:30.626124 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:00:30.626124 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:00:30.626124 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:00:30.626124 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:00:30.626124 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:00:30.626124 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:00:30.626124 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 01:00:30.626124 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 01:00:30.626124 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 01:00:30.627087 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 01:00:30.627087 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:00:30.627087 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:00:30.627087 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:00:30.627087 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:00:30.627087 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:00:30.627087 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:00:30.627087 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:00:30.627087 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application with Lock( Aug 30 01:00:30.627087 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:00:30.627087 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:00:30.627087 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:00:30.627087 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:00:30.627087 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:00:30.627087 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:00:30.627087 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:00:30.627087 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:00:30.628019 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 01:00:30.628019 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 01:00:30.628019 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 01:00:30.628019 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 01:00:30.628019 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 01:00:30.628019 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 01:00:30.628019 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 01:00:30.628019 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Aug 30 01:00:30.628019 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 461/942] 10.222.0.79 () {56 vars in 1111 bytes} [Tue Aug 30 01:00:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:00:30.628521 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b1d36a-da9d-46be-b8ad-698285fad308 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:30.718457 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5b2b22-b5e9-4bb0-8602-1edc3981ac5d None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:30.768861 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b036119-390a-4d5a-a3fc-e4774ddbed63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:30.769474 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b036119-390a-4d5a-a3fc-e4774ddbed63 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:30.769767 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b036119-390a-4d5a-a3fc-e4774ddbed63 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:30.770013 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b036119-390a-4d5a-a3fc-e4774ddbed63 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:30.770727 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b036119-390a-4d5a-a3fc-e4774ddbed63 None admin] RBAC: Adding query filter params (interface=public, service_id=bc6c24419cd14fdabdfefeb33ad7c9eb, region_id=RegionOne) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:00:30.771036 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b036119-390a-4d5a-a3fc-e4774ddbed63 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:30.772449 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b036119-390a-4d5a-a3fc-e4774ddbed63 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:30.779479 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 482/943] 10.222.0.79 () {56 vars in 1251 bytes} [Tue Aug 30 01:00:30 2022] GET /identity/v3/endpoints?service_id=bc6c24419cd14fdabdfefeb33ad7c9eb&interface=public®ion_id=RegionOne => generated 194 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:00:30.780223 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b036119-390a-4d5a-a3fc-e4774ddbed63 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:30.788623 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b1d36a-da9d-46be-b8ad-698285fad308 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:30.823916 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:30.832704 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da68222-e412-4285-a75f-2ed40fa6110a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:30.833372 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da68222-e412-4285-a75f-2ed40fa6110a None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:30.833650 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da68222-e412-4285-a75f-2ed40fa6110a None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:30.833916 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da68222-e412-4285-a75f-2ed40fa6110a None admin] PATH_INFO: `/v3/services` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:30.834926 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da68222-e412-4285-a75f-2ed40fa6110a None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:00:30.835255 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da68222-e412-4285-a75f-2ed40fa6110a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:30.836957 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da68222-e412-4285-a75f-2ed40fa6110a None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:30.843284 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 462/944] 10.222.0.79 () {56 vars in 1126 bytes} [Tue Aug 30 01:00:30 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:00:30.844074 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da68222-e412-4285-a75f-2ed40fa6110a None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:30.849112 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:30.905849 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b036119-390a-4d5a-a3fc-e4774ddbed63 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:30.941227 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65187693-7106-40a6-89bd-550e2880d793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:30.942192 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65187693-7106-40a6-89bd-550e2880d793 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:30.942914 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65187693-7106-40a6-89bd-550e2880d793 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:30.943401 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65187693-7106-40a6-89bd-550e2880d793 None admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:30.944298 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65187693-7106-40a6-89bd-550e2880d793 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:00:30.944669 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65187693-7106-40a6-89bd-550e2880d793 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:30.946098 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65187693-7106-40a6-89bd-550e2880d793 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:30.966052 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 483/945] 10.222.0.79 () {56 vars in 1148 bytes} [Tue Aug 30 01:00:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:00:30.966052 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65187693-7106-40a6-89bd-550e2880d793 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:30.966351 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da68222-e412-4285-a75f-2ed40fa6110a None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:31.001292 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128d087c-4ba4-47bc-9e50-48597bae235e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:31.001913 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128d087c-4ba4-47bc-9e50-48597bae235e None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:31.002191 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128d087c-4ba4-47bc-9e50-48597bae235e None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:31.002465 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128d087c-4ba4-47bc-9e50-48597bae235e None admin] PATH_INFO: `/v3/services` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:31.003080 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128d087c-4ba4-47bc-9e50-48597bae235e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:31.004475 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128d087c-4ba4-47bc-9e50-48597bae235e None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:31.019154 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 463/946] 10.222.0.79 () {56 vars in 1087 bytes} [Tue Aug 30 01:00:30 2022] GET /identity/v3/services => generated 1497 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:00:31.019154 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128d087c-4ba4-47bc-9e50-48597bae235e None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:31.089825 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:31.100305 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65187693-7106-40a6-89bd-550e2880d793 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:31.109290 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:31.146204 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b64ca10-229c-407d-a2f1-e20276ff8996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:31.147108 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b64ca10-229c-407d-a2f1-e20276ff8996 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:31.147605 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b64ca10-229c-407d-a2f1-e20276ff8996 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:31.148057 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b64ca10-229c-407d-a2f1-e20276ff8996 None admin] PATH_INFO: `/v3/services` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:31.148908 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b64ca10-229c-407d-a2f1-e20276ff8996 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:00:31.149472 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b64ca10-229c-407d-a2f1-e20276ff8996 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:31.151252 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b64ca10-229c-407d-a2f1-e20276ff8996 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:31.159180 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 484/947] 10.222.0.79 () {56 vars in 1126 bytes} [Tue Aug 30 01:00:30 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:00:31.165449 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b64ca10-229c-407d-a2f1-e20276ff8996 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:31.175022 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128d087c-4ba4-47bc-9e50-48597bae235e None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:31.229337 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8e3a27-70dc-404e-a153-0497b96d1eaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:31.230105 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8e3a27-70dc-404e-a153-0497b96d1eaf None admin] REQUEST_METHOD: `PUT` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:31.230364 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8e3a27-70dc-404e-a153-0497b96d1eaf None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:31.230623 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8e3a27-70dc-404e-a153-0497b96d1eaf None admin] PATH_INFO: `/v3/projects/0eec3a73673e45dc881de586b9b0fbbb/users/5cacaed93420436e8f423f96a8041401/roles/3ff248f562e2493b8a0c8f21fe0a08a8` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:31.234462 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8e3a27-70dc-404e-a153-0497b96d1eaf None admin] RBAC: Authorizing `identity:create_grant(project_id=0eec3a73673e45dc881de586b9b0fbbb, user_id=5cacaed93420436e8f423f96a8041401, role_id=3ff248f562e2493b8a0c8f21fe0a08a8)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:31.235960 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8e3a27-70dc-404e-a153-0497b96d1eaf None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:31.259231 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 464/948] 10.222.0.79 () {58 vars in 1439 bytes} [Tue Aug 30 01:00:31 2022] PUT /identity/v3/projects/0eec3a73673e45dc881de586b9b0fbbb/users/5cacaed93420436e8f423f96a8041401/roles/3ff248f562e2493b8a0c8f21fe0a08a8 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:00:31.307109 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b64ca10-229c-407d-a2f1-e20276ff8996 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:31.352803 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdcd49e-92f2-4c5d-8955-9a801f62748d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:31.353759 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdcd49e-92f2-4c5d-8955-9a801f62748d None admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:31.354188 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdcd49e-92f2-4c5d-8955-9a801f62748d None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:31.354625 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdcd49e-92f2-4c5d-8955-9a801f62748d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:31.355509 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdcd49e-92f2-4c5d-8955-9a801f62748d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:31.357907 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdcd49e-92f2-4c5d-8955-9a801f62748d None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:31.386427 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 485/949] 10.222.0.79 () {60 vars in 1144 bytes} [Tue Aug 30 01:00:31 2022] POST /identity/v3/endpoints => generated 347 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:00:32.329119 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b76e99-1d8d-4f5c-a6dc-ac34a09956d4 None None] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:32.329664 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b76e99-1d8d-4f5c-a6dc-ac34a09956d4 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:32.329664 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b76e99-1d8d-4f5c-a6dc-ac34a09956d4 None None] PATH_INFO: `/` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:32.331358 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 465/950] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 01:00:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:00:32.336769 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d415acab-33fd-494b-b132-0b500bce7a77 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:32.337196 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d415acab-33fd-494b-b132-0b500bce7a77 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:32.337296 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d415acab-33fd-494b-b132-0b500bce7a77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:32.356854 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-d415acab-33fd-494b-b132-0b500bce7a77 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:00:32.358343 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-d415acab-33fd-494b-b132-0b500bce7a77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:00:32.368361 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:32.437210 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 486/951] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 01:00:32 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 01:00:32.719726 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b76e99-1d8d-4f5c-a6dc-ac34a09956d4 None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:32.838200 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b76e99-1d8d-4f5c-a6dc-ac34a09956d4 None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:32.870755 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:32.880817 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51269c69-ca07-4589-8b3a-e777d9196140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:32.882019 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51269c69-ca07-4589-8b3a-e777d9196140 None admin] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:32.882519 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51269c69-ca07-4589-8b3a-e777d9196140 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:32.883812 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51269c69-ca07-4589-8b3a-e777d9196140 None admin] PATH_INFO: `/v3/users` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:32.884938 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51269c69-ca07-4589-8b3a-e777d9196140 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:32.886477 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51269c69-ca07-4589-8b3a-e777d9196140 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:32.890048 dv-cinder-819667-6-smb devstack@keystone.service[81998]: WARNING keystone.server.flask.common [None req-51269c69-ca07-4589-8b3a-e777d9196140 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 30 01:00:32.905184 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.sql.core [None req-51269c69-ca07-4589-8b3a-e777d9196140 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 30 01:00:32.905184 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 30 01:00:32.905184 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [parameters: {'user_id': '66a07a7ceeb9457ca21f2f19f65954ea', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 30 01:00:32.905184 dv-cinder-819667-6-smb devstack@keystone.service[81998]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81998) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 30 01:00:32.913132 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application [None req-51269c69-ca07-4589-8b3a-e777d9196140 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 30 01:00:32.913132 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:00:32.913132 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 30 01:00:32.913132 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 30 01:00:32.913132 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 30 01:00:32.913132 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 30 01:00:32.913132 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 30 01:00:32.913132 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application result = self._query(query) Aug 30 01:00:32.913132 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 30 01:00:32.913132 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application conn.query(q) Aug 30 01:00:32.913132 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 30 01:00:32.913132 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 30 01:00:32.913132 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 30 01:00:32.913132 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application result.read() Aug 30 01:00:32.913132 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 30 01:00:32.914247 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 30 01:00:32.914247 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 30 01:00:32.914247 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 30 01:00:32.914247 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 30 01:00:32.914247 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 30 01:00:32.914247 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 30 01:00:32.914247 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 30 01:00:32.914247 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 30 01:00:32.914247 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Aug 30 01:00:32.914247 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 30 01:00:32.914247 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Aug 30 01:00:32.914247 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:00:32.914247 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 30 01:00:32.914247 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 30 01:00:32.914247 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 30 01:00:32.914247 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 30 01:00:32.914247 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 30 01:00:32.914247 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application next(self.gen) Aug 30 01:00:32.915291 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 30 01:00:32.915291 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application yield resource Aug 30 01:00:32.915291 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 30 01:00:32.915291 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application next(self.gen) Aug 30 01:00:32.915291 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 30 01:00:32.915291 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application self.session.rollback() Aug 30 01:00:32.915291 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 01:00:32.915291 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application self.force_reraise() Aug 30 01:00:32.915291 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 01:00:32.915291 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application raise self.value Aug 30 01:00:32.915291 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 30 01:00:32.915291 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 30 01:00:32.915291 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 30 01:00:32.915291 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application session.commit() Aug 30 01:00:32.915291 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 30 01:00:32.915291 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 30 01:00:32.915291 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 30 01:00:32.916188 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application self._prepare_impl() Aug 30 01:00:32.916188 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 30 01:00:32.916188 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application self.session.flush() Aug 30 01:00:32.916188 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 30 01:00:32.916188 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application self._flush(objects) Aug 30 01:00:32.916188 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 30 01:00:32.916188 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 30 01:00:32.916188 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 30 01:00:32.916188 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application compat.raise_( Aug 30 01:00:32.916188 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 30 01:00:32.916188 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application raise exception Aug 30 01:00:32.916188 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 30 01:00:32.916188 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application flush_context.execute() Aug 30 01:00:32.916188 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 30 01:00:32.916188 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application rec.execute(self) Aug 30 01:00:32.916188 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 30 01:00:32.916188 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 30 01:00:32.917076 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 30 01:00:32.917076 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 30 01:00:32.917076 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 30 01:00:32.917076 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 30 01:00:32.917076 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 30 01:00:32.917076 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 30 01:00:32.917076 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 30 01:00:32.917076 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 30 01:00:32.917076 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 30 01:00:32.917076 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 30 01:00:32.917076 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 30 01:00:32.917076 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 30 01:00:32.917076 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 30 01:00:32.917076 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 30 01:00:32.917076 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 30 01:00:32.917076 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application raise exception Aug 30 01:00:32.918125 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 30 01:00:32.918125 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 30 01:00:32.918125 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 30 01:00:32.918125 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 30 01:00:32.918125 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 30 01:00:32.918125 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application result = self._query(query) Aug 30 01:00:32.918125 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 30 01:00:32.918125 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application conn.query(q) Aug 30 01:00:32.918125 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 30 01:00:32.918125 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 30 01:00:32.918125 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 30 01:00:32.918125 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application result.read() Aug 30 01:00:32.918125 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 30 01:00:32.918125 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 30 01:00:32.918125 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 30 01:00:32.918125 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 30 01:00:32.921294 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 30 01:00:32.921294 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 30 01:00:32.921294 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 30 01:00:32.921294 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 30 01:00:32.921294 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 30 01:00:32.921294 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 30 01:00:32.921294 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application [parameters: {'user_id': '66a07a7ceeb9457ca21f2f19f65954ea', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 30 01:00:32.921294 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 30 01:00:32.921294 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Aug 30 01:00:32.921294 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 01:00:32.921294 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Aug 30 01:00:32.921294 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:00:32.921294 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:00:32.921294 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:00:32.921294 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:00:32.923249 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:00:32.923249 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:00:32.923249 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:00:32.923249 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:00:32.923249 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:00:32.923249 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:00:32.923249 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:00:32.923249 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 30 01:00:32.923249 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 30 01:00:32.923249 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:00:32.923249 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:00:32.923249 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 01:00:32.923249 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 01:00:32.923249 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 01:00:32.923249 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 01:00:32.923249 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 30 01:00:32.923249 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 30 01:00:32.925474 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 30 01:00:32.925474 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 30 01:00:32.925474 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 30 01:00:32.925474 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 30 01:00:32.925474 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 30 01:00:32.925474 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Aug 30 01:00:32.925474 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 466/952] 10.222.0.79 () {60 vars in 1131 bytes} [Tue Aug 30 01:00:32 2022] POST /identity/v3/users => generated 160 bytes in 196 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:00:32.931535 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d415acab-33fd-494b-b132-0b500bce7a77 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:33.046072 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d415acab-33fd-494b-b132-0b500bce7a77 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:33.085991 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9b1b69-7694-4422-85de-ef2931706d99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:33.086972 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9b1b69-7694-4422-85de-ef2931706d99 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:33.087467 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9b1b69-7694-4422-85de-ef2931706d99 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:33.087917 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9b1b69-7694-4422-85de-ef2931706d99 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:33.094308 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7991531-837a-4817-af53-a53ec171e057 None None] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:33.095025 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7991531-837a-4817-af53-a53ec171e057 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:33.095527 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7991531-837a-4817-af53-a53ec171e057 None None] PATH_INFO: `/` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:33.097589 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9b1b69-7694-4422-85de-ef2931706d99 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:33.099045 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9b1b69-7694-4422-85de-ef2931706d99 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:33.102407 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:33.103634 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 467/953] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 01:00:33 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 01:00:33.107253 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7809962f-222b-449e-a20d-a3cabfdad2c4 None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:33.107543 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7809962f-222b-449e-a20d-a3cabfdad2c4 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:33.107816 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7809962f-222b-449e-a20d-a3cabfdad2c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:33.118924 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-dc9b1b69-7694-4422-85de-ef2931706d99 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 30 01:00:33.118924 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:00:33.118924 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:00:33.118924 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:00:33.118924 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:00:33.118924 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:00:33.118924 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:00:33.118924 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:00:33.118924 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:00:33.118924 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:00:33.118924 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:00:33.118924 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:00:33.118924 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 01:00:33.118924 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 01:00:33.118924 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 01:00:33.118924 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 01:00:33.120003 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:00:33.120003 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:00:33.120003 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 01:00:33.120003 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 01:00:33.120003 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 01:00:33.120003 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 01:00:33.120003 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:00:33.120003 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:00:33.120003 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:00:33.120003 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:00:33.120003 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:00:33.120003 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Aug 30 01:00:33.120003 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:00:33.120003 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:00:33.120003 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:00:33.120003 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:00:33.120003 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:00:33.120003 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:00:33.121001 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:00:33.121001 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:00:33.121001 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 01:00:33.121001 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 01:00:33.121001 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 01:00:33.121001 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 01:00:33.121001 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 01:00:33.121001 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 01:00:33.121001 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 30 01:00:33.121001 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Aug 30 01:00:33.124843 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 487/954] 10.222.0.79 () {56 vars in 1099 bytes} [Tue Aug 30 01:00:32 2022] GET /identity/v3/users/cinder => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:00:33.134353 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9b1b69-7694-4422-85de-ef2931706d99 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:33.141216 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-7809962f-222b-449e-a20d-a3cabfdad2c4 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:00:33.142837 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-7809962f-222b-449e-a20d-a3cabfdad2c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:00:33.247340 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 468/955] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 01:00:33 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 01:00:33.284398 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9b1b69-7694-4422-85de-ef2931706d99 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:33.322651 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f664bf-7c78-4c98-9c91-a1a4f28929cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:33.323870 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f664bf-7c78-4c98-9c91-a1a4f28929cb None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:33.324156 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f664bf-7c78-4c98-9c91-a1a4f28929cb None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:33.325006 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f664bf-7c78-4c98-9c91-a1a4f28929cb None admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:33.325726 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f664bf-7c78-4c98-9c91-a1a4f28929cb None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:00:33.326089 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f664bf-7c78-4c98-9c91-a1a4f28929cb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:33.326362 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bd0931-d2b0-4a51-87a8-b38581112fcc None None] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:33.326853 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bd0931-d2b0-4a51-87a8-b38581112fcc None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:33.327356 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bd0931-d2b0-4a51-87a8-b38581112fcc None None] PATH_INFO: `/` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:33.327461 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f664bf-7c78-4c98-9c91-a1a4f28929cb None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:33.329436 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 469/956] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 01:00:33 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:00:33.334800 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e7e5b4-4cb8-45c6-9d36-76985cf1f79a None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:33.335078 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e7e5b4-4cb8-45c6-9d36-76985cf1f79a None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:33.335389 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e7e5b4-4cb8-45c6-9d36-76985cf1f79a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:33.355794 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-84e7e5b4-4cb8-45c6-9d36-76985cf1f79a None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:00:33.357004 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-84e7e5b4-4cb8-45c6-9d36-76985cf1f79a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:00:33.374279 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 488/957] 10.222.0.79 () {56 vars in 1101 bytes} [Tue Aug 30 01:00:33 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:00:33.453965 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 470/958] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 01:00:33 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 01:00:33.490080 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d53c2d-14c4-49ff-8fc0-2e7263ace7ee None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:33.490363 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d53c2d-14c4-49ff-8fc0-2e7263ace7ee None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:33.490646 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d53c2d-14c4-49ff-8fc0-2e7263ace7ee None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:33.492427 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 489/959] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 01:00:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:00:33.499072 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d47035a-a11f-4e5e-87eb-03631e449fae None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:33.499396 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d47035a-a11f-4e5e-87eb-03631e449fae None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:33.499675 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d47035a-a11f-4e5e-87eb-03631e449fae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:33.520607 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-1d47035a-a11f-4e5e-87eb-03631e449fae None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:00:33.521868 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-1d47035a-a11f-4e5e-87eb-03631e449fae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:00:33.532006 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d53c2d-14c4-49ff-8fc0-2e7263ace7ee None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:33.582406 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:33.618917 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 471/960] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 01:00:33 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 01:00:33.627222 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:33.679854 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d53c2d-14c4-49ff-8fc0-2e7263ace7ee None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:33.719687 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015804da-3d51-4ce4-b1f3-294b3e34cff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:33.720322 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015804da-3d51-4ce4-b1f3-294b3e34cff6 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:33.720599 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015804da-3d51-4ce4-b1f3-294b3e34cff6 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:33.720870 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015804da-3d51-4ce4-b1f3-294b3e34cff6 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:33.721457 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015804da-3d51-4ce4-b1f3-294b3e34cff6 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:33.722877 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015804da-3d51-4ce4-b1f3-294b3e34cff6 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:33.731208 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d47035a-a11f-4e5e-87eb-03631e449fae None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:33.733041 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-015804da-3d51-4ce4-b1f3-294b3e34cff6 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 01:00:33.733041 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:00:33.733041 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 01:00:33.733041 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 01:00:33.733041 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 01:00:33.733041 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 01:00:33.733041 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 01:00:33.733041 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 01:00:33.733041 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 01:00:33.733041 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Aug 30 01:00:33.733041 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 01:00:33.733041 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Aug 30 01:00:33.733041 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:00:33.733041 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:00:33.733041 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:00:33.733041 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:00:33.733041 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:00:33.734056 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:00:33.734056 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:00:33.734056 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:00:33.734056 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:00:33.734056 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:00:33.734056 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:00:33.734056 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 01:00:33.734056 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 01:00:33.734056 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 01:00:33.734056 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 01:00:33.734056 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:00:33.734056 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:00:33.734056 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:00:33.734056 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:00:33.734056 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:00:33.734056 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:00:33.735571 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:00:33.735571 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Aug 30 01:00:33.735571 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:00:33.735571 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:00:33.735571 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:00:33.735571 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:00:33.735571 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:00:33.735571 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:00:33.735571 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:00:33.735571 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:00:33.735571 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 01:00:33.735571 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 01:00:33.735571 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 01:00:33.735571 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Aug 30 01:00:33.739202 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 490/961] 10.222.0.79 () {56 vars in 1126 bytes} [Tue Aug 30 01:00:33 2022] GET /identity/v3/services/object-store => generated 93 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:00:33.740881 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015804da-3d51-4ce4-b1f3-294b3e34cff6 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:33.854109 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015804da-3d51-4ce4-b1f3-294b3e34cff6 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:33.855257 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d47035a-a11f-4e5e-87eb-03631e449fae None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:33.879235 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:33.892555 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90904942-b94a-4f8b-ab6a-9f172b726c8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:33.893195 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90904942-b94a-4f8b-ab6a-9f172b726c8d None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:33.893425 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fbff87-a181-4a22-b638-9d8429ce459d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:33.893544 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90904942-b94a-4f8b-ab6a-9f172b726c8d None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:33.893853 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90904942-b94a-4f8b-ab6a-9f172b726c8d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:33.894040 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fbff87-a181-4a22-b638-9d8429ce459d None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:33.894305 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fbff87-a181-4a22-b638-9d8429ce459d None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:33.894567 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fbff87-a181-4a22-b638-9d8429ce459d None admin] PATH_INFO: `/v3/services` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:33.895220 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fbff87-a181-4a22-b638-9d8429ce459d None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:00:33.895518 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fbff87-a181-4a22-b638-9d8429ce459d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:33.896865 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fbff87-a181-4a22-b638-9d8429ce459d None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:33.901467 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 491/962] 10.222.0.79 () {56 vars in 1122 bytes} [Tue Aug 30 01:00:33 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:00:33.902316 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fbff87-a181-4a22-b638-9d8429ce459d None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:33.904655 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90904942-b94a-4f8b-ab6a-9f172b726c8d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 01:00:33.909633 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application [None req-90904942-b94a-4f8b-ab6a-9f172b726c8d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 01:00:33.909633 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:00:33.909633 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:00:33.909633 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:00:33.909633 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:00:33.909633 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:00:33.909633 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:00:33.909633 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:00:33.909633 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:00:33.909633 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:00:33.909633 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:00:33.909633 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:00:33.909633 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 01:00:33.909633 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 01:00:33.909633 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 01:00:33.909633 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 01:00:33.910604 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 01:00:33.910604 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 01:00:33.910604 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 01:00:33.910604 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 01:00:33.910604 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:00:33.910604 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:00:33.910604 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:00:33.910604 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:00:33.910604 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:00:33.910604 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:00:33.910604 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:00:33.910604 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application with Lock( Aug 30 01:00:33.910604 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:00:33.910604 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:00:33.910604 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:00:33.910604 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:00:33.911450 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:00:33.911450 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:00:33.911450 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:00:33.911450 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:00:33.911450 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 01:00:33.911450 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 01:00:33.911450 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 01:00:33.911450 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 01:00:33.911450 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 01:00:33.911450 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 01:00:33.911450 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 01:00:33.911450 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Aug 30 01:00:33.911450 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 472/963] 10.222.0.79 () {56 vars in 1120 bytes} [Tue Aug 30 01:00:33 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 01:00:33.913359 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90904942-b94a-4f8b-ab6a-9f172b726c8d None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:33.956630 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:34.007072 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fbff87-a181-4a22-b638-9d8429ce459d None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:34.014259 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90904942-b94a-4f8b-ab6a-9f172b726c8d None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:34.040907 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10a2931-4991-4066-9406-7b0fac738d6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:34.041537 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10a2931-4991-4066-9406-7b0fac738d6c None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:34.041808 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10a2931-4991-4066-9406-7b0fac738d6c None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:34.042072 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10a2931-4991-4066-9406-7b0fac738d6c None admin] PATH_INFO: `/v3/services/compute` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:34.042645 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10a2931-4991-4066-9406-7b0fac738d6c None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:34.044552 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10a2931-4991-4066-9406-7b0fac738d6c None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:34.048663 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9867dd15-7072-4e8d-88d5-d7253ed9fb0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:34.049275 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9867dd15-7072-4e8d-88d5-d7253ed9fb0c None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:34.049552 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9867dd15-7072-4e8d-88d5-d7253ed9fb0c None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:34.049827 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9867dd15-7072-4e8d-88d5-d7253ed9fb0c None admin] PATH_INFO: `/v3/services` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:34.050446 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9867dd15-7072-4e8d-88d5-d7253ed9fb0c None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:00:34.050745 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9867dd15-7072-4e8d-88d5-d7253ed9fb0c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:34.052253 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9867dd15-7072-4e8d-88d5-d7253ed9fb0c None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:34.053106 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-b10a2931-4991-4066-9406-7b0fac738d6c None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 30 01:00:34.053106 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:00:34.053106 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 01:00:34.053106 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 01:00:34.053106 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 01:00:34.053106 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 01:00:34.053106 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 01:00:34.053106 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 01:00:34.053106 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 30 01:00:34.053106 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Aug 30 01:00:34.053106 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 01:00:34.053106 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Aug 30 01:00:34.053106 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:00:34.053106 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:00:34.053106 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:00:34.053106 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:00:34.053106 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:00:34.054158 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:00:34.054158 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:00:34.054158 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:00:34.054158 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:00:34.054158 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:00:34.054158 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:00:34.054158 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 01:00:34.054158 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 01:00:34.054158 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 01:00:34.054158 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 01:00:34.054158 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:00:34.054158 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:00:34.054158 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:00:34.054158 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:00:34.054158 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:00:34.054158 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:00:34.054980 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:00:34.054980 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Aug 30 01:00:34.054980 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:00:34.054980 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:00:34.054980 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:00:34.054980 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:00:34.054980 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:00:34.054980 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:00:34.054980 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:00:34.054980 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:00:34.054980 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 01:00:34.054980 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 01:00:34.054980 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 30 01:00:34.054980 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Aug 30 01:00:34.054980 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 492/964] 10.222.0.79 () {56 vars in 1111 bytes} [Tue Aug 30 01:00:33 2022] GET /identity/v3/services/compute => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:00:34.055816 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10a2931-4991-4066-9406-7b0fac738d6c None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:34.060729 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 473/965] 10.222.0.79 () {56 vars in 1122 bytes} [Tue Aug 30 01:00:33 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:00:34.061570 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9867dd15-7072-4e8d-88d5-d7253ed9fb0c None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:34.109546 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:34.160948 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10a2931-4991-4066-9406-7b0fac738d6c None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:34.161164 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9867dd15-7072-4e8d-88d5-d7253ed9fb0c None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:34.164772 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:34.196916 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1debd69-4835-4984-9fdc-4698f542e82b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:34.197512 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1debd69-4835-4984-9fdc-4698f542e82b None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:34.197785 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1debd69-4835-4984-9fdc-4698f542e82b None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:34.197895 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b18cd38-ff51-48c0-aef6-5c21d208939e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:34.198051 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1debd69-4835-4984-9fdc-4698f542e82b None admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:34.198416 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b18cd38-ff51-48c0-aef6-5c21d208939e None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:34.198695 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b18cd38-ff51-48c0-aef6-5c21d208939e None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:34.198803 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1debd69-4835-4984-9fdc-4698f542e82b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:00:34.198965 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b18cd38-ff51-48c0-aef6-5c21d208939e None admin] PATH_INFO: `/v3/services` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:34.199057 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1debd69-4835-4984-9fdc-4698f542e82b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:34.200239 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b18cd38-ff51-48c0-aef6-5c21d208939e None admin] RBAC: Adding query filter params (name=compute) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:00:34.200361 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1debd69-4835-4984-9fdc-4698f542e82b None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:34.200552 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b18cd38-ff51-48c0-aef6-5c21d208939e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:34.202080 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b18cd38-ff51-48c0-aef6-5c21d208939e None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:34.207692 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 474/966] 10.222.0.79 () {56 vars in 1112 bytes} [Tue Aug 30 01:00:34 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:00:34.212828 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 493/967] 10.222.0.79 () {56 vars in 1115 bytes} [Tue Aug 30 01:00:34 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:00:34.212985 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b18cd38-ff51-48c0-aef6-5c21d208939e None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:34.213944 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1debd69-4835-4984-9fdc-4698f542e82b None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:34.308556 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b18cd38-ff51-48c0-aef6-5c21d208939e None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:34.323718 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1debd69-4835-4984-9fdc-4698f542e82b None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:34.338406 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:34.342679 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01dfd9a-2734-4414-9b33-ccd78e89a543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:34.343323 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01dfd9a-2734-4414-9b33-ccd78e89a543 None admin] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:34.343607 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01dfd9a-2734-4414-9b33-ccd78e89a543 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:34.343882 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01dfd9a-2734-4414-9b33-ccd78e89a543 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:34.344542 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01dfd9a-2734-4414-9b33-ccd78e89a543 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:34.345903 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01dfd9a-2734-4414-9b33-ccd78e89a543 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:34.362577 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6416c40c-25d0-473d-8a9d-9e6e803c2a91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:34.363117 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6416c40c-25d0-473d-8a9d-9e6e803c2a91 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:34.363426 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6416c40c-25d0-473d-8a9d-9e6e803c2a91 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:34.363700 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6416c40c-25d0-473d-8a9d-9e6e803c2a91 None admin] PATH_INFO: `/v3/services` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:34.364374 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6416c40c-25d0-473d-8a9d-9e6e803c2a91 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:00:34.364634 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6416c40c-25d0-473d-8a9d-9e6e803c2a91 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:34.366017 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6416c40c-25d0-473d-8a9d-9e6e803c2a91 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:34.366470 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 475/968] 10.222.0.79 () {60 vars in 1144 bytes} [Tue Aug 30 01:00:34 2022] POST /identity/v3/endpoints => generated 349 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:00:34.367504 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01dfd9a-2734-4414-9b33-ccd78e89a543 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:34.370931 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 494/969] 10.222.0.79 () {56 vars in 1112 bytes} [Tue Aug 30 01:00:34 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:00:34.406263 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:34.509641 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01dfd9a-2734-4414-9b33-ccd78e89a543 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:34.554238 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f27cb9-ee82-4a54-8d03-249e582f879b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:34.554880 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f27cb9-ee82-4a54-8d03-249e582f879b None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:34.555170 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f27cb9-ee82-4a54-8d03-249e582f879b None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:34.555442 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f27cb9-ee82-4a54-8d03-249e582f879b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:34.567890 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f27cb9-ee82-4a54-8d03-249e582f879b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:34.569329 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f27cb9-ee82-4a54-8d03-249e582f879b None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:34.584886 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application [None req-f3f27cb9-ee82-4a54-8d03-249e582f879b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:00:34.584886 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:00:34.584886 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:00:34.584886 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:00:34.584886 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:00:34.584886 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:00:34.584886 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:00:34.584886 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:00:34.584886 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:00:34.584886 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:00:34.584886 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:00:34.584886 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:00:34.584886 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 01:00:34.584886 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 01:00:34.584886 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 01:00:34.584886 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 01:00:34.586059 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:00:34.586059 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:00:34.586059 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:00:34.586059 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:00:34.586059 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:00:34.586059 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:00:34.586059 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:00:34.586059 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application with Lock( Aug 30 01:00:34.586059 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:00:34.586059 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:00:34.586059 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:00:34.586059 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:00:34.586059 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:00:34.586059 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:00:34.586059 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:00:34.586059 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:00:34.586059 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 01:00:34.587162 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 01:00:34.587162 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:00:34.587162 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Aug 30 01:00:34.588649 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 476/970] 10.222.0.79 () {56 vars in 1108 bytes} [Tue Aug 30 01:00:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:00:34.595555 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6416c40c-25d0-473d-8a9d-9e6e803c2a91 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:34.702873 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6416c40c-25d0-473d-8a9d-9e6e803c2a91 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:34.737486 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1821f7d-395d-42c6-9138-df144fba27b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:34.738091 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1821f7d-395d-42c6-9138-df144fba27b5 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:34.738362 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1821f7d-395d-42c6-9138-df144fba27b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:34.738626 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1821f7d-395d-42c6-9138-df144fba27b5 None admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:34.739291 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1821f7d-395d-42c6-9138-df144fba27b5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:00:34.739586 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1821f7d-395d-42c6-9138-df144fba27b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:34.740928 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1821f7d-395d-42c6-9138-df144fba27b5 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:34.757769 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 495/971] 10.222.0.79 () {56 vars in 1109 bytes} [Tue Aug 30 01:00:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:00:34.759283 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f27cb9-ee82-4a54-8d03-249e582f879b None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:34.834122 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:34.868299 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f27cb9-ee82-4a54-8d03-249e582f879b None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:34.908073 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaac1030-26ed-4f7b-b1f3-a704eaaff650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:34.908729 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaac1030-26ed-4f7b-b1f3-a704eaaff650 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:34.909004 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaac1030-26ed-4f7b-b1f3-a704eaaff650 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:34.909270 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaac1030-26ed-4f7b-b1f3-a704eaaff650 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:34.918075 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaac1030-26ed-4f7b-b1f3-a704eaaff650 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:34.919556 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaac1030-26ed-4f7b-b1f3-a704eaaff650 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:34.931118 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application [None req-aaac1030-26ed-4f7b-b1f3-a704eaaff650 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 01:00:34.931118 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:00:34.931118 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:00:34.931118 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:00:34.931118 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:00:34.931118 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:00:34.931118 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:00:34.931118 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:00:34.931118 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:00:34.931118 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:00:34.931118 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:00:34.931118 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:00:34.931118 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 01:00:34.931118 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 01:00:34.931118 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 01:00:34.931118 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 01:00:34.932156 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:00:34.932156 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:00:34.932156 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 01:00:34.932156 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 01:00:34.932156 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 01:00:34.932156 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 01:00:34.932156 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:00:34.932156 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:00:34.932156 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:00:34.932156 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:00:34.932156 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:00:34.932156 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application with Lock( Aug 30 01:00:34.932156 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:00:34.932156 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:00:34.932156 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:00:34.932156 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:00:34.932156 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:00:34.932156 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:00:34.940925 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:00:34.940925 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:00:34.940925 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 01:00:34.940925 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 01:00:34.940925 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 01:00:34.940925 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 01:00:34.940925 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 01:00:34.940925 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 01:00:34.940925 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 01:00:34.940925 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Aug 30 01:00:34.940925 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 477/972] 10.222.0.79 () {56 vars in 1117 bytes} [Tue Aug 30 01:00:34 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 01:00:34.941565 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1821f7d-395d-42c6-9138-df144fba27b5 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:34.977880 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:35.049073 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1821f7d-395d-42c6-9138-df144fba27b5 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:35.085171 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91883d58-a055-4805-ab0d-a5bf09d1e177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:35.085771 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91883d58-a055-4805-ab0d-a5bf09d1e177 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:35.086043 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91883d58-a055-4805-ab0d-a5bf09d1e177 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:35.086312 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91883d58-a055-4805-ab0d-a5bf09d1e177 None admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:35.087031 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91883d58-a055-4805-ab0d-a5bf09d1e177 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:00:35.087370 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91883d58-a055-4805-ab0d-a5bf09d1e177 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:35.088772 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91883d58-a055-4805-ab0d-a5bf09d1e177 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:35.110539 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 496/973] 10.222.0.79 () {56 vars in 1149 bytes} [Tue Aug 30 01:00:34 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:00:35.112192 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaac1030-26ed-4f7b-b1f3-a704eaaff650 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:35.215620 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaac1030-26ed-4f7b-b1f3-a704eaaff650 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:35.262923 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:35.269274 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20df6c93-ea8d-486c-aff3-d566973f9e2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:35.269881 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20df6c93-ea8d-486c-aff3-d566973f9e2d None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:35.270156 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20df6c93-ea8d-486c-aff3-d566973f9e2d None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:35.270421 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20df6c93-ea8d-486c-aff3-d566973f9e2d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:35.340706 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20df6c93-ea8d-486c-aff3-d566973f9e2d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:35.342196 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20df6c93-ea8d-486c-aff3-d566973f9e2d None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:35.447224 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 478/974] 10.222.0.79 () {58 vars in 1282 bytes} [Tue Aug 30 01:00:35 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 01:00:35.452738 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91883d58-a055-4805-ab0d-a5bf09d1e177 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:35.558437 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:35.567429 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91883d58-a055-4805-ab0d-a5bf09d1e177 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:35.604173 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848b4827-1bc4-40c0-85b0-62e1d71db750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:35.604975 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848b4827-1bc4-40c0-85b0-62e1d71db750 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:35.605251 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848b4827-1bc4-40c0-85b0-62e1d71db750 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:35.605563 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848b4827-1bc4-40c0-85b0-62e1d71db750 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:35.617718 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848b4827-1bc4-40c0-85b0-62e1d71db750 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:35.619184 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848b4827-1bc4-40c0-85b0-62e1d71db750 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:35.636244 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-848b4827-1bc4-40c0-85b0-62e1d71db750 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:00:35.636244 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:00:35.636244 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:00:35.636244 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:00:35.636244 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:00:35.636244 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:00:35.636244 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:00:35.636244 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:00:35.636244 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:00:35.636244 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:00:35.636244 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:00:35.636244 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:00:35.636244 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 01:00:35.636244 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 01:00:35.636244 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 01:00:35.636244 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 01:00:35.637504 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:00:35.637504 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:00:35.637504 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:00:35.637504 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:00:35.637504 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:00:35.637504 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:00:35.637504 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:00:35.637504 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Aug 30 01:00:35.637504 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:00:35.637504 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:00:35.637504 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:00:35.637504 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:00:35.637504 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:00:35.637504 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:00:35.637504 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:00:35.637504 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:00:35.637504 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 01:00:35.638561 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 01:00:35.638561 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:00:35.638561 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Aug 30 01:00:35.638561 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 497/975] 10.222.0.79 () {56 vars in 1108 bytes} [Tue Aug 30 01:00:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:00:35.645109 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20df6c93-ea8d-486c-aff3-d566973f9e2d None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:35.677984 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:35.751604 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20df6c93-ea8d-486c-aff3-d566973f9e2d None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:35.787395 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7029730b-5222-4f30-9105-4dd6a909a002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:35.788005 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7029730b-5222-4f30-9105-4dd6a909a002 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:35.788282 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7029730b-5222-4f30-9105-4dd6a909a002 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:35.788552 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7029730b-5222-4f30-9105-4dd6a909a002 None admin] PATH_INFO: `/v3/domains` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:35.789188 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7029730b-5222-4f30-9105-4dd6a909a002 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:00:35.789486 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7029730b-5222-4f30-9105-4dd6a909a002 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:35.790837 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7029730b-5222-4f30-9105-4dd6a909a002 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:35.807734 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 479/976] 10.222.0.79 () {56 vars in 1109 bytes} [Tue Aug 30 01:00:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:00:35.809387 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848b4827-1bc4-40c0-85b0-62e1d71db750 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:35.916974 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848b4827-1bc4-40c0-85b0-62e1d71db750 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:35.954210 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c57a7b-1856-4266-8e52-592571eb6216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:35.954844 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c57a7b-1856-4266-8e52-592571eb6216 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:35.955166 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c57a7b-1856-4266-8e52-592571eb6216 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:35.955614 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c57a7b-1856-4266-8e52-592571eb6216 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:35.963038 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c57a7b-1856-4266-8e52-592571eb6216 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:35.964558 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c57a7b-1856-4266-8e52-592571eb6216 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:35.977307 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-f2c57a7b-1856-4266-8e52-592571eb6216 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 01:00:35.977307 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:00:35.977307 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:00:35.977307 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:00:35.977307 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:00:35.977307 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:00:35.977307 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:00:35.977307 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:00:35.977307 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:00:35.977307 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:00:35.977307 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:00:35.977307 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:00:35.977307 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 01:00:35.977307 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 01:00:35.977307 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 01:00:35.978272 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 01:00:35.978272 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:00:35.978272 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:00:35.978272 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:00:35.978272 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:00:35.978272 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:00:35.978272 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:00:35.978272 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:00:35.978272 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Aug 30 01:00:35.978272 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:00:35.978272 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:00:35.978272 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:00:35.978272 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:00:35.978272 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:00:35.978272 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:00:35.978272 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:00:35.978272 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:00:35.984700 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 01:00:35.984700 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 01:00:35.984700 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 01:00:35.984700 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 01:00:35.984700 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 01:00:35.984700 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 01:00:35.984700 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 01:00:35.984700 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Aug 30 01:00:35.984700 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 498/977] 10.222.0.79 () {56 vars in 1111 bytes} [Tue Aug 30 01:00:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 01:00:35.985235 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7029730b-5222-4f30-9105-4dd6a909a002 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:36.082557 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:36.093313 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7029730b-5222-4f30-9105-4dd6a909a002 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:36.128591 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ea21af-fd31-4b18-8993-8ab830482189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:36.129197 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ea21af-fd31-4b18-8993-8ab830482189 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:36.129474 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ea21af-fd31-4b18-8993-8ab830482189 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:36.129743 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ea21af-fd31-4b18-8993-8ab830482189 None admin] PATH_INFO: `/v3/projects` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:36.130427 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ea21af-fd31-4b18-8993-8ab830482189 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:00:36.130725 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ea21af-fd31-4b18-8993-8ab830482189 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:36.132189 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ea21af-fd31-4b18-8993-8ab830482189 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:36.150166 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 480/978] 10.222.0.79 () {56 vars in 1148 bytes} [Tue Aug 30 01:00:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:00:36.151665 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c57a7b-1856-4266-8e52-592571eb6216 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:36.161168 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:36.260733 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c57a7b-1856-4266-8e52-592571eb6216 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:36.296680 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a805b0-7daf-4d40-9733-c8d204b79d6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:36.297287 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a805b0-7daf-4d40-9733-c8d204b79d6b None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:36.297559 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a805b0-7daf-4d40-9733-c8d204b79d6b None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:36.297824 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a805b0-7daf-4d40-9733-c8d204b79d6b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:36.298539 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a805b0-7daf-4d40-9733-c8d204b79d6b None admin] RBAC: Adding query filter params (role.id=3ff248f562e2493b8a0c8f21fe0a08a8, scope.project.id=0eec3a73673e45dc881de586b9b0fbbb, user.id=5cacaed93420436e8f423f96a8041401) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:00:36.298837 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a805b0-7daf-4d40-9733-c8d204b79d6b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:36.300268 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a805b0-7daf-4d40-9733-c8d204b79d6b None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:36.306570 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 499/979] 10.222.0.79 () {56 vars in 1374 bytes} [Tue Aug 30 01:00:36 2022] GET /identity/v3/role_assignments?user.id=5cacaed93420436e8f423f96a8041401&scope.project.id=0eec3a73673e45dc881de586b9b0fbbb&role.id=3ff248f562e2493b8a0c8f21fe0a08a8 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:00:36.336268 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04361087-ae1c-4553-ad35-af13259af9f0 None None] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:36.336463 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04361087-ae1c-4553-ad35-af13259af9f0 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:36.336728 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04361087-ae1c-4553-ad35-af13259af9f0 None None] PATH_INFO: `/` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:36.338292 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 481/980] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 01:00:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:00:36.344284 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d68281-6da0-4c59-b763-777a461af1e9 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:36.344580 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d68281-6da0-4c59-b763-777a461af1e9 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:36.344843 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d68281-6da0-4c59-b763-777a461af1e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:36.359751 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80673dd1-edc0-497f-aecf-fde1483bc184 None None] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:36.360033 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80673dd1-edc0-497f-aecf-fde1483bc184 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:36.360309 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80673dd1-edc0-497f-aecf-fde1483bc184 None None] PATH_INFO: `/` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:36.362028 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 482/981] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 01:00:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:00:36.367534 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-b3d68281-6da0-4c59-b763-777a461af1e9 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:00:36.367773 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e124527a-cbb0-4964-aeb2-909a0c23cee9 None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:36.368005 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e124527a-cbb0-4964-aeb2-909a0c23cee9 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:36.368172 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e124527a-cbb0-4964-aeb2-909a0c23cee9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:36.368764 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-b3d68281-6da0-4c59-b763-777a461af1e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:00:36.388376 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-e124527a-cbb0-4964-aeb2-909a0c23cee9 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:00:36.389638 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-e124527a-cbb0-4964-aeb2-909a0c23cee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:00:36.448884 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:36.458368 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 500/982] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 01:00:36 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 01:00:36.483459 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 483/983] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 01:00:36 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 01:00:36.728324 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d68281-6da0-4c59-b763-777a461af1e9 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:36.765224 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e124527a-cbb0-4964-aeb2-909a0c23cee9 None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:36.841990 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d68281-6da0-4c59-b763-777a461af1e9 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:36.856932 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:36.876921 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e124527a-cbb0-4964-aeb2-909a0c23cee9 None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:36.884894 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47807a11-3967-4f35-87d4-77f2e6cda0d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:36.885397 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47807a11-3967-4f35-87d4-77f2e6cda0d0 None admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:36.885683 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47807a11-3967-4f35-87d4-77f2e6cda0d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:36.885969 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47807a11-3967-4f35-87d4-77f2e6cda0d0 None admin] PATH_INFO: `/v3/services` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:36.886622 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47807a11-3967-4f35-87d4-77f2e6cda0d0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:36.888336 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47807a11-3967-4f35-87d4-77f2e6cda0d0 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:36.906361 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 501/984] 10.222.0.79 () {60 vars in 1141 bytes} [Tue Aug 30 01:00:36 2022] POST /identity/v3/services => generated 242 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:00:36.926347 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048473cc-02fa-41fc-bee0-e7b306b27504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:36.927163 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048473cc-02fa-41fc-bee0-e7b306b27504 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:36.927448 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048473cc-02fa-41fc-bee0-e7b306b27504 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:36.927720 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048473cc-02fa-41fc-bee0-e7b306b27504 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:36.928325 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048473cc-02fa-41fc-bee0-e7b306b27504 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:36.929775 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048473cc-02fa-41fc-bee0-e7b306b27504 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:36.940477 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application [None req-048473cc-02fa-41fc-bee0-e7b306b27504 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 01:00:36.940477 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:00:36.940477 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 01:00:36.940477 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 01:00:36.940477 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 01:00:36.940477 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 01:00:36.940477 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 01:00:36.940477 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 01:00:36.940477 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 01:00:36.940477 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Aug 30 01:00:36.940477 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 01:00:36.940477 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Aug 30 01:00:36.940477 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:00:36.940477 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:00:36.940477 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:00:36.940477 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:00:36.940477 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:00:36.941663 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:00:36.941663 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:00:36.941663 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:00:36.941663 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:00:36.941663 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:00:36.941663 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:00:36.941663 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 01:00:36.941663 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 01:00:36.941663 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 01:00:36.941663 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 01:00:36.941663 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:00:36.941663 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:00:36.941663 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:00:36.941663 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:00:36.941663 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:00:36.941663 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:00:36.942502 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:00:36.942502 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application with Lock( Aug 30 01:00:36.942502 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:00:36.942502 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:00:36.942502 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:00:36.942502 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:00:36.942502 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:00:36.942502 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:00:36.942502 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:00:36.942502 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:00:36.942502 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 01:00:36.942502 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 01:00:36.942502 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 01:00:36.942502 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Aug 30 01:00:36.942502 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 484/985] 10.222.0.79 () {56 vars in 1126 bytes} [Tue Aug 30 01:00:36 2022] GET /identity/v3/services/object-store => generated 93 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:00:36.948265 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47807a11-3967-4f35-87d4-77f2e6cda0d0 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:37.017462 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:37.069572 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47807a11-3967-4f35-87d4-77f2e6cda0d0 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:37.106761 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6c9bbb-3a0c-453b-9670-a0be0f1a6707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:37.107415 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6c9bbb-3a0c-453b-9670-a0be0f1a6707 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:37.107689 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6c9bbb-3a0c-453b-9670-a0be0f1a6707 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:37.107955 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6c9bbb-3a0c-453b-9670-a0be0f1a6707 None admin] PATH_INFO: `/v3/services` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:37.108581 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6c9bbb-3a0c-453b-9670-a0be0f1a6707 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:00:37.108876 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6c9bbb-3a0c-453b-9670-a0be0f1a6707 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:37.110218 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6c9bbb-3a0c-453b-9670-a0be0f1a6707 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:37.115555 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 502/986] 10.222.0.79 () {56 vars in 1122 bytes} [Tue Aug 30 01:00:36 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:00:37.121482 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048473cc-02fa-41fc-bee0-e7b306b27504 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:37.226978 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048473cc-02fa-41fc-bee0-e7b306b27504 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:37.271232 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944d1282-7a96-4471-aae7-cc2bfd44b9b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:37.271781 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944d1282-7a96-4471-aae7-cc2bfd44b9b3 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:37.272058 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944d1282-7a96-4471-aae7-cc2bfd44b9b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:37.272327 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944d1282-7a96-4471-aae7-cc2bfd44b9b3 None admin] PATH_INFO: `/v3/services` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:37.273026 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944d1282-7a96-4471-aae7-cc2bfd44b9b3 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:00:37.273327 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944d1282-7a96-4471-aae7-cc2bfd44b9b3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:37.274738 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944d1282-7a96-4471-aae7-cc2bfd44b9b3 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:37.280770 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 485/987] 10.222.0.79 () {56 vars in 1122 bytes} [Tue Aug 30 01:00:37 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:00:37.286513 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6c9bbb-3a0c-453b-9670-a0be0f1a6707 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:37.394732 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6c9bbb-3a0c-453b-9670-a0be0f1a6707 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:37.419539 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:37.431530 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30579b78-5913-4268-991c-c6c52c6c2119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:37.432144 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30579b78-5913-4268-991c-c6c52c6c2119 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:37.432423 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30579b78-5913-4268-991c-c6c52c6c2119 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:37.432696 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30579b78-5913-4268-991c-c6c52c6c2119 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:37.433414 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30579b78-5913-4268-991c-c6c52c6c2119 None admin] RBAC: Adding query filter params (interface=admin, service_id=bc6c24419cd14fdabdfefeb33ad7c9eb, region_id=RegionOne) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:00:37.433782 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30579b78-5913-4268-991c-c6c52c6c2119 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:37.435449 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30579b78-5913-4268-991c-c6c52c6c2119 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:37.441226 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 503/988] 10.222.0.79 () {56 vars in 1249 bytes} [Tue Aug 30 01:00:37 2022] GET /identity/v3/endpoints?service_id=bc6c24419cd14fdabdfefeb33ad7c9eb&interface=admin®ion_id=RegionOne => generated 193 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:00:37.447186 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944d1282-7a96-4471-aae7-cc2bfd44b9b3 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:37.458025 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:37.555799 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944d1282-7a96-4471-aae7-cc2bfd44b9b3 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:37.591501 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f244e41e-759b-48e5-93ee-f92507486317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:37.592114 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f244e41e-759b-48e5-93ee-f92507486317 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:37.592392 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f244e41e-759b-48e5-93ee-f92507486317 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:37.592662 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f244e41e-759b-48e5-93ee-f92507486317 None admin] PATH_INFO: `/v3/services` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:37.593271 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f244e41e-759b-48e5-93ee-f92507486317 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:37.594632 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f244e41e-759b-48e5-93ee-f92507486317 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:37.603308 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 486/989] 10.222.0.79 () {56 vars in 1087 bytes} [Tue Aug 30 01:00:37 2022] GET /identity/v3/services => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:00:38.316687 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5ac55e-1df8-41bd-b5b8-acde7fd65e96 None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:38.317230 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5ac55e-1df8-41bd-b5b8-acde7fd65e96 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:38.317230 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5ac55e-1df8-41bd-b5b8-acde7fd65e96 None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:38.318881 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 504/990] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 01:00:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:00:38.324908 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190a86f8-ed5d-4ca8-a047-b683d7714fc6 None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:38.325259 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190a86f8-ed5d-4ca8-a047-b683d7714fc6 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:38.325500 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190a86f8-ed5d-4ca8-a047-b683d7714fc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:38.345960 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-190a86f8-ed5d-4ca8-a047-b683d7714fc6 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:00:38.347192 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-190a86f8-ed5d-4ca8-a047-b683d7714fc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:00:38.417842 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:38.426350 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 487/991] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 01:00:38 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 01:00:38.814456 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5ac55e-1df8-41bd-b5b8-acde7fd65e96 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:38.964511 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5ac55e-1df8-41bd-b5b8-acde7fd65e96 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:39.004294 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1988ed-e8ce-4b3f-9be6-0e7fbbb5af76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:39.004956 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1988ed-e8ce-4b3f-9be6-0e7fbbb5af76 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:39.005236 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1988ed-e8ce-4b3f-9be6-0e7fbbb5af76 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:39.005507 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1988ed-e8ce-4b3f-9be6-0e7fbbb5af76 None admin] PATH_INFO: `/v3/services/image` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:39.006108 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1988ed-e8ce-4b3f-9be6-0e7fbbb5af76 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:39.007552 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1988ed-e8ce-4b3f-9be6-0e7fbbb5af76 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:39.017195 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccc152b-fa54-43de-8bc1-2cfc607a9513 None None] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:39.017755 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccc152b-fa54-43de-8bc1-2cfc607a9513 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:39.017755 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccc152b-fa54-43de-8bc1-2cfc607a9513 None None] PATH_INFO: `/` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:39.017916 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-cd1988ed-e8ce-4b3f-9be6-0e7fbbb5af76 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 30 01:00:39.017916 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:00:39.017916 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 01:00:39.017916 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 01:00:39.017916 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 01:00:39.017916 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 01:00:39.017916 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 01:00:39.017916 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 01:00:39.017916 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 30 01:00:39.017916 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Aug 30 01:00:39.017916 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 01:00:39.017916 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Aug 30 01:00:39.017916 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:00:39.017916 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:00:39.017916 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:00:39.017916 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:00:39.017916 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:00:39.018836 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:00:39.018836 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:00:39.018836 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:00:39.018836 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:00:39.018836 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:00:39.018836 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:00:39.018836 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 01:00:39.018836 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 01:00:39.018836 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 01:00:39.018836 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 01:00:39.018836 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:00:39.018836 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:00:39.018836 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:00:39.018836 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:00:39.018836 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:00:39.018836 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:00:39.020690 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:00:39.020690 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Aug 30 01:00:39.020690 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:00:39.020690 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:00:39.020690 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:00:39.020690 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:00:39.020690 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:00:39.020690 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:00:39.020690 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:00:39.020690 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:00:39.020690 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 01:00:39.020690 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 01:00:39.020690 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 30 01:00:39.020690 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Aug 30 01:00:39.021492 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 488/992] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 01:00:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:00:39.027377 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 505/993] 10.222.0.79 () {56 vars in 1105 bytes} [Tue Aug 30 01:00:38 2022] GET /identity/v3/services/image => generated 86 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:00:39.027377 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1988ed-e8ce-4b3f-9be6-0e7fbbb5af76 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:39.027679 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43d2482-574a-4b40-b14e-076761cf1731 None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:39.027679 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43d2482-574a-4b40-b14e-076761cf1731 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:39.027679 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43d2482-574a-4b40-b14e-076761cf1731 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:39.049211 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-f43d2482-574a-4b40-b14e-076761cf1731 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:00:39.050519 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-f43d2482-574a-4b40-b14e-076761cf1731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:00:39.090742 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:39.135523 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 489/994] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 01:00:39 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 01:00:39.156511 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1988ed-e8ce-4b3f-9be6-0e7fbbb5af76 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:39.210233 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b6ee49-1204-44ab-b6f9-0807daa03f18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:39.210876 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b6ee49-1204-44ab-b6f9-0807daa03f18 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:39.211112 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b6ee49-1204-44ab-b6f9-0807daa03f18 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:39.211417 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b6ee49-1204-44ab-b6f9-0807daa03f18 None admin] PATH_INFO: `/v3/services` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:39.212050 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b6ee49-1204-44ab-b6f9-0807daa03f18 None admin] RBAC: Adding query filter params (name=image) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:00:39.212757 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b6ee49-1204-44ab-b6f9-0807daa03f18 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:39.213696 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b6ee49-1204-44ab-b6f9-0807daa03f18 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:39.232871 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 506/995] 10.222.0.79 () {56 vars in 1108 bytes} [Tue Aug 30 01:00:39 2022] GET /identity/v3/services?name=image => generated 122 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:00:39.239168 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43d2482-574a-4b40-b14e-076761cf1731 None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:39.354955 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43d2482-574a-4b40-b14e-076761cf1731 None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:39.388710 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:39.399667 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90358fab-584d-4526-a67d-3223558cbf47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:39.400396 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90358fab-584d-4526-a67d-3223558cbf47 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:39.400671 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90358fab-584d-4526-a67d-3223558cbf47 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:39.400941 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90358fab-584d-4526-a67d-3223558cbf47 None admin] PATH_INFO: `/v3/services` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:39.401640 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90358fab-584d-4526-a67d-3223558cbf47 None admin] RBAC: Adding query filter params (type=image) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:00:39.401939 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90358fab-584d-4526-a67d-3223558cbf47 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:39.404370 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90358fab-584d-4526-a67d-3223558cbf47 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:39.419160 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 490/996] 10.222.0.79 () {56 vars in 1108 bytes} [Tue Aug 30 01:00:39 2022] GET /identity/v3/services?type=image => generated 122 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:00:39.420799 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b6ee49-1204-44ab-b6f9-0807daa03f18 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:39.564823 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd3a5a9-ca4c-4858-8f71-67afa1a78739 None None] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:39.565340 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd3a5a9-ca4c-4858-8f71-67afa1a78739 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:39.565819 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd3a5a9-ca4c-4858-8f71-67afa1a78739 None None] PATH_INFO: `/` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:39.570896 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 491/997] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 01:00:39 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 01:00:39.577470 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244a7c88-a0a5-4f84-8113-20a87a5eaf72 None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:39.577899 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244a7c88-a0a5-4f84-8113-20a87a5eaf72 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:39.578256 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244a7c88-a0a5-4f84-8113-20a87a5eaf72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:39.605481 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-244a7c88-a0a5-4f84-8113-20a87a5eaf72 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:00:39.608337 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-244a7c88-a0a5-4f84-8113-20a87a5eaf72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:00:39.609459 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b6ee49-1204-44ab-b6f9-0807daa03f18 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:39.640362 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:39.676466 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fae40c-3690-45e2-8af8-6c59342a7572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:39.677496 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fae40c-3690-45e2-8af8-6c59342a7572 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:39.677972 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fae40c-3690-45e2-8af8-6c59342a7572 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:39.678453 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fae40c-3690-45e2-8af8-6c59342a7572 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:39.679530 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fae40c-3690-45e2-8af8-6c59342a7572 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:39.682055 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fae40c-3690-45e2-8af8-6c59342a7572 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:39.698407 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-a1fae40c-3690-45e2-8af8-6c59342a7572 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 30 01:00:39.698407 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:00:39.698407 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 01:00:39.698407 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 01:00:39.698407 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 01:00:39.698407 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 01:00:39.698407 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 01:00:39.698407 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 01:00:39.698407 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 30 01:00:39.698407 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Aug 30 01:00:39.698407 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 01:00:39.698407 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Aug 30 01:00:39.698407 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:00:39.698407 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:00:39.698407 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:00:39.698407 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:00:39.698407 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:00:39.700285 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:00:39.700285 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:00:39.700285 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:00:39.700285 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:00:39.700285 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:00:39.700285 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:00:39.700285 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 01:00:39.700285 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 01:00:39.700285 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 01:00:39.700285 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 01:00:39.700285 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:00:39.700285 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:00:39.700285 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:00:39.700285 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:00:39.700285 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:00:39.700285 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:00:39.701163 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:00:39.701163 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Aug 30 01:00:39.701163 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:00:39.701163 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:00:39.701163 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:00:39.701163 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:00:39.701163 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:00:39.701163 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:00:39.701163 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:00:39.701163 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:00:39.701163 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 01:00:39.701163 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 01:00:39.701163 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 30 01:00:39.701163 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Aug 30 01:00:39.701163 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 507/998] 10.222.0.79 () {56 vars in 1111 bytes} [Tue Aug 30 01:00:39 2022] GET /identity/v3/services/compute => generated 88 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 01:00:39.710301 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fae40c-3690-45e2-8af8-6c59342a7572 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:39.735190 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 492/999] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 01:00:39 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 01:00:39.896695 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fae40c-3690-45e2-8af8-6c59342a7572 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:39.959026 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9798aea-f388-4e2c-914e-5e544f83926e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:39.960062 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9798aea-f388-4e2c-914e-5e544f83926e None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:39.960540 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9798aea-f388-4e2c-914e-5e544f83926e None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:39.961014 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9798aea-f388-4e2c-914e-5e544f83926e None admin] PATH_INFO: `/v3/services` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:39.962122 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9798aea-f388-4e2c-914e-5e544f83926e None admin] RBAC: Adding query filter params (name=compute) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:00:39.962636 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9798aea-f388-4e2c-914e-5e544f83926e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:39.966078 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9798aea-f388-4e2c-914e-5e544f83926e None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:39.982890 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 508/1000] 10.222.0.79 () {56 vars in 1112 bytes} [Tue Aug 30 01:00:39 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:00:39.985049 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244a7c88-a0a5-4f84-8113-20a87a5eaf72 None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:40.015942 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9798aea-f388-4e2c-914e-5e544f83926e None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:40.085182 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:40.160574 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9798aea-f388-4e2c-914e-5e544f83926e None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:40.169946 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244a7c88-a0a5-4f84-8113-20a87a5eaf72 None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:40.214960 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:40.222144 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7809287b-319c-4a4e-9980-83278e7fa51e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:40.223261 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7809287b-319c-4a4e-9980-83278e7fa51e None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:40.223740 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7809287b-319c-4a4e-9980-83278e7fa51e None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:40.224199 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7809287b-319c-4a4e-9980-83278e7fa51e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:40.225628 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7809287b-319c-4a4e-9980-83278e7fa51e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:40.227822 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7809287b-319c-4a4e-9980-83278e7fa51e None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:40.236309 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5e2496-9f65-487b-9401-5b363e02de16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:40.237398 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5e2496-9f65-487b-9401-5b363e02de16 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:40.237859 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5e2496-9f65-487b-9401-5b363e02de16 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:40.238685 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5e2496-9f65-487b-9401-5b363e02de16 None admin] PATH_INFO: `/v3/services` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:40.239460 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5e2496-9f65-487b-9401-5b363e02de16 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:00:40.239955 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5e2496-9f65-487b-9401-5b363e02de16 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:40.242406 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5e2496-9f65-487b-9401-5b363e02de16 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:40.249195 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-7809287b-319c-4a4e-9980-83278e7fa51e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 01:00:40.249195 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:00:40.249195 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 01:00:40.249195 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 01:00:40.249195 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 01:00:40.249195 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 01:00:40.249195 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 01:00:40.249195 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 01:00:40.249195 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 01:00:40.249195 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Aug 30 01:00:40.249195 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 01:00:40.249195 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Aug 30 01:00:40.249195 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:00:40.249195 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:00:40.249195 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:00:40.249195 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:00:40.249195 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:00:40.250298 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:00:40.250298 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:00:40.250298 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:00:40.250298 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:00:40.250298 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:00:40.250298 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:00:40.250298 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 01:00:40.250298 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 01:00:40.250298 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 01:00:40.250298 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 01:00:40.250298 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:00:40.250298 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:00:40.250298 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:00:40.250298 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:00:40.250298 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:00:40.250298 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:00:40.251226 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:00:40.251226 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Aug 30 01:00:40.251226 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:00:40.251226 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:00:40.251226 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:00:40.251226 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:00:40.251226 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:00:40.251226 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:00:40.251226 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:00:40.251226 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:00:40.251226 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 01:00:40.251226 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 01:00:40.251226 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 01:00:40.251226 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Aug 30 01:00:40.255604 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 493/1001] 10.222.0.79 () {56 vars in 1112 bytes} [Tue Aug 30 01:00:39 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:00:40.255780 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 509/1002] 10.222.0.79 () {56 vars in 1126 bytes} [Tue Aug 30 01:00:40 2022] GET /identity/v3/services/object-store => generated 93 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:00:40.260166 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5e2496-9f65-487b-9401-5b363e02de16 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:40.260698 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7809287b-319c-4a4e-9980-83278e7fa51e None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:40.439612 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5e2496-9f65-487b-9401-5b363e02de16 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:40.444739 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7809287b-319c-4a4e-9980-83278e7fa51e None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:40.459370 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:40.500532 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a5285f-9a39-4f7d-9c28-0d88c5d44997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:40.501407 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a5285f-9a39-4f7d-9c28-0d88c5d44997 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:40.501901 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a5285f-9a39-4f7d-9c28-0d88c5d44997 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:40.502273 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a5285f-9a39-4f7d-9c28-0d88c5d44997 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:40.503351 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a5285f-9a39-4f7d-9c28-0d88c5d44997 None admin] RBAC: Adding query filter params (interface=public, service_id=0f4466f3b6a64b67bd3cd57454f57f89, region_id=RegionOne) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:00:40.503760 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a5285f-9a39-4f7d-9c28-0d88c5d44997 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:40.505479 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a5285f-9a39-4f7d-9c28-0d88c5d44997 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:40.507062 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f8298e-78b9-49ec-a36f-b57e89c84563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:40.508351 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f8298e-78b9-49ec-a36f-b57e89c84563 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:40.508770 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f8298e-78b9-49ec-a36f-b57e89c84563 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:40.509199 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f8298e-78b9-49ec-a36f-b57e89c84563 None admin] PATH_INFO: `/v3/services` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:40.510163 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f8298e-78b9-49ec-a36f-b57e89c84563 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:00:40.510616 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f8298e-78b9-49ec-a36f-b57e89c84563 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:40.513587 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f8298e-78b9-49ec-a36f-b57e89c84563 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:40.514964 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 510/1003] 10.222.0.79 () {56 vars in 1251 bytes} [Tue Aug 30 01:00:40 2022] GET /identity/v3/endpoints?service_id=0f4466f3b6a64b67bd3cd57454f57f89&interface=public®ion_id=RegionOne => generated 194 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:00:40.521453 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a5285f-9a39-4f7d-9c28-0d88c5d44997 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:40.527509 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 494/1004] 10.222.0.79 () {56 vars in 1122 bytes} [Tue Aug 30 01:00:40 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:00:40.531438 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f8298e-78b9-49ec-a36f-b57e89c84563 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:40.637047 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:40.709007 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a5285f-9a39-4f7d-9c28-0d88c5d44997 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:40.722142 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f8298e-78b9-49ec-a36f-b57e89c84563 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:40.758437 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f5da5e-725a-4c37-86b0-4e200218e5a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:40.759869 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f5da5e-725a-4c37-86b0-4e200218e5a4 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:40.760581 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f5da5e-725a-4c37-86b0-4e200218e5a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:40.761019 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f5da5e-725a-4c37-86b0-4e200218e5a4 None admin] PATH_INFO: `/v3/services` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:40.762090 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f5da5e-725a-4c37-86b0-4e200218e5a4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:40.764462 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f5da5e-725a-4c37-86b0-4e200218e5a4 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:40.773986 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e82802-6eb5-4ee9-9465-865ab083b3eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:40.774798 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e82802-6eb5-4ee9-9465-865ab083b3eb None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:40.775249 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e82802-6eb5-4ee9-9465-865ab083b3eb None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:40.775666 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e82802-6eb5-4ee9-9465-865ab083b3eb None admin] PATH_INFO: `/v3/services` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:40.776440 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e82802-6eb5-4ee9-9465-865ab083b3eb None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:00:40.776957 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 511/1005] 10.222.0.79 () {56 vars in 1087 bytes} [Tue Aug 30 01:00:40 2022] GET /identity/v3/services => generated 1727 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:00:40.783919 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e82802-6eb5-4ee9-9465-865ab083b3eb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:40.786685 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e82802-6eb5-4ee9-9465-865ab083b3eb None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:40.804512 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 495/1006] 10.222.0.79 () {56 vars in 1122 bytes} [Tue Aug 30 01:00:40 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:00:40.806967 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f5da5e-725a-4c37-86b0-4e200218e5a4 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:40.880590 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:41.015076 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f5da5e-725a-4c37-86b0-4e200218e5a4 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:41.079315 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114874a1-f985-40ba-ba83-8317e3b18d7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:41.080767 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114874a1-f985-40ba-ba83-8317e3b18d7d None admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:41.081493 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114874a1-f985-40ba-ba83-8317e3b18d7d None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:41.082184 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114874a1-f985-40ba-ba83-8317e3b18d7d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:41.083603 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114874a1-f985-40ba-ba83-8317e3b18d7d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:41.086343 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114874a1-f985-40ba-ba83-8317e3b18d7d None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:41.116870 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 512/1007] 10.222.0.79 () {60 vars in 1144 bytes} [Tue Aug 30 01:00:40 2022] POST /identity/v3/endpoints => generated 325 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:00:41.703637 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628cb35e-a8a8-4b80-9cce-2bd619cbe80f None None] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:41.704482 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628cb35e-a8a8-4b80-9cce-2bd619cbe80f None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:41.704482 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628cb35e-a8a8-4b80-9cce-2bd619cbe80f None None] PATH_INFO: `/` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:41.705924 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 496/1008] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 01:00:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:00:41.712498 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bab436-3027-4309-a2c5-566242007f18 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:41.713119 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bab436-3027-4309-a2c5-566242007f18 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:41.713411 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bab436-3027-4309-a2c5-566242007f18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:41.739389 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-74bab436-3027-4309-a2c5-566242007f18 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:00:41.740776 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-74bab436-3027-4309-a2c5-566242007f18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:00:41.834153 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 513/1009] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 01:00:41 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 01:00:42.111737 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628cb35e-a8a8-4b80-9cce-2bd619cbe80f None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:42.266742 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628cb35e-a8a8-4b80-9cce-2bd619cbe80f None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:42.292296 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:42.341982 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8493fa3d-b0de-4146-be8a-633662ce1d86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:42.343034 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8493fa3d-b0de-4146-be8a-633662ce1d86 None admin] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:42.343538 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8493fa3d-b0de-4146-be8a-633662ce1d86 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:42.343999 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8493fa3d-b0de-4146-be8a-633662ce1d86 None admin] PATH_INFO: `/v3/services` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:42.347107 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8493fa3d-b0de-4146-be8a-633662ce1d86 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:42.350231 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8493fa3d-b0de-4146-be8a-633662ce1d86 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:42.386005 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 497/1010] 10.222.0.79 () {60 vars in 1141 bytes} [Tue Aug 30 01:00:42 2022] POST /identity/v3/services => generated 242 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:00:43.399417 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c555680-cda6-44a7-a1fa-58308b704938 None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:43.399939 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c555680-cda6-44a7-a1fa-58308b704938 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:43.400468 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c555680-cda6-44a7-a1fa-58308b704938 None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:43.402993 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 514/1011] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 01:00:43 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:00:43.408619 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecb70b5-468a-46d8-b358-bbe94f46d701 None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:43.409345 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecb70b5-468a-46d8-b358-bbe94f46d701 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:43.409345 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecb70b5-468a-46d8-b358-bbe94f46d701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:43.428708 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-7ecb70b5-468a-46d8-b358-bbe94f46d701 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:00:43.429915 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-7ecb70b5-468a-46d8-b358-bbe94f46d701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:00:43.522165 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 498/1012] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 01:00:43 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 01:00:43.596027 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd28ed7-7ae9-404b-8e5c-e0159a9c7d68 None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:43.596488 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd28ed7-7ae9-404b-8e5c-e0159a9c7d68 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:43.596953 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd28ed7-7ae9-404b-8e5c-e0159a9c7d68 None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:43.599600 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 515/1013] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 01:00:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:00:43.608482 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3023c215-a43d-4f9a-9f6c-ddf89c88fd95 None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:43.608963 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3023c215-a43d-4f9a-9f6c-ddf89c88fd95 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:43.609423 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3023c215-a43d-4f9a-9f6c-ddf89c88fd95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:43.639066 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-3023c215-a43d-4f9a-9f6c-ddf89c88fd95 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:00:43.640937 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-3023c215-a43d-4f9a-9f6c-ddf89c88fd95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:00:43.767191 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 499/1014] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 01:00:43 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 01:00:43.804720 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd28ed7-7ae9-404b-8e5c-e0159a9c7d68 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:43.831322 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:43.918843 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd28ed7-7ae9-404b-8e5c-e0159a9c7d68 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:43.958968 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e23aa1-36b2-418d-a0ba-7a41266c14c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:43.959621 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e23aa1-36b2-418d-a0ba-7a41266c14c0 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:43.959895 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e23aa1-36b2-418d-a0ba-7a41266c14c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:43.960163 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e23aa1-36b2-418d-a0ba-7a41266c14c0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:43.961280 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e23aa1-36b2-418d-a0ba-7a41266c14c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:43.962714 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e23aa1-36b2-418d-a0ba-7a41266c14c0 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:43.964514 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 516/1015] 10.222.0.79 () {56 vars in 1108 bytes} [Tue Aug 30 01:00:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:00:43.970684 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3023c215-a43d-4f9a-9f6c-ddf89c88fd95 None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:44.002757 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:44.061868 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e23aa1-36b2-418d-a0ba-7a41266c14c0 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:44.079857 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3023c215-a43d-4f9a-9f6c-ddf89c88fd95 None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:44.128477 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b968eba-705c-4ebb-b316-9fccacb27217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:44.129907 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b968eba-705c-4ebb-b316-9fccacb27217 None admin] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:44.130619 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b968eba-705c-4ebb-b316-9fccacb27217 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:44.131355 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b968eba-705c-4ebb-b316-9fccacb27217 None admin] PATH_INFO: `/v3/projects` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:44.132882 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b968eba-705c-4ebb-b316-9fccacb27217 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:44.136092 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b968eba-705c-4ebb-b316-9fccacb27217 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:44.161546 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:44.173865 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e23aa1-36b2-418d-a0ba-7a41266c14c0 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:44.192582 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 500/1016] 10.222.0.79 () {60 vars in 1141 bytes} [Tue Aug 30 01:00:43 2022] POST /identity/v3/projects => generated 311 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:00:44.224518 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef335fb-077e-4ba3-afa1-ee0808ab7d50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:44.225181 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef335fb-077e-4ba3-afa1-ee0808ab7d50 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:44.225458 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef335fb-077e-4ba3-afa1-ee0808ab7d50 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:44.225735 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef335fb-077e-4ba3-afa1-ee0808ab7d50 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:44.226417 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef335fb-077e-4ba3-afa1-ee0808ab7d50 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:44.227878 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef335fb-077e-4ba3-afa1-ee0808ab7d50 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:44.252188 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-2ef335fb-077e-4ba3-afa1-ee0808ab7d50 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 30 01:00:44.252188 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:00:44.252188 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 01:00:44.252188 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 01:00:44.252188 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 01:00:44.252188 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 01:00:44.252188 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 01:00:44.252188 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 01:00:44.252188 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 30 01:00:44.252188 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Aug 30 01:00:44.252188 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 01:00:44.252188 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Aug 30 01:00:44.252188 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:00:44.252188 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:00:44.252188 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:00:44.252188 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:00:44.252188 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:00:44.253374 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:00:44.253374 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:00:44.253374 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:00:44.253374 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:00:44.253374 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:00:44.253374 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:00:44.253374 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 01:00:44.253374 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 01:00:44.253374 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 01:00:44.253374 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 01:00:44.253374 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:00:44.253374 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:00:44.253374 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:00:44.253374 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:00:44.253374 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:00:44.253374 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:00:44.254300 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:00:44.254300 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Aug 30 01:00:44.254300 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:00:44.254300 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:00:44.254300 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:00:44.254300 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:00:44.254300 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:00:44.254300 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:00:44.254300 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:00:44.254300 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:00:44.254300 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 01:00:44.254300 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 01:00:44.254300 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 30 01:00:44.254300 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Aug 30 01:00:44.255927 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 517/1017] 10.222.0.79 () {56 vars in 1111 bytes} [Tue Aug 30 01:00:44 2022] GET /identity/v3/services/compute => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 01:00:44.263624 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b968eba-705c-4ebb-b316-9fccacb27217 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:44.391867 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:44.417562 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b968eba-705c-4ebb-b316-9fccacb27217 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:44.460799 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd56978b-c86b-4193-802b-b782e6d2e634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:44.461427 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd56978b-c86b-4193-802b-b782e6d2e634 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:44.461706 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd56978b-c86b-4193-802b-b782e6d2e634 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:44.461976 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd56978b-c86b-4193-802b-b782e6d2e634 None admin] PATH_INFO: `/v3/services` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:44.462611 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd56978b-c86b-4193-802b-b782e6d2e634 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:00:44.462910 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd56978b-c86b-4193-802b-b782e6d2e634 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:44.464320 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd56978b-c86b-4193-802b-b782e6d2e634 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:44.475153 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 501/1018] 10.222.0.79 () {56 vars in 1112 bytes} [Tue Aug 30 01:00:44 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:00:44.477150 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef335fb-077e-4ba3-afa1-ee0808ab7d50 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:44.589889 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef335fb-077e-4ba3-afa1-ee0808ab7d50 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:44.635265 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a77b77-5607-4036-ba26-c7e282acb9f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:44.636231 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a77b77-5607-4036-ba26-c7e282acb9f3 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:44.637248 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a77b77-5607-4036-ba26-c7e282acb9f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:44.637735 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a77b77-5607-4036-ba26-c7e282acb9f3 None admin] PATH_INFO: `/v3/services` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:44.638872 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a77b77-5607-4036-ba26-c7e282acb9f3 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:00:44.639408 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a77b77-5607-4036-ba26-c7e282acb9f3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:44.641827 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a77b77-5607-4036-ba26-c7e282acb9f3 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:44.650743 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 518/1019] 10.222.0.79 () {56 vars in 1112 bytes} [Tue Aug 30 01:00:44 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:00:44.657852 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd56978b-c86b-4193-802b-b782e6d2e634 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:44.773372 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6817e226-ad30-4ee8-885f-d84a025fe65b None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:44.773654 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6817e226-ad30-4ee8-885f-d84a025fe65b None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:44.773914 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6817e226-ad30-4ee8-885f-d84a025fe65b None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:44.775945 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 519/1020] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 01:00:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:00:44.782352 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac18b2c7-bc3f-4fb2-9c54-dfe8b169abaa None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:44.782893 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac18b2c7-bc3f-4fb2-9c54-dfe8b169abaa None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:44.783364 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac18b2c7-bc3f-4fb2-9c54-dfe8b169abaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:44.812341 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-ac18b2c7-bc3f-4fb2-9c54-dfe8b169abaa None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:00:44.814346 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-ac18b2c7-bc3f-4fb2-9c54-dfe8b169abaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:00:44.817977 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd56978b-c86b-4193-802b-b782e6d2e634 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:44.838345 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:44.866709 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7ce919-c4fa-4070-97d1-89d06edb4da2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:44.867740 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7ce919-c4fa-4070-97d1-89d06edb4da2 None admin] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:44.868219 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7ce919-c4fa-4070-97d1-89d06edb4da2 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:44.868686 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7ce919-c4fa-4070-97d1-89d06edb4da2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:44.869748 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7ce919-c4fa-4070-97d1-89d06edb4da2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:44.873911 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7ce919-c4fa-4070-97d1-89d06edb4da2 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:44.901806 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 502/1021] 10.222.0.79 () {60 vars in 1144 bytes} [Tue Aug 30 01:00:44 2022] POST /identity/v3/endpoints => generated 334 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:00:44.923262 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 520/1022] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 01:00:44 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 01:00:45.197097 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7ce919-c4fa-4070-97d1-89d06edb4da2 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:45.201123 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:45.335589 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7ce919-c4fa-4070-97d1-89d06edb4da2 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:45.380753 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f64e93-894e-4df4-bfce-bc2145ab166f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:45.381582 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f64e93-894e-4df4-bfce-bc2145ab166f None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:45.382040 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f64e93-894e-4df4-bfce-bc2145ab166f None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:45.382448 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f64e93-894e-4df4-bfce-bc2145ab166f None admin] PATH_INFO: `/v3/services/image` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:45.383212 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f64e93-894e-4df4-bfce-bc2145ab166f None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:45.384767 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f64e93-894e-4df4-bfce-bc2145ab166f None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:45.395183 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application [None req-34f64e93-894e-4df4-bfce-bc2145ab166f None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 30 01:00:45.395183 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:00:45.395183 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 01:00:45.395183 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 01:00:45.395183 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 01:00:45.395183 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 01:00:45.395183 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 01:00:45.395183 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 01:00:45.395183 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 30 01:00:45.395183 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Aug 30 01:00:45.395183 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 01:00:45.395183 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Aug 30 01:00:45.395183 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:00:45.395183 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:00:45.395183 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:00:45.395183 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:00:45.395183 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:00:45.397130 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:00:45.397130 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:00:45.397130 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:00:45.397130 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:00:45.397130 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:00:45.397130 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:00:45.397130 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 01:00:45.397130 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 01:00:45.397130 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 01:00:45.397130 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 01:00:45.397130 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:00:45.397130 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:00:45.397130 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:00:45.397130 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:00:45.397130 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:00:45.397130 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:00:45.398175 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:00:45.398175 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application with Lock( Aug 30 01:00:45.398175 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:00:45.398175 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:00:45.398175 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:00:45.398175 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:00:45.398175 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:00:45.398175 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:00:45.398175 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:00:45.398175 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:00:45.398175 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 01:00:45.398175 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 01:00:45.398175 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 30 01:00:45.398175 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Aug 30 01:00:45.398175 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 503/1023] 10.222.0.79 () {56 vars in 1105 bytes} [Tue Aug 30 01:00:45 2022] GET /identity/v3/services/image => generated 86 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:00:45.406152 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac18b2c7-bc3f-4fb2-9c54-dfe8b169abaa None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:45.526722 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac18b2c7-bc3f-4fb2-9c54-dfe8b169abaa None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:45.576136 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eaab81-94a5-468b-ae07-1fc29710d3e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:45.577052 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eaab81-94a5-468b-ae07-1fc29710d3e2 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:45.577531 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eaab81-94a5-468b-ae07-1fc29710d3e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:45.578011 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eaab81-94a5-468b-ae07-1fc29710d3e2 None admin] PATH_INFO: `/v3/services` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:45.579227 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12eaab81-94a5-468b-ae07-1fc29710d3e2 None admin] RBAC: Adding query filter params (name=image) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:00:45.579776 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12eaab81-94a5-468b-ae07-1fc29710d3e2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:45.582329 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12eaab81-94a5-468b-ae07-1fc29710d3e2 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:45.591717 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 521/1024] 10.222.0.79 () {56 vars in 1108 bytes} [Tue Aug 30 01:00:45 2022] GET /identity/v3/services?name=image => generated 122 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:00:45.598216 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f64e93-894e-4df4-bfce-bc2145ab166f None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:45.723670 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:45.787096 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f64e93-894e-4df4-bfce-bc2145ab166f None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:45.832093 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a403ef6-c4d9-4b5f-ac1b-d956b741b0aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:45.832705 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a403ef6-c4d9-4b5f-ac1b-d956b741b0aa None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:45.832975 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a403ef6-c4d9-4b5f-ac1b-d956b741b0aa None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:45.833240 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a403ef6-c4d9-4b5f-ac1b-d956b741b0aa None admin] PATH_INFO: `/v3/services` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:45.833869 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a403ef6-c4d9-4b5f-ac1b-d956b741b0aa None admin] RBAC: Adding query filter params (type=image) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:00:45.834161 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a403ef6-c4d9-4b5f-ac1b-d956b741b0aa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:45.835557 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a403ef6-c4d9-4b5f-ac1b-d956b741b0aa None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:45.846692 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 504/1025] 10.222.0.79 () {56 vars in 1108 bytes} [Tue Aug 30 01:00:45 2022] GET /identity/v3/services?type=image => generated 350 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:00:45.848041 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eaab81-94a5-468b-ae07-1fc29710d3e2 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:45.861573 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:45.967175 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eaab81-94a5-468b-ae07-1fc29710d3e2 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:46.007673 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4cde0f-3e8e-41fa-ac1d-ba0ae17046d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:46.008281 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4cde0f-3e8e-41fa-ac1d-ba0ae17046d2 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:46.008560 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4cde0f-3e8e-41fa-ac1d-ba0ae17046d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:46.008862 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4cde0f-3e8e-41fa-ac1d-ba0ae17046d2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:46.009536 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4cde0f-3e8e-41fa-ac1d-ba0ae17046d2 None admin] RBAC: Adding query filter params (interface=public, service_id=11c4cba28faf4b0ab19c4977f5cd73ab, region_id=RegionOne) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:00:46.009841 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4cde0f-3e8e-41fa-ac1d-ba0ae17046d2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:46.011297 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4cde0f-3e8e-41fa-ac1d-ba0ae17046d2 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:46.018019 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 522/1026] 10.222.0.79 () {56 vars in 1251 bytes} [Tue Aug 30 01:00:45 2022] GET /identity/v3/endpoints?service_id=11c4cba28faf4b0ab19c4977f5cd73ab&interface=public®ion_id=RegionOne => generated 194 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:00:46.024301 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a403ef6-c4d9-4b5f-ac1b-d956b741b0aa None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:46.204457 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a403ef6-c4d9-4b5f-ac1b-d956b741b0aa None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:46.218057 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e9cef1-2444-496d-8e06-0501a0ed6a69 None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:46.218389 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e9cef1-2444-496d-8e06-0501a0ed6a69 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:46.218607 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e9cef1-2444-496d-8e06-0501a0ed6a69 None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:46.220052 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 523/1027] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 01:00:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 01:00:46.225689 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f953d9-bb65-4e1a-8dfd-b4625a6e1011 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:46.225985 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f953d9-bb65-4e1a-8dfd-b4625a6e1011 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:46.226227 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f953d9-bb65-4e1a-8dfd-b4625a6e1011 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:46.253239 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-17f953d9-bb65-4e1a-8dfd-b4625a6e1011 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:00:46.254439 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-17f953d9-bb65-4e1a-8dfd-b4625a6e1011 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:00:46.269264 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:46.278898 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c7bd16-b26c-4e97-9e92-3bf4ab223518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:46.280302 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c7bd16-b26c-4e97-9e92-3bf4ab223518 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:46.280493 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c7bd16-b26c-4e97-9e92-3bf4ab223518 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:46.280975 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c7bd16-b26c-4e97-9e92-3bf4ab223518 None admin] PATH_INFO: `/v3/services` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:46.282108 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c7bd16-b26c-4e97-9e92-3bf4ab223518 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:46.284867 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c7bd16-b26c-4e97-9e92-3bf4ab223518 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:46.304214 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 505/1028] 10.222.0.79 () {56 vars in 1087 bytes} [Tue Aug 30 01:00:46 2022] GET /identity/v3/services => generated 1957 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:00:46.335464 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 524/1029] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 01:00:46 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 01:00:46.610954 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c7bd16-b26c-4e97-9e92-3bf4ab223518 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:46.784394 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c7bd16-b26c-4e97-9e92-3bf4ab223518 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:46.847980 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0d9e94-f212-48ea-b854-9b82be769245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:46.849011 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0d9e94-f212-48ea-b854-9b82be769245 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:46.849509 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0d9e94-f212-48ea-b854-9b82be769245 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:46.849939 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0d9e94-f212-48ea-b854-9b82be769245 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:46.851868 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0d9e94-f212-48ea-b854-9b82be769245 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:46.854518 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0d9e94-f212-48ea-b854-9b82be769245 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:46.859229 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 506/1030] 10.222.0.79 () {56 vars in 1108 bytes} [Tue Aug 30 01:00:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:00:46.864027 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f953d9-bb65-4e1a-8dfd-b4625a6e1011 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:46.866336 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:46.982213 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f953d9-bb65-4e1a-8dfd-b4625a6e1011 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:47.023276 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e798f7-23b4-4ae4-b381-724e08df3ed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:47.024130 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e798f7-23b4-4ae4-b381-724e08df3ed6 None admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:47.024467 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e798f7-23b4-4ae4-b381-724e08df3ed6 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:47.024734 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e798f7-23b4-4ae4-b381-724e08df3ed6 None admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:47.025409 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e798f7-23b4-4ae4-b381-724e08df3ed6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:47.026884 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e798f7-23b4-4ae4-b381-724e08df3ed6 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:47.054916 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 525/1031] 10.222.0.79 () {60 vars in 1132 bytes} [Tue Aug 30 01:00:46 2022] POST /identity/v3/users => generated 285 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:00:47.086181 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b35ab61-2814-49e5-8475-923860f3d7ea None None] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:47.086451 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b35ab61-2814-49e5-8475-923860f3d7ea None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:47.086815 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b35ab61-2814-49e5-8475-923860f3d7ea None None] PATH_INFO: `/` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:47.088536 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 507/1032] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 01:00:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:00:47.094340 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1bca5d-926c-435d-9724-be065e0ff6e7 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:47.094761 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1bca5d-926c-435d-9724-be065e0ff6e7 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:47.094918 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1bca5d-926c-435d-9724-be065e0ff6e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:47.116405 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-9e1bca5d-926c-435d-9724-be065e0ff6e7 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:00:47.117537 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-9e1bca5d-926c-435d-9724-be065e0ff6e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:00:47.213730 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:47.231447 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 526/1033] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 01:00:47 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 01:00:47.510794 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b35ab61-2814-49e5-8475-923860f3d7ea None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:47.581759 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:47.625212 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b35ab61-2814-49e5-8475-923860f3d7ea None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:47.661257 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b467f4-e02d-4efe-9a55-351feb54ba79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:47.661898 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b467f4-e02d-4efe-9a55-351feb54ba79 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:47.662171 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b467f4-e02d-4efe-9a55-351feb54ba79 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:47.662438 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b467f4-e02d-4efe-9a55-351feb54ba79 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:47.674001 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b467f4-e02d-4efe-9a55-351feb54ba79 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 01:00:47.678806 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application [None req-e7b467f4-e02d-4efe-9a55-351feb54ba79 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 01:00:47.678806 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:00:47.678806 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:00:47.678806 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:00:47.678806 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:00:47.678806 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:00:47.678806 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:00:47.678806 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:00:47.678806 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:00:47.678806 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:00:47.678806 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:00:47.678806 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:00:47.678806 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 01:00:47.678806 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 01:00:47.678806 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 01:00:47.678806 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 01:00:47.679970 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 01:00:47.679970 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 01:00:47.679970 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 01:00:47.679970 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 01:00:47.679970 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:00:47.679970 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:00:47.679970 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:00:47.679970 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:00:47.679970 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:00:47.679970 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:00:47.679970 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:00:47.679970 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application with Lock( Aug 30 01:00:47.679970 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:00:47.679970 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:00:47.679970 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:00:47.679970 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:00:47.680807 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:00:47.680807 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:00:47.680807 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:00:47.680807 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:00:47.680807 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 01:00:47.680807 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 01:00:47.680807 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 01:00:47.680807 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 01:00:47.680807 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 01:00:47.680807 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 01:00:47.680807 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 01:00:47.680807 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Aug 30 01:00:47.683572 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 508/1034] 10.222.0.79 () {56 vars in 1120 bytes} [Tue Aug 30 01:00:47 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:00:47.685927 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1bca5d-926c-435d-9724-be065e0ff6e7 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:47.802964 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1bca5d-926c-435d-9724-be065e0ff6e7 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:47.839579 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed8f730-1d84-49db-aa99-6462a75cb178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:47.841026 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed8f730-1d84-49db-aa99-6462a75cb178 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:47.841395 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed8f730-1d84-49db-aa99-6462a75cb178 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:47.841684 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed8f730-1d84-49db-aa99-6462a75cb178 None admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:47.842675 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed8f730-1d84-49db-aa99-6462a75cb178 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:00:47.843183 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed8f730-1d84-49db-aa99-6462a75cb178 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:47.845362 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed8f730-1d84-49db-aa99-6462a75cb178 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:47.859174 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 527/1035] 10.222.0.79 () {56 vars in 1115 bytes} [Tue Aug 30 01:00:47 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:00:47.860995 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b467f4-e02d-4efe-9a55-351feb54ba79 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:47.974963 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b467f4-e02d-4efe-9a55-351feb54ba79 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:48.004161 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:48.019613 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a56c8e-e83d-401d-96a6-49c522c5c0a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:48.020248 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a56c8e-e83d-401d-96a6-49c522c5c0a5 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:48.020550 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a56c8e-e83d-401d-96a6-49c522c5c0a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:48.020966 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a56c8e-e83d-401d-96a6-49c522c5c0a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:48.033598 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a56c8e-e83d-401d-96a6-49c522c5c0a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:48.035074 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a56c8e-e83d-401d-96a6-49c522c5c0a5 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:48.052277 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application [None req-a6a56c8e-e83d-401d-96a6-49c522c5c0a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:00:48.052277 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:00:48.052277 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:00:48.052277 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:00:48.052277 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:00:48.052277 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:00:48.052277 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:00:48.052277 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:00:48.052277 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:00:48.052277 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:00:48.052277 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:00:48.052277 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:00:48.052277 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 01:00:48.052277 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 01:00:48.052277 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 01:00:48.052277 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 01:00:48.054194 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:00:48.054194 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:00:48.054194 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:00:48.054194 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:00:48.054194 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:00:48.054194 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:00:48.054194 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:00:48.054194 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application with Lock( Aug 30 01:00:48.054194 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:00:48.054194 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:00:48.054194 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:00:48.054194 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:00:48.054194 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:00:48.054194 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:00:48.054194 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:00:48.054194 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:00:48.054194 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 01:00:48.056106 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 01:00:48.056106 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:00:48.056106 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Aug 30 01:00:48.056106 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 509/1036] 10.222.0.79 () {56 vars in 1108 bytes} [Tue Aug 30 01:00:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:00:48.067068 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed8f730-1d84-49db-aa99-6462a75cb178 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:48.159732 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:48.238354 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed8f730-1d84-49db-aa99-6462a75cb178 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:48.275937 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427d0114-3d78-4af3-b286-91a0c4b2e583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:48.276559 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427d0114-3d78-4af3-b286-91a0c4b2e583 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:48.276836 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427d0114-3d78-4af3-b286-91a0c4b2e583 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:48.277106 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427d0114-3d78-4af3-b286-91a0c4b2e583 None admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:48.277926 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427d0114-3d78-4af3-b286-91a0c4b2e583 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:00:48.278344 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427d0114-3d78-4af3-b286-91a0c4b2e583 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:48.279757 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427d0114-3d78-4af3-b286-91a0c4b2e583 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:48.294412 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 528/1037] 10.222.0.79 () {56 vars in 1109 bytes} [Tue Aug 30 01:00:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:00:48.300282 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a56c8e-e83d-401d-96a6-49c522c5c0a5 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:48.393280 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9be042d-e0af-475f-8d33-733be0bbf793 None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:48.393462 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9be042d-e0af-475f-8d33-733be0bbf793 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:48.393732 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9be042d-e0af-475f-8d33-733be0bbf793 None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:48.395063 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 529/1038] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 01:00:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 01:00:48.399972 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacf7ef8-47ed-40d4-8968-775e7aaa1a19 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:48.400255 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacf7ef8-47ed-40d4-8968-775e7aaa1a19 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:48.400526 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacf7ef8-47ed-40d4-8968-775e7aaa1a19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:48.407557 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a56c8e-e83d-401d-96a6-49c522c5c0a5 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:48.419401 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-dacf7ef8-47ed-40d4-8968-775e7aaa1a19 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:00:48.420599 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-dacf7ef8-47ed-40d4-8968-775e7aaa1a19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:00:48.444153 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e366421c-cf3c-41b6-9879-963d4d782dbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:48.444793 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e366421c-cf3c-41b6-9879-963d4d782dbb None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:48.445068 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e366421c-cf3c-41b6-9879-963d4d782dbb None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:48.445337 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e366421c-cf3c-41b6-9879-963d4d782dbb None admin] PATH_INFO: `/v3/users/nova` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:48.454033 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e366421c-cf3c-41b6-9879-963d4d782dbb None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:48.455526 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e366421c-cf3c-41b6-9879-963d4d782dbb None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:48.468625 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application [None req-e366421c-cf3c-41b6-9879-963d4d782dbb None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 30 01:00:48.468625 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:00:48.468625 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:00:48.468625 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:00:48.468625 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:00:48.468625 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:00:48.468625 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:00:48.468625 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:00:48.468625 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:00:48.468625 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:00:48.468625 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:00:48.468625 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:00:48.468625 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 01:00:48.468625 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 01:00:48.468625 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 01:00:48.468625 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 01:00:48.469674 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:00:48.469674 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:00:48.469674 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 01:00:48.469674 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 01:00:48.469674 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 01:00:48.469674 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 01:00:48.469674 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:00:48.469674 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:00:48.469674 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:00:48.469674 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:00:48.469674 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:00:48.469674 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application with Lock( Aug 30 01:00:48.469674 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:00:48.469674 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:00:48.469674 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:00:48.469674 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:00:48.469674 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:00:48.469674 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:00:48.470637 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:00:48.470637 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:00:48.470637 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 01:00:48.470637 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 01:00:48.470637 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 01:00:48.470637 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 01:00:48.470637 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 01:00:48.470637 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 01:00:48.470637 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 30 01:00:48.470637 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Aug 30 01:00:48.470637 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 510/1039] 10.222.0.79 () {56 vars in 1093 bytes} [Tue Aug 30 01:00:48 2022] GET /identity/v3/users/nova => generated 82 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:00:48.476357 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e366421c-cf3c-41b6-9879-963d4d782dbb None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:48.511220 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 530/1040] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 01:00:48 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 01:00:48.522270 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:48.603043 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e366421c-cf3c-41b6-9879-963d4d782dbb None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:48.642109 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab9e491-1213-4b52-b6c4-cbc0c4c1718e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:48.642807 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab9e491-1213-4b52-b6c4-cbc0c4c1718e None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:48.643058 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab9e491-1213-4b52-b6c4-cbc0c4c1718e None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:48.643268 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab9e491-1213-4b52-b6c4-cbc0c4c1718e None admin] PATH_INFO: `/v3/users` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:48.644047 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab9e491-1213-4b52-b6c4-cbc0c4c1718e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:00:48.644296 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab9e491-1213-4b52-b6c4-cbc0c4c1718e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:48.645724 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab9e491-1213-4b52-b6c4-cbc0c4c1718e None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:48.666750 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 511/1041] 10.222.0.79 () {56 vars in 1133 bytes} [Tue Aug 30 01:00:48 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:00:48.673729 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacf7ef8-47ed-40d4-8968-775e7aaa1a19 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:48.722441 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:48.793527 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab9e491-1213-4b52-b6c4-cbc0c4c1718e None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:48.796414 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacf7ef8-47ed-40d4-8968-775e7aaa1a19 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:48.835892 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85624d7d-d813-4b93-818b-ce7b9697080b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:48.836503 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85624d7d-d813-4b93-818b-ce7b9697080b None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:48.836785 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85624d7d-d813-4b93-818b-ce7b9697080b None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:48.837042 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85624d7d-d813-4b93-818b-ce7b9697080b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:48.896265 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:48.904287 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab9e491-1213-4b52-b6c4-cbc0c4c1718e None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:48.914846 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85624d7d-d813-4b93-818b-ce7b9697080b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:48.916460 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85624d7d-d813-4b93-818b-ce7b9697080b None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:48.939935 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1236405-3de6-44e2-b06a-ac035149b007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:48.940577 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1236405-3de6-44e2-b06a-ac035149b007 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:48.940850 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1236405-3de6-44e2-b06a-ac035149b007 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:48.941116 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1236405-3de6-44e2-b06a-ac035149b007 None admin] PATH_INFO: `/v3/services/image` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:48.941693 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1236405-3de6-44e2-b06a-ac035149b007 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:48.943335 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1236405-3de6-44e2-b06a-ac035149b007 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:48.953874 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application [None req-d1236405-3de6-44e2-b06a-ac035149b007 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 30 01:00:48.953874 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:00:48.953874 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 01:00:48.953874 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 01:00:48.953874 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 01:00:48.953874 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 01:00:48.953874 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 01:00:48.953874 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 01:00:48.953874 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 30 01:00:48.953874 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Aug 30 01:00:48.953874 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 01:00:48.953874 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Aug 30 01:00:48.953874 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:00:48.953874 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:00:48.953874 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:00:48.953874 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:00:48.953874 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:00:48.955221 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:00:48.955221 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:00:48.955221 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:00:48.955221 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:00:48.955221 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:00:48.955221 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:00:48.955221 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 01:00:48.955221 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 01:00:48.955221 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 01:00:48.955221 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 01:00:48.955221 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:00:48.955221 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:00:48.955221 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:00:48.955221 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:00:48.955221 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:00:48.955221 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:00:48.956719 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:00:48.956719 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application with Lock( Aug 30 01:00:48.956719 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:00:48.956719 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:00:48.956719 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:00:48.956719 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:00:48.956719 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:00:48.956719 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:00:48.956719 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:00:48.956719 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:00:48.956719 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 01:00:48.956719 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 01:00:48.956719 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 30 01:00:48.956719 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Aug 30 01:00:48.959868 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 512/1042] 10.222.0.79 () {56 vars in 1105 bytes} [Tue Aug 30 01:00:48 2022] GET /identity/v3/services/image => generated 86 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 01:00:48.960773 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1236405-3de6-44e2-b06a-ac035149b007 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:48.969169 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:49.041702 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 531/1043] 10.222.0.79 () {58 vars in 1282 bytes} [Tue Aug 30 01:00:48 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 30 01:00:49.047550 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85624d7d-d813-4b93-818b-ce7b9697080b None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:49.081989 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1236405-3de6-44e2-b06a-ac035149b007 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:49.128741 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad5faa0-328b-4640-92f7-812ff9393fb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:49.129359 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad5faa0-328b-4640-92f7-812ff9393fb3 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:49.129631 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad5faa0-328b-4640-92f7-812ff9393fb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:49.129902 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad5faa0-328b-4640-92f7-812ff9393fb3 None admin] PATH_INFO: `/v3/services` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:49.130527 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad5faa0-328b-4640-92f7-812ff9393fb3 None admin] RBAC: Adding query filter params (name=image) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:00:49.130822 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad5faa0-328b-4640-92f7-812ff9393fb3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:49.132225 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad5faa0-328b-4640-92f7-812ff9393fb3 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:49.138597 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 513/1044] 10.222.0.79 () {56 vars in 1108 bytes} [Tue Aug 30 01:00:48 2022] GET /identity/v3/services?name=image => generated 122 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:00:49.140107 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6358fcd8-2996-4427-8221-f8f768e3c073 None None] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:49.140397 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6358fcd8-2996-4427-8221-f8f768e3c073 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:49.140667 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6358fcd8-2996-4427-8221-f8f768e3c073 None None] PATH_INFO: `/` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:49.142250 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 514/1045] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 01:00:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:00:49.144455 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6358fcd8-2996-4427-8221-f8f768e3c073 None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:49.160135 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85624d7d-d813-4b93-818b-ce7b9697080b None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:49.170725 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:49.195608 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7063ba39-41bf-43c9-970e-838e51d8ea75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:49.196247 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7063ba39-41bf-43c9-970e-838e51d8ea75 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:49.196525 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7063ba39-41bf-43c9-970e-838e51d8ea75 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:49.196793 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7063ba39-41bf-43c9-970e-838e51d8ea75 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:49.206228 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:49.208292 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7063ba39-41bf-43c9-970e-838e51d8ea75 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:49.210027 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7063ba39-41bf-43c9-970e-838e51d8ea75 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:49.226231 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-7063ba39-41bf-43c9-970e-838e51d8ea75 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:00:49.226231 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:00:49.226231 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:00:49.226231 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:00:49.226231 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:00:49.226231 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:00:49.226231 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:00:49.226231 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:00:49.226231 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:00:49.226231 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:00:49.226231 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:00:49.226231 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:00:49.226231 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 01:00:49.226231 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 01:00:49.226231 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 01:00:49.226231 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 01:00:49.227349 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:00:49.227349 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:00:49.227349 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:00:49.227349 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:00:49.227349 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:00:49.227349 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:00:49.227349 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:00:49.227349 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Aug 30 01:00:49.227349 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:00:49.227349 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:00:49.227349 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:00:49.227349 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:00:49.227349 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:00:49.227349 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:00:49.227349 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:00:49.227349 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:00:49.227349 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 01:00:49.228333 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 01:00:49.228333 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:00:49.228333 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Aug 30 01:00:49.228333 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 532/1046] 10.222.0.79 () {56 vars in 1108 bytes} [Tue Aug 30 01:00:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 01:00:49.229544 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7098166b-927b-4833-94eb-eadcd3a4d49e None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:49.229819 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7098166b-927b-4833-94eb-eadcd3a4d49e None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:49.230090 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7098166b-927b-4833-94eb-eadcd3a4d49e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:49.250057 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-7098166b-927b-4833-94eb-eadcd3a4d49e None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:00:49.251343 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-7098166b-927b-4833-94eb-eadcd3a4d49e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:00:49.260126 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6358fcd8-2996-4427-8221-f8f768e3c073 None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:49.296902 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9925b9a-39c8-49f6-a4f3-7d1b53481381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:49.297528 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9925b9a-39c8-49f6-a4f3-7d1b53481381 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:49.297805 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9925b9a-39c8-49f6-a4f3-7d1b53481381 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:49.298078 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9925b9a-39c8-49f6-a4f3-7d1b53481381 None admin] PATH_INFO: `/v3/services` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:49.298714 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9925b9a-39c8-49f6-a4f3-7d1b53481381 None admin] RBAC: Adding query filter params (type=image) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:00:49.299017 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9925b9a-39c8-49f6-a4f3-7d1b53481381 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:49.300437 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9925b9a-39c8-49f6-a4f3-7d1b53481381 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:49.305591 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 515/1047] 10.222.0.79 () {56 vars in 1108 bytes} [Tue Aug 30 01:00:49 2022] GET /identity/v3/services?type=image => generated 350 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:00:49.306411 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9925b9a-39c8-49f6-a4f3-7d1b53481381 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:49.323185 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 533/1048] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 01:00:49 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 01:00:49.324120 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7098166b-927b-4833-94eb-eadcd3a4d49e None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:49.426606 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:49.451407 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9925b9a-39c8-49f6-a4f3-7d1b53481381 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:49.485500 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7098166b-927b-4833-94eb-eadcd3a4d49e None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:49.502570 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22da0ad2-283d-4563-b12a-fb565fddb07b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:49.503201 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22da0ad2-283d-4563-b12a-fb565fddb07b None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:49.503509 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22da0ad2-283d-4563-b12a-fb565fddb07b None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:49.503798 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22da0ad2-283d-4563-b12a-fb565fddb07b None admin] PATH_INFO: `/v3/domains` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:49.504404 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22da0ad2-283d-4563-b12a-fb565fddb07b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:00:49.504708 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22da0ad2-283d-4563-b12a-fb565fddb07b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:49.506169 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22da0ad2-283d-4563-b12a-fb565fddb07b None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:49.517698 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:49.519578 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 516/1049] 10.222.0.79 () {56 vars in 1109 bytes} [Tue Aug 30 01:00:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:00:49.525208 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22da0ad2-283d-4563-b12a-fb565fddb07b None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:49.532799 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fad4eae-73ac-4738-842a-327d5a37d035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:49.533662 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fad4eae-73ac-4738-842a-327d5a37d035 None admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:49.534690 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fad4eae-73ac-4738-842a-327d5a37d035 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:49.535167 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fad4eae-73ac-4738-842a-327d5a37d035 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:49.536030 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fad4eae-73ac-4738-842a-327d5a37d035 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:49.538595 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fad4eae-73ac-4738-842a-327d5a37d035 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:49.579163 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 534/1050] 10.222.0.79 () {60 vars in 1144 bytes} [Tue Aug 30 01:00:49 2022] POST /identity/v3/endpoints => generated 327 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:00:49.589681 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fad4eae-73ac-4738-842a-327d5a37d035 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:49.658086 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22da0ad2-283d-4563-b12a-fb565fddb07b None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:49.706097 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d63ae6-828e-4a48-8a72-700ce64edb5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:49.706647 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d63ae6-828e-4a48-8a72-700ce64edb5e None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:49.706918 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d63ae6-828e-4a48-8a72-700ce64edb5e None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:49.707222 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d63ae6-828e-4a48-8a72-700ce64edb5e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:49.714876 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d63ae6-828e-4a48-8a72-700ce64edb5e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:49.716377 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d63ae6-828e-4a48-8a72-700ce64edb5e None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:49.728669 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application [None req-59d63ae6-828e-4a48-8a72-700ce64edb5e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 01:00:49.728669 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:00:49.728669 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:00:49.728669 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:00:49.728669 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:00:49.728669 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:00:49.728669 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:00:49.728669 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:00:49.728669 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:00:49.728669 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:00:49.728669 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:00:49.728669 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:00:49.728669 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 01:00:49.728669 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 01:00:49.728669 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 01:00:49.729684 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 01:00:49.729684 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:00:49.729684 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:00:49.729684 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:00:49.729684 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:00:49.729684 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:00:49.729684 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:00:49.729684 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:00:49.729684 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application with Lock( Aug 30 01:00:49.729684 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:00:49.729684 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:00:49.729684 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:00:49.729684 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:00:49.729684 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:00:49.729684 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:00:49.729684 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:00:49.729684 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:00:49.731608 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 01:00:49.731608 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 01:00:49.731608 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 01:00:49.731608 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 01:00:49.731608 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 01:00:49.731608 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 01:00:49.731608 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 01:00:49.731608 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Aug 30 01:00:49.731608 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 517/1051] 10.222.0.79 () {56 vars in 1111 bytes} [Tue Aug 30 01:00:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 01:00:49.738756 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d63ae6-828e-4a48-8a72-700ce64edb5e None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:49.741858 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:49.770159 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fad4eae-73ac-4738-842a-327d5a37d035 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:49.829397 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ccafa9-bf8c-4a10-b31a-fdddb848563a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:49.830377 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ccafa9-bf8c-4a10-b31a-fdddb848563a None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:49.830827 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ccafa9-bf8c-4a10-b31a-fdddb848563a None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:49.831267 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ccafa9-bf8c-4a10-b31a-fdddb848563a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:49.849061 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ccafa9-bf8c-4a10-b31a-fdddb848563a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 01:00:49.858168 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-72ccafa9-bf8c-4a10-b31a-fdddb848563a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 01:00:49.858168 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:00:49.858168 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:00:49.858168 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:00:49.858168 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:00:49.858168 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:00:49.858168 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:00:49.858168 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:00:49.858168 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:00:49.858168 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:00:49.858168 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:00:49.858168 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:00:49.858168 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 01:00:49.858168 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 01:00:49.858168 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 01:00:49.858168 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 01:00:49.859302 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 01:00:49.859302 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 01:00:49.859302 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 01:00:49.859302 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 01:00:49.859302 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:00:49.859302 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:00:49.859302 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:00:49.859302 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:00:49.859302 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:00:49.859302 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:00:49.859302 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:00:49.859302 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Aug 30 01:00:49.859302 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:00:49.859302 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:00:49.859302 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:00:49.859302 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:00:49.860215 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:00:49.860215 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:00:49.860215 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:00:49.860215 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:00:49.860215 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 01:00:49.860215 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 01:00:49.860215 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 01:00:49.860215 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 01:00:49.860215 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 01:00:49.860215 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 01:00:49.860215 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 01:00:49.860215 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Aug 30 01:00:49.860215 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 535/1052] 10.222.0.79 () {56 vars in 1096 bytes} [Tue Aug 30 01:00:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 01:00:49.868251 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ccafa9-bf8c-4a10-b31a-fdddb848563a None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:49.888608 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d63ae6-828e-4a48-8a72-700ce64edb5e None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:49.922390 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:49.936284 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba97951-749e-486e-aa05-aea0d910f3e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:49.936898 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba97951-749e-486e-aa05-aea0d910f3e4 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:49.937170 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba97951-749e-486e-aa05-aea0d910f3e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:49.937445 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba97951-749e-486e-aa05-aea0d910f3e4 None admin] PATH_INFO: `/v3/projects` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:49.938420 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba97951-749e-486e-aa05-aea0d910f3e4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:00:49.938734 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba97951-749e-486e-aa05-aea0d910f3e4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:49.940205 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba97951-749e-486e-aa05-aea0d910f3e4 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:49.954451 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 518/1053] 10.222.0.79 () {56 vars in 1148 bytes} [Tue Aug 30 01:00:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:00:49.963621 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba97951-749e-486e-aa05-aea0d910f3e4 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:50.012540 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ccafa9-bf8c-4a10-b31a-fdddb848563a None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:50.050616 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:50.074087 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80041db9-c7a3-4390-b7e8-fb1297e897da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:50.075041 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80041db9-c7a3-4390-b7e8-fb1297e897da None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:50.075513 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80041db9-c7a3-4390-b7e8-fb1297e897da None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:50.075952 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80041db9-c7a3-4390-b7e8-fb1297e897da None admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:50.077057 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80041db9-c7a3-4390-b7e8-fb1297e897da None admin] RBAC: Adding query filter params (name=admin) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:00:50.077565 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80041db9-c7a3-4390-b7e8-fb1297e897da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:50.080116 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80041db9-c7a3-4390-b7e8-fb1297e897da None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:50.093739 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 536/1054] 10.222.0.79 () {56 vars in 1099 bytes} [Tue Aug 30 01:00:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:00:50.100272 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80041db9-c7a3-4390-b7e8-fb1297e897da None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:50.109021 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba97951-749e-486e-aa05-aea0d910f3e4 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:50.155228 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b49f74-607a-4bc7-9574-e378f21de77a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:50.156277 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b49f74-607a-4bc7-9574-e378f21de77a None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:50.156778 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b49f74-607a-4bc7-9574-e378f21de77a None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:50.157272 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b49f74-607a-4bc7-9574-e378f21de77a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:50.158658 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b49f74-607a-4bc7-9574-e378f21de77a None admin] RBAC: Adding query filter params (role.id=3ff248f562e2493b8a0c8f21fe0a08a8, scope.project.id=0eec3a73673e45dc881de586b9b0fbbb, user.id=6480b2f14c37474c89df9fba48f7cd91) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:00:50.159242 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b49f74-607a-4bc7-9574-e378f21de77a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:50.161984 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b49f74-607a-4bc7-9574-e378f21de77a None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:50.172637 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 519/1055] 10.222.0.79 () {56 vars in 1374 bytes} [Tue Aug 30 01:00:49 2022] GET /identity/v3/role_assignments?user.id=6480b2f14c37474c89df9fba48f7cd91&scope.project.id=0eec3a73673e45dc881de586b9b0fbbb&role.id=3ff248f562e2493b8a0c8f21fe0a08a8 => generated 259 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:00:50.243281 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:50.248303 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80041db9-c7a3-4390-b7e8-fb1297e897da None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:50.309929 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5329e26-4e93-4cfa-8fd9-1bd72e3b3f91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:50.311053 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5329e26-4e93-4cfa-8fd9-1bd72e3b3f91 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:50.311584 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5329e26-4e93-4cfa-8fd9-1bd72e3b3f91 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:50.312034 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5329e26-4e93-4cfa-8fd9-1bd72e3b3f91 None admin] PATH_INFO: `/v3/users/53c5857c209f44718934df86ba6ed0a1` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:50.331179 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5329e26-4e93-4cfa-8fd9-1bd72e3b3f91 None admin] RBAC: Authorizing `identity:get_user(user_id=53c5857c209f44718934df86ba6ed0a1)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:50.332628 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5329e26-4e93-4cfa-8fd9-1bd72e3b3f91 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:50.334579 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 537/1056] 10.222.0.79 () {56 vars in 1177 bytes} [Tue Aug 30 01:00:50 2022] GET /identity/v3/users/53c5857c209f44718934df86ba6ed0a1 => generated 285 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:00:50.341154 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b49f74-607a-4bc7-9574-e378f21de77a None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:50.467817 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b49f74-607a-4bc7-9574-e378f21de77a None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:50.516531 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:50.528703 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748d9d5e-a393-463b-9d0f-80fd4517140a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:50.529336 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748d9d5e-a393-463b-9d0f-80fd4517140a None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:50.529615 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748d9d5e-a393-463b-9d0f-80fd4517140a None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:50.529884 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748d9d5e-a393-463b-9d0f-80fd4517140a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:50.610080 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748d9d5e-a393-463b-9d0f-80fd4517140a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:50.611665 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748d9d5e-a393-463b-9d0f-80fd4517140a None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:50.731193 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 520/1057] 10.222.0.79 () {58 vars in 1282 bytes} [Tue Aug 30 01:00:50 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 01:00:50.737019 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5329e26-4e93-4cfa-8fd9-1bd72e3b3f91 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:50.881503 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5329e26-4e93-4cfa-8fd9-1bd72e3b3f91 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:50.919010 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250f46c1-3b2f-410e-9067-0b08ab3bc42f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:50.919716 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250f46c1-3b2f-410e-9067-0b08ab3bc42f None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:50.919988 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250f46c1-3b2f-410e-9067-0b08ab3bc42f None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:50.920256 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250f46c1-3b2f-410e-9067-0b08ab3bc42f None admin] PATH_INFO: `/v3/projects/8555a66c304d4264a54e2b2f13dfb1f0` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:50.921533 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250f46c1-3b2f-410e-9067-0b08ab3bc42f None admin] RBAC: Authorizing `identity:get_project(project_id=8555a66c304d4264a54e2b2f13dfb1f0)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:50.922950 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250f46c1-3b2f-410e-9067-0b08ab3bc42f None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:50.925800 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 538/1058] 10.222.0.79 () {56 vars in 1186 bytes} [Tue Aug 30 01:00:50 2022] GET /identity/v3/projects/8555a66c304d4264a54e2b2f13dfb1f0 => generated 311 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:00:50.931613 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748d9d5e-a393-463b-9d0f-80fd4517140a None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:50.963784 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:51.051486 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748d9d5e-a393-463b-9d0f-80fd4517140a None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:51.096802 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb74e7fd-060b-4716-873c-2e53b669d17f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:51.097421 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb74e7fd-060b-4716-873c-2e53b669d17f None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:51.097696 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb74e7fd-060b-4716-873c-2e53b669d17f None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:51.097963 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb74e7fd-060b-4716-873c-2e53b669d17f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:51.098677 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb74e7fd-060b-4716-873c-2e53b669d17f None admin] RBAC: Adding query filter params (role.id=d14c3070c9184d76a7b23df69bd3db07, scope.project.id=8555a66c304d4264a54e2b2f13dfb1f0, user.id=53c5857c209f44718934df86ba6ed0a1) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:00:51.098974 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb74e7fd-060b-4716-873c-2e53b669d17f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:51.100417 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb74e7fd-060b-4716-873c-2e53b669d17f None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:51.107366 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 521/1059] 10.222.0.79 () {56 vars in 1374 bytes} [Tue Aug 30 01:00:50 2022] GET /identity/v3/role_assignments?user.id=53c5857c209f44718934df86ba6ed0a1&scope.project.id=8555a66c304d4264a54e2b2f13dfb1f0&role.id=d14c3070c9184d76a7b23df69bd3db07 => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:00:51.640568 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6540b71e-6ee4-4110-aa97-90d46e5ab9b8 None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:51.641075 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6540b71e-6ee4-4110-aa97-90d46e5ab9b8 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:51.641075 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6540b71e-6ee4-4110-aa97-90d46e5ab9b8 None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:51.642431 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 539/1060] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 01:00:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:00:51.647736 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347ea449-9084-4b62-a11e-fbd18f9d6c5d None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:51.649612 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347ea449-9084-4b62-a11e-fbd18f9d6c5d None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:51.649612 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347ea449-9084-4b62-a11e-fbd18f9d6c5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:51.669799 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-347ea449-9084-4b62-a11e-fbd18f9d6c5d None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:00:51.670983 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-347ea449-9084-4b62-a11e-fbd18f9d6c5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:00:51.746067 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 522/1061] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 01:00:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 01:00:52.022430 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6540b71e-6ee4-4110-aa97-90d46e5ab9b8 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:52.052599 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:52.132632 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6540b71e-6ee4-4110-aa97-90d46e5ab9b8 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:52.169829 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36afb951-0d48-4f0f-9f03-c460f77324d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:52.170437 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36afb951-0d48-4f0f-9f03-c460f77324d3 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:52.170714 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36afb951-0d48-4f0f-9f03-c460f77324d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:52.170979 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36afb951-0d48-4f0f-9f03-c460f77324d3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:52.249961 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadb4a9f-e39c-4458-8761-f7fc042ab763 None None] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:52.250409 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadb4a9f-e39c-4458-8761-f7fc042ab763 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:52.250833 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadb4a9f-e39c-4458-8761-f7fc042ab763 None None] PATH_INFO: `/` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:52.252945 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 523/1062] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 01:00:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 01:00:52.253925 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36afb951-0d48-4f0f-9f03-c460f77324d3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:52.255577 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36afb951-0d48-4f0f-9f03-c460f77324d3 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:52.259867 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390efe7f-9cd0-42ea-b106-79e80dd181e8 None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:52.260146 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390efe7f-9cd0-42ea-b106-79e80dd181e8 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:52.260556 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390efe7f-9cd0-42ea-b106-79e80dd181e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:52.280137 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-390efe7f-9cd0-42ea-b106-79e80dd181e8 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:00:52.281778 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-390efe7f-9cd0-42ea-b106-79e80dd181e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:00:52.288817 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:52.300747 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:52.373949 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 524/1063] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 01:00:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 01:00:52.385522 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 540/1064] 10.222.0.79 () {58 vars in 1282 bytes} [Tue Aug 30 01:00:52 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 30 01:00:52.391647 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390efe7f-9cd0-42ea-b106-79e80dd181e8 None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:52.495476 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390efe7f-9cd0-42ea-b106-79e80dd181e8 None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:52.530834 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5db490-d3fb-4441-8d5a-697e06a9cab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:52.531415 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5db490-d3fb-4441-8d5a-697e06a9cab2 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:52.531693 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5db490-d3fb-4441-8d5a-697e06a9cab2 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:52.531961 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5db490-d3fb-4441-8d5a-697e06a9cab2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:52.543686 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5db490-d3fb-4441-8d5a-697e06a9cab2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:52.546463 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5db490-d3fb-4441-8d5a-697e06a9cab2 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:52.575617 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application [None req-3a5db490-d3fb-4441-8d5a-697e06a9cab2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:00:52.575617 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:00:52.575617 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:00:52.575617 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:00:52.575617 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:00:52.575617 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:00:52.575617 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:00:52.575617 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:00:52.575617 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:00:52.575617 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:00:52.575617 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:00:52.575617 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:00:52.575617 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 01:00:52.575617 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 01:00:52.575617 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 01:00:52.575617 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 01:00:52.576638 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:00:52.576638 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:00:52.576638 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:00:52.576638 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:00:52.576638 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:00:52.576638 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:00:52.576638 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:00:52.576638 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application with Lock( Aug 30 01:00:52.576638 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:00:52.576638 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:00:52.576638 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:00:52.576638 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:00:52.576638 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:00:52.576638 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:00:52.576638 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:00:52.576638 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:00:52.576638 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 01:00:52.577565 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 01:00:52.577565 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:00:52.577565 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Aug 30 01:00:52.579454 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 525/1065] 10.222.0.79 () {56 vars in 1108 bytes} [Tue Aug 30 01:00:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:00:52.587379 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36afb951-0d48-4f0f-9f03-c460f77324d3 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:52.646268 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5db490-d3fb-4441-8d5a-697e06a9cab2 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:52.649192 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:52.724061 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36afb951-0d48-4f0f-9f03-c460f77324d3 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:52.756344 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:52.774638 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94efa836-ffc9-45ad-ae7c-1f25fb155833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:52.776185 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94efa836-ffc9-45ad-ae7c-1f25fb155833 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:52.776920 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94efa836-ffc9-45ad-ae7c-1f25fb155833 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:52.778200 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94efa836-ffc9-45ad-ae7c-1f25fb155833 None admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:52.779965 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94efa836-ffc9-45ad-ae7c-1f25fb155833 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:00:52.780762 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94efa836-ffc9-45ad-ae7c-1f25fb155833 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:52.783748 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94efa836-ffc9-45ad-ae7c-1f25fb155833 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:52.793151 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5db490-d3fb-4441-8d5a-697e06a9cab2 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:52.802624 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 541/1066] 10.222.0.79 () {56 vars in 1109 bytes} [Tue Aug 30 01:00:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:00:52.844827 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4af70e-1b70-4e26-8cbf-00dd14faa954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:52.845481 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4af70e-1b70-4e26-8cbf-00dd14faa954 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:52.845756 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4af70e-1b70-4e26-8cbf-00dd14faa954 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:52.846024 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4af70e-1b70-4e26-8cbf-00dd14faa954 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:52.859248 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4af70e-1b70-4e26-8cbf-00dd14faa954 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 01:00:52.864238 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application [None req-2a4af70e-1b70-4e26-8cbf-00dd14faa954 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 01:00:52.864238 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:00:52.864238 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:00:52.864238 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:00:52.864238 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:00:52.864238 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:00:52.864238 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:00:52.864238 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:00:52.864238 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:00:52.864238 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:00:52.864238 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:00:52.864238 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:00:52.864238 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 01:00:52.864238 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 01:00:52.864238 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 01:00:52.864238 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 01:00:52.865294 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 01:00:52.865294 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 01:00:52.865294 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 01:00:52.865294 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 01:00:52.865294 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:00:52.865294 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:00:52.865294 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:00:52.865294 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:00:52.865294 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:00:52.865294 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:00:52.865294 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:00:52.865294 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application with Lock( Aug 30 01:00:52.865294 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:00:52.865294 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:00:52.865294 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:00:52.865294 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:00:52.866163 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:00:52.866163 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:00:52.866163 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:00:52.866163 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:00:52.866163 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 01:00:52.866163 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 01:00:52.866163 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 01:00:52.866163 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 01:00:52.866163 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 01:00:52.866163 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 01:00:52.866163 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 01:00:52.866163 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Aug 30 01:00:52.866163 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 526/1067] 10.222.0.79 () {56 vars in 1120 bytes} [Tue Aug 30 01:00:52 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 01:00:52.875845 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94efa836-ffc9-45ad-ae7c-1f25fb155833 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:53.010421 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94efa836-ffc9-45ad-ae7c-1f25fb155833 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:53.054947 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe01050-4843-4555-9e24-91b0039d2a5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:53.055633 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe01050-4843-4555-9e24-91b0039d2a5b None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:53.055916 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe01050-4843-4555-9e24-91b0039d2a5b None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:53.056188 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe01050-4843-4555-9e24-91b0039d2a5b None admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:53.056880 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe01050-4843-4555-9e24-91b0039d2a5b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:00:53.057183 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe01050-4843-4555-9e24-91b0039d2a5b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:53.059072 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe01050-4843-4555-9e24-91b0039d2a5b None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:53.069685 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 542/1068] 10.222.0.79 () {56 vars in 1115 bytes} [Tue Aug 30 01:00:52 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:00:53.076192 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4af70e-1b70-4e26-8cbf-00dd14faa954 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:53.158895 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:53.212930 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96548ed0-f962-46d1-9f7e-ab54f38c8e5e None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:53.213204 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96548ed0-f962-46d1-9f7e-ab54f38c8e5e None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:53.213473 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96548ed0-f962-46d1-9f7e-ab54f38c8e5e None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:53.214960 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 543/1069] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 01:00:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 01:00:53.220316 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecd3280-a653-4467-8343-844671d4721b None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:53.220649 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecd3280-a653-4467-8343-844671d4721b None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:53.220948 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecd3280-a653-4467-8343-844671d4721b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:53.229183 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4af70e-1b70-4e26-8cbf-00dd14faa954 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:53.241079 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-aecd3280-a653-4467-8343-844671d4721b None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:00:53.242275 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-aecd3280-a653-4467-8343-844671d4721b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:00:53.268656 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950f357a-c9a8-4a76-a05d-00dc216f1d7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:53.269282 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950f357a-c9a8-4a76-a05d-00dc216f1d7c None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:53.269558 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950f357a-c9a8-4a76-a05d-00dc216f1d7c None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:53.269826 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950f357a-c9a8-4a76-a05d-00dc216f1d7c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:53.281039 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950f357a-c9a8-4a76-a05d-00dc216f1d7c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:53.282496 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950f357a-c9a8-4a76-a05d-00dc216f1d7c None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:53.289364 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:53.298560 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application [None req-950f357a-c9a8-4a76-a05d-00dc216f1d7c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:00:53.298560 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:00:53.298560 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:00:53.298560 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:00:53.298560 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:00:53.298560 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:00:53.298560 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:00:53.298560 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:00:53.298560 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:00:53.298560 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:00:53.298560 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:00:53.298560 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:00:53.298560 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 01:00:53.298560 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 01:00:53.298560 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 01:00:53.298560 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 01:00:53.299962 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:00:53.299962 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:00:53.299962 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:00:53.299962 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:00:53.299962 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:00:53.299962 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:00:53.299962 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:00:53.299962 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application with Lock( Aug 30 01:00:53.299962 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:00:53.299962 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:00:53.299962 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:00:53.299962 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:00:53.299962 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:00:53.299962 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:00:53.299962 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:00:53.299962 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:00:53.299962 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 01:00:53.301677 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 01:00:53.301677 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:00:53.301677 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Aug 30 01:00:53.301677 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 527/1070] 10.222.0.79 () {56 vars in 1108 bytes} [Tue Aug 30 01:00:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:00:53.306967 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950f357a-c9a8-4a76-a05d-00dc216f1d7c None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:53.324401 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 544/1071] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 01:00:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 01:00:53.467922 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950f357a-c9a8-4a76-a05d-00dc216f1d7c None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:53.493311 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:53.527700 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1896e9-e04f-4109-9d71-3508b7498f50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:53.528700 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1896e9-e04f-4109-9d71-3508b7498f50 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:53.529185 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1896e9-e04f-4109-9d71-3508b7498f50 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:53.529661 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1896e9-e04f-4109-9d71-3508b7498f50 None admin] PATH_INFO: `/v3/domains` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:53.530792 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1896e9-e04f-4109-9d71-3508b7498f50 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:00:53.531344 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1896e9-e04f-4109-9d71-3508b7498f50 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:53.533815 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1896e9-e04f-4109-9d71-3508b7498f50 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:53.560448 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 528/1072] 10.222.0.79 () {56 vars in 1109 bytes} [Tue Aug 30 01:00:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:00:53.561694 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecd3280-a653-4467-8343-844671d4721b None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:53.672926 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecd3280-a653-4467-8343-844671d4721b None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:53.701174 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1896e9-e04f-4109-9d71-3508b7498f50 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:53.709375 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d0f1fb-e415-4171-b445-8f19b2f472ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:53.710025 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d0f1fb-e415-4171-b445-8f19b2f472ef None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:53.710320 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d0f1fb-e415-4171-b445-8f19b2f472ef None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:53.710591 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d0f1fb-e415-4171-b445-8f19b2f472ef None admin] PATH_INFO: `/v3/users/nova` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:53.719494 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d0f1fb-e415-4171-b445-8f19b2f472ef None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:53.720996 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d0f1fb-e415-4171-b445-8f19b2f472ef None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:53.734743 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-65d0f1fb-e415-4171-b445-8f19b2f472ef None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 30 01:00:53.734743 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:00:53.734743 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:00:53.734743 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:00:53.734743 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:00:53.734743 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:00:53.734743 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:00:53.734743 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:00:53.734743 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:00:53.734743 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:00:53.734743 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:00:53.734743 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:00:53.734743 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 01:00:53.734743 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 01:00:53.734743 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 01:00:53.734743 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 01:00:53.736648 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:00:53.736648 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:00:53.736648 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 01:00:53.736648 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 01:00:53.736648 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 01:00:53.736648 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 01:00:53.736648 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:00:53.736648 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:00:53.736648 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:00:53.736648 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:00:53.736648 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:00:53.736648 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Aug 30 01:00:53.736648 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:00:53.736648 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:00:53.736648 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:00:53.736648 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:00:53.736648 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:00:53.736648 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:00:53.737850 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:00:53.737850 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:00:53.737850 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 01:00:53.737850 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 01:00:53.737850 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 01:00:53.737850 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 01:00:53.737850 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 01:00:53.737850 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 01:00:53.737850 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 30 01:00:53.737850 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Aug 30 01:00:53.737850 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 545/1073] 10.222.0.79 () {56 vars in 1093 bytes} [Tue Aug 30 01:00:53 2022] GET /identity/v3/users/nova => generated 82 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:00:53.741789 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d0f1fb-e415-4171-b445-8f19b2f472ef None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:53.784150 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:53.831368 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1896e9-e04f-4109-9d71-3508b7498f50 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:53.853926 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d0f1fb-e415-4171-b445-8f19b2f472ef None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:53.872974 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9684b5-56b0-491d-8547-bb90f4a0357b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:53.873604 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9684b5-56b0-491d-8547-bb90f4a0357b None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:53.873877 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9684b5-56b0-491d-8547-bb90f4a0357b None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:53.874143 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9684b5-56b0-491d-8547-bb90f4a0357b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:53.884778 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9684b5-56b0-491d-8547-bb90f4a0357b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 01:00:53.889846 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application [None req-9d9684b5-56b0-491d-8547-bb90f4a0357b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 01:00:53.889846 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:00:53.889846 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:00:53.889846 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:00:53.889846 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:00:53.889846 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:00:53.889846 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:00:53.889846 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:00:53.889846 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:00:53.889846 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:00:53.889846 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:00:53.889846 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:00:53.889846 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 01:00:53.889846 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 01:00:53.889846 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 01:00:53.889846 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 01:00:53.890852 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 01:00:53.890852 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 01:00:53.890852 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 01:00:53.890852 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 01:00:53.890852 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:00:53.890852 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:00:53.890852 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:00:53.890852 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:00:53.890852 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:00:53.890852 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:00:53.890852 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:00:53.890852 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application with Lock( Aug 30 01:00:53.890852 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:00:53.890852 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:00:53.890852 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:00:53.890852 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:00:53.892002 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:00:53.892002 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:00:53.892002 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:00:53.892002 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:00:53.892002 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 01:00:53.892002 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 01:00:53.892002 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 01:00:53.892002 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 01:00:53.892002 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 01:00:53.892002 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 01:00:53.892002 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 01:00:53.892002 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Aug 30 01:00:53.893125 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31376d6-7238-46cc-9e3d-9a56d22e5463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:53.893125 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31376d6-7238-46cc-9e3d-9a56d22e5463 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:53.893294 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 529/1074] 10.222.0.79 () {56 vars in 1096 bytes} [Tue Aug 30 01:00:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 01:00:53.893363 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31376d6-7238-46cc-9e3d-9a56d22e5463 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:53.893363 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31376d6-7238-46cc-9e3d-9a56d22e5463 None admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:53.893363 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31376d6-7238-46cc-9e3d-9a56d22e5463 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:00:53.893363 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31376d6-7238-46cc-9e3d-9a56d22e5463 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:53.893848 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31376d6-7238-46cc-9e3d-9a56d22e5463 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:53.897031 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9684b5-56b0-491d-8547-bb90f4a0357b None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:53.913710 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 546/1075] 10.222.0.79 () {56 vars in 1133 bytes} [Tue Aug 30 01:00:53 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:00:53.920021 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31376d6-7238-46cc-9e3d-9a56d22e5463 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:53.938185 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:54.010446 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9684b5-56b0-491d-8547-bb90f4a0357b None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:54.020193 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:54.028333 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31376d6-7238-46cc-9e3d-9a56d22e5463 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:54.050257 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0249a30-54e9-4ba8-a68c-8c0a8b36e429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:54.050886 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0249a30-54e9-4ba8-a68c-8c0a8b36e429 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:54.051194 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0249a30-54e9-4ba8-a68c-8c0a8b36e429 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:54.051466 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0249a30-54e9-4ba8-a68c-8c0a8b36e429 None admin] PATH_INFO: `/v3/roles` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:54.052147 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0249a30-54e9-4ba8-a68c-8c0a8b36e429 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:00:54.052446 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0249a30-54e9-4ba8-a68c-8c0a8b36e429 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:54.053876 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0249a30-54e9-4ba8-a68c-8c0a8b36e429 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:54.064456 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 530/1076] 10.222.0.79 () {56 vars in 1099 bytes} [Tue Aug 30 01:00:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:00:54.070965 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0249a30-54e9-4ba8-a68c-8c0a8b36e429 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:54.073699 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dcbcc4-527d-45e3-a695-5a3f5c84ff67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:54.074909 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dcbcc4-527d-45e3-a695-5a3f5c84ff67 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:54.075209 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dcbcc4-527d-45e3-a695-5a3f5c84ff67 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:54.075639 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dcbcc4-527d-45e3-a695-5a3f5c84ff67 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:54.087025 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dcbcc4-527d-45e3-a695-5a3f5c84ff67 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:54.089686 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dcbcc4-527d-45e3-a695-5a3f5c84ff67 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:54.128001 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-b4dcbcc4-527d-45e3-a695-5a3f5c84ff67 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:00:54.128001 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:00:54.128001 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:00:54.128001 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:00:54.128001 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:00:54.128001 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:00:54.128001 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:00:54.128001 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:00:54.128001 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:00:54.128001 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:00:54.128001 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:00:54.128001 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:00:54.128001 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 01:00:54.128001 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 01:00:54.128001 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 01:00:54.128001 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 01:00:54.129955 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:00:54.129955 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:00:54.129955 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:00:54.129955 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:00:54.129955 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:00:54.129955 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:00:54.129955 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:00:54.129955 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Aug 30 01:00:54.129955 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:00:54.129955 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:00:54.129955 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:00:54.129955 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:00:54.129955 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:00:54.129955 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:00:54.129955 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:00:54.129955 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:00:54.129955 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 01:00:54.132030 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 01:00:54.132030 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:00:54.132030 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Aug 30 01:00:54.132030 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 547/1077] 10.222.0.79 () {56 vars in 1108 bytes} [Tue Aug 30 01:00:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 01:00:54.134987 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dcbcc4-527d-45e3-a695-5a3f5c84ff67 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:54.173636 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:54.180630 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0249a30-54e9-4ba8-a68c-8c0a8b36e429 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:54.218766 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa5ea00-35d1-4a36-8d73-29e6c47bda08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:54.219419 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa5ea00-35d1-4a36-8d73-29e6c47bda08 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:54.219693 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa5ea00-35d1-4a36-8d73-29e6c47bda08 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:54.219959 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa5ea00-35d1-4a36-8d73-29e6c47bda08 None admin] PATH_INFO: `/v3/users/53c5857c209f44718934df86ba6ed0a1` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:54.221183 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa5ea00-35d1-4a36-8d73-29e6c47bda08 None admin] RBAC: Authorizing `identity:get_user(user_id=53c5857c209f44718934df86ba6ed0a1)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:54.222600 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa5ea00-35d1-4a36-8d73-29e6c47bda08 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:54.224218 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 531/1078] 10.222.0.79 () {56 vars in 1177 bytes} [Tue Aug 30 01:00:54 2022] GET /identity/v3/users/53c5857c209f44718934df86ba6ed0a1 => generated 285 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:00:54.233912 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa5ea00-35d1-4a36-8d73-29e6c47bda08 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:54.253167 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dcbcc4-527d-45e3-a695-5a3f5c84ff67 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:54.292112 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22fea50-043c-4cba-a608-32699c2bbcf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:54.292907 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22fea50-043c-4cba-a608-32699c2bbcf2 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:54.293258 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22fea50-043c-4cba-a608-32699c2bbcf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:54.293668 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22fea50-043c-4cba-a608-32699c2bbcf2 None admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:54.294788 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22fea50-043c-4cba-a608-32699c2bbcf2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:00:54.295366 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22fea50-043c-4cba-a608-32699c2bbcf2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:54.297878 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22fea50-043c-4cba-a608-32699c2bbcf2 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:54.311617 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 548/1079] 10.222.0.79 () {56 vars in 1109 bytes} [Tue Aug 30 01:00:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:00:54.319186 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22fea50-043c-4cba-a608-32699c2bbcf2 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:54.338045 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:54.354858 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa5ea00-35d1-4a36-8d73-29e6c47bda08 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:54.396378 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e24d7f-3671-449b-9b29-f653855a4568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:54.397012 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e24d7f-3671-449b-9b29-f653855a4568 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:54.397377 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e24d7f-3671-449b-9b29-f653855a4568 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:54.397569 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e24d7f-3671-449b-9b29-f653855a4568 None admin] PATH_INFO: `/v3/projects/8555a66c304d4264a54e2b2f13dfb1f0` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:54.398667 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e24d7f-3671-449b-9b29-f653855a4568 None admin] RBAC: Authorizing `identity:get_project(project_id=8555a66c304d4264a54e2b2f13dfb1f0)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:54.400199 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e24d7f-3671-449b-9b29-f653855a4568 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:54.403334 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 532/1080] 10.222.0.79 () {56 vars in 1186 bytes} [Tue Aug 30 01:00:54 2022] GET /identity/v3/projects/8555a66c304d4264a54e2b2f13dfb1f0 => generated 311 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:00:54.408814 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e24d7f-3671-449b-9b29-f653855a4568 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:54.448436 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:54.483804 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22fea50-043c-4cba-a608-32699c2bbcf2 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:54.534483 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07533fe7-f00d-42a8-be46-1a5630b78325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:54.535506 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07533fe7-f00d-42a8-be46-1a5630b78325 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:54.535957 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07533fe7-f00d-42a8-be46-1a5630b78325 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:54.536417 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07533fe7-f00d-42a8-be46-1a5630b78325 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:54.545086 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e24d7f-3671-449b-9b29-f653855a4568 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:54.547351 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07533fe7-f00d-42a8-be46-1a5630b78325 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:54.549719 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07533fe7-f00d-42a8-be46-1a5630b78325 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:54.571026 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-07533fe7-f00d-42a8-be46-1a5630b78325 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 01:00:54.571026 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:00:54.571026 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:00:54.571026 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:00:54.571026 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:00:54.571026 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:00:54.571026 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:00:54.571026 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:00:54.571026 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:00:54.571026 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:00:54.571026 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:00:54.571026 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:00:54.571026 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 01:00:54.571026 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 01:00:54.571026 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 01:00:54.573028 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 01:00:54.573028 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:00:54.573028 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:00:54.573028 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:00:54.573028 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:00:54.573028 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:00:54.573028 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:00:54.573028 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:00:54.573028 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Aug 30 01:00:54.573028 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:00:54.573028 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:00:54.573028 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:00:54.573028 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:00:54.573028 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:00:54.573028 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:00:54.573028 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:00:54.573028 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:00:54.575649 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 01:00:54.575649 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 01:00:54.575649 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 01:00:54.575649 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 01:00:54.575649 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 01:00:54.575649 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 01:00:54.575649 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 01:00:54.575649 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Aug 30 01:00:54.581202 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 549/1081] 10.222.0.79 () {56 vars in 1111 bytes} [Tue Aug 30 01:00:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 01:00:54.582649 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07533fe7-f00d-42a8-be46-1a5630b78325 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:54.603028 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3cb660-88b8-4671-ae63-1419b9ee32c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:54.603632 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3cb660-88b8-4671-ae63-1419b9ee32c8 None admin] REQUEST_METHOD: `PUT` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:54.603893 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3cb660-88b8-4671-ae63-1419b9ee32c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:54.604160 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3cb660-88b8-4671-ae63-1419b9ee32c8 None admin] PATH_INFO: `/v3/projects/8555a66c304d4264a54e2b2f13dfb1f0/users/53c5857c209f44718934df86ba6ed0a1/roles/d14c3070c9184d76a7b23df69bd3db07` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:54.606306 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3cb660-88b8-4671-ae63-1419b9ee32c8 None admin] RBAC: Authorizing `identity:create_grant(project_id=8555a66c304d4264a54e2b2f13dfb1f0, user_id=53c5857c209f44718934df86ba6ed0a1, role_id=d14c3070c9184d76a7b23df69bd3db07)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:54.607792 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3cb660-88b8-4671-ae63-1419b9ee32c8 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:54.631631 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 533/1082] 10.222.0.79 () {58 vars in 1439 bytes} [Tue Aug 30 01:00:54 2022] PUT /identity/v3/projects/8555a66c304d4264a54e2b2f13dfb1f0/users/53c5857c209f44718934df86ba6ed0a1/roles/d14c3070c9184d76a7b23df69bd3db07 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:00:54.674238 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:54.720533 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07533fe7-f00d-42a8-be46-1a5630b78325 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:54.766519 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b956bac-7f02-4e53-b7b0-2128aeff0c24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:54.767467 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b956bac-7f02-4e53-b7b0-2128aeff0c24 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:54.767878 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b956bac-7f02-4e53-b7b0-2128aeff0c24 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:54.768281 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b956bac-7f02-4e53-b7b0-2128aeff0c24 None admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:54.769357 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b956bac-7f02-4e53-b7b0-2128aeff0c24 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:00:54.769824 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b956bac-7f02-4e53-b7b0-2128aeff0c24 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:54.772475 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b956bac-7f02-4e53-b7b0-2128aeff0c24 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:54.787238 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 550/1083] 10.222.0.79 () {56 vars in 1148 bytes} [Tue Aug 30 01:00:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:00:54.794291 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3cb660-88b8-4671-ae63-1419b9ee32c8 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:54.896232 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:54.907575 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3cb660-88b8-4671-ae63-1419b9ee32c8 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:54.946168 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c23be78-f2a9-4076-9336-563394cdede8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:54.946833 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c23be78-f2a9-4076-9336-563394cdede8 None admin] REQUEST_METHOD: `PUT` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:54.947107 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c23be78-f2a9-4076-9336-563394cdede8 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:54.947399 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c23be78-f2a9-4076-9336-563394cdede8 None admin] PATH_INFO: `/v3/projects/0eec3a73673e45dc881de586b9b0fbbb/users/6480b2f14c37474c89df9fba48f7cd91/roles/3ff248f562e2493b8a0c8f21fe0a08a8` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:54.950049 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c23be78-f2a9-4076-9336-563394cdede8 None admin] RBAC: Authorizing `identity:create_grant(project_id=0eec3a73673e45dc881de586b9b0fbbb, user_id=6480b2f14c37474c89df9fba48f7cd91, role_id=3ff248f562e2493b8a0c8f21fe0a08a8)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:54.951530 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c23be78-f2a9-4076-9336-563394cdede8 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:54.967268 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 534/1084] 10.222.0.79 () {58 vars in 1439 bytes} [Tue Aug 30 01:00:54 2022] PUT /identity/v3/projects/0eec3a73673e45dc881de586b9b0fbbb/users/6480b2f14c37474c89df9fba48f7cd91/roles/3ff248f562e2493b8a0c8f21fe0a08a8 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:00:57.594895 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dedc08-aaf4-41c3-958c-1fca72917aff None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:57.595464 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dedc08-aaf4-41c3-958c-1fca72917aff None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:57.595765 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dedc08-aaf4-41c3-958c-1fca72917aff None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:57.598310 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 551/1085] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 01:00:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:00:57.603770 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7d07a4-c14d-4084-a22d-990b3ff4c8b3 None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:57.604265 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7d07a4-c14d-4084-a22d-990b3ff4c8b3 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:57.604426 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7d07a4-c14d-4084-a22d-990b3ff4c8b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:57.625194 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-3f7d07a4-c14d-4084-a22d-990b3ff4c8b3 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:00:57.626388 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-3f7d07a4-c14d-4084-a22d-990b3ff4c8b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:00:57.701073 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 535/1086] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 01:00:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 01:00:57.878148 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9a7018-090c-468f-a43c-69a9e6fa4a0c None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:57.878582 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9a7018-090c-468f-a43c-69a9e6fa4a0c None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:57.879000 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9a7018-090c-468f-a43c-69a9e6fa4a0c None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:57.880544 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 552/1087] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 01:00:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:00:57.886866 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0560b14-ecb0-431e-9445-d4f1a7678738 None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:57.887369 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0560b14-ecb0-431e-9445-d4f1a7678738 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:57.887932 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0560b14-ecb0-431e-9445-d4f1a7678738 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:57.907445 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-a0560b14-ecb0-431e-9445-d4f1a7678738 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:00:57.908654 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-a0560b14-ecb0-431e-9445-d4f1a7678738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:00:57.976929 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9a7018-090c-468f-a43c-69a9e6fa4a0c None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:57.984912 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 536/1088] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 01:00:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 01:00:58.090595 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9a7018-090c-468f-a43c-69a9e6fa4a0c None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:58.117988 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:58.127565 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c2418b-904e-4408-b85d-aa12bc969b89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:58.128253 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c2418b-904e-4408-b85d-aa12bc969b89 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:58.129499 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c2418b-904e-4408-b85d-aa12bc969b89 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:58.129768 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c2418b-904e-4408-b85d-aa12bc969b89 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:58.142913 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c2418b-904e-4408-b85d-aa12bc969b89 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 01:00:58.147880 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-80c2418b-904e-4408-b85d-aa12bc969b89 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 01:00:58.147880 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:00:58.147880 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:00:58.147880 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:00:58.147880 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:00:58.147880 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:00:58.147880 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:00:58.147880 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:00:58.147880 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:00:58.147880 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:00:58.147880 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:00:58.147880 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:00:58.147880 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 01:00:58.147880 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 01:00:58.147880 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 01:00:58.147880 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 01:00:58.148910 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 01:00:58.148910 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 01:00:58.148910 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 01:00:58.148910 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 01:00:58.148910 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:00:58.148910 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:00:58.148910 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:00:58.148910 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:00:58.148910 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:00:58.148910 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:00:58.148910 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:00:58.148910 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Aug 30 01:00:58.148910 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:00:58.148910 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:00:58.148910 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:00:58.148910 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:00:58.149769 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:00:58.149769 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:00:58.149769 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:00:58.149769 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:00:58.149769 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 01:00:58.149769 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 01:00:58.149769 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 01:00:58.149769 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 01:00:58.149769 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 01:00:58.149769 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 01:00:58.149769 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 01:00:58.149769 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Aug 30 01:00:58.149769 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 553/1089] 10.222.0.79 () {56 vars in 1096 bytes} [Tue Aug 30 01:00:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 01:00:58.155753 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0560b14-ecb0-431e-9445-d4f1a7678738 None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:58.171394 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:58.276335 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0560b14-ecb0-431e-9445-d4f1a7678738 None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:58.290432 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c2418b-904e-4408-b85d-aa12bc969b89 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:58.326114 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a30a89-5850-48a6-8006-7c25dbf01f1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:58.327191 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a30a89-5850-48a6-8006-7c25dbf01f1d None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:58.327634 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a30a89-5850-48a6-8006-7c25dbf01f1d None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:58.328117 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a30a89-5850-48a6-8006-7c25dbf01f1d None admin] PATH_INFO: `/v3/roles` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:58.329343 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a30a89-5850-48a6-8006-7c25dbf01f1d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:00:58.329872 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a30a89-5850-48a6-8006-7c25dbf01f1d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:58.332481 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a30a89-5850-48a6-8006-7c25dbf01f1d None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:58.345639 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 537/1090] 10.222.0.79 () {56 vars in 1099 bytes} [Tue Aug 30 01:00:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:00:58.351963 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a30a89-5850-48a6-8006-7c25dbf01f1d None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:58.400297 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c2418b-904e-4408-b85d-aa12bc969b89 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:58.437407 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:58.439790 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753a6033-8ef3-4fe7-a27b-5c6e11cb2ed8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:58.440435 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753a6033-8ef3-4fe7-a27b-5c6e11cb2ed8 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:58.440710 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753a6033-8ef3-4fe7-a27b-5c6e11cb2ed8 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:58.440982 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753a6033-8ef3-4fe7-a27b-5c6e11cb2ed8 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:58.454745 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753a6033-8ef3-4fe7-a27b-5c6e11cb2ed8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 01:00:58.459830 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-753a6033-8ef3-4fe7-a27b-5c6e11cb2ed8 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 01:00:58.459830 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:00:58.459830 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:00:58.459830 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:00:58.459830 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:00:58.459830 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:00:58.459830 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:00:58.459830 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:00:58.459830 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:00:58.459830 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:00:58.459830 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:00:58.459830 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:00:58.459830 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 01:00:58.459830 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 01:00:58.459830 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 01:00:58.459830 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 01:00:58.461472 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 01:00:58.461472 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 01:00:58.461472 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 01:00:58.461472 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 01:00:58.461472 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:00:58.461472 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:00:58.461472 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:00:58.461472 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:00:58.461472 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:00:58.461472 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:00:58.461472 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:00:58.461472 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Aug 30 01:00:58.461472 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:00:58.461472 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:00:58.461472 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:00:58.461472 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:00:58.462384 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:00:58.462384 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:00:58.462384 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:00:58.462384 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:00:58.462384 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 01:00:58.462384 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 01:00:58.462384 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 01:00:58.462384 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 01:00:58.462384 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 01:00:58.462384 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 01:00:58.462384 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 01:00:58.462384 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Aug 30 01:00:58.462384 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 554/1091] 10.222.0.79 () {56 vars in 1120 bytes} [Tue Aug 30 01:00:58 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:00:58.471061 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753a6033-8ef3-4fe7-a27b-5c6e11cb2ed8 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:58.479044 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a30a89-5850-48a6-8006-7c25dbf01f1d None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:58.518727 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b73703-865b-46b6-a216-46ea6436ac5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:58.519506 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b73703-865b-46b6-a216-46ea6436ac5c None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:58.519785 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b73703-865b-46b6-a216-46ea6436ac5c None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:58.520054 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b73703-865b-46b6-a216-46ea6436ac5c None admin] PATH_INFO: `/v3/users/53c5857c209f44718934df86ba6ed0a1` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:58.521303 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b73703-865b-46b6-a216-46ea6436ac5c None admin] RBAC: Authorizing `identity:get_user(user_id=53c5857c209f44718934df86ba6ed0a1)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:58.522757 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b73703-865b-46b6-a216-46ea6436ac5c None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:58.524452 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 538/1092] 10.222.0.79 () {56 vars in 1177 bytes} [Tue Aug 30 01:00:58 2022] GET /identity/v3/users/53c5857c209f44718934df86ba6ed0a1 => generated 285 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:00:58.530886 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b73703-865b-46b6-a216-46ea6436ac5c None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:58.556970 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:58.615863 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753a6033-8ef3-4fe7-a27b-5c6e11cb2ed8 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:58.642174 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b73703-865b-46b6-a216-46ea6436ac5c None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:58.655607 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e7092d-c98d-4ffe-a528-23957a96ccb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:58.656356 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e7092d-c98d-4ffe-a528-23957a96ccb5 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:58.656726 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e7092d-c98d-4ffe-a528-23957a96ccb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:58.657140 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e7092d-c98d-4ffe-a528-23957a96ccb5 None admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:58.658041 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e7092d-c98d-4ffe-a528-23957a96ccb5 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:00:58.658436 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e7092d-c98d-4ffe-a528-23957a96ccb5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:58.660041 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e7092d-c98d-4ffe-a528-23957a96ccb5 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:58.670544 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 555/1093] 10.222.0.79 () {56 vars in 1115 bytes} [Tue Aug 30 01:00:58 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:00:58.676905 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e7092d-c98d-4ffe-a528-23957a96ccb5 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:58.679872 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ee0798-9fc4-4226-a21e-aa4b9ed923f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:58.680488 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ee0798-9fc4-4226-a21e-aa4b9ed923f4 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:58.680774 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ee0798-9fc4-4226-a21e-aa4b9ed923f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:58.681033 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ee0798-9fc4-4226-a21e-aa4b9ed923f4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:58.695195 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:58.759222 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ee0798-9fc4-4226-a21e-aa4b9ed923f4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:58.760673 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ee0798-9fc4-4226-a21e-aa4b9ed923f4 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:58.792182 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e7092d-c98d-4ffe-a528-23957a96ccb5 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:58.803793 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:58.829649 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e51a1a-ac96-48ab-8d46-6108ade22761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:58.830336 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e51a1a-ac96-48ab-8d46-6108ade22761 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:58.830606 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e51a1a-ac96-48ab-8d46-6108ade22761 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:58.830900 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e51a1a-ac96-48ab-8d46-6108ade22761 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:58.843003 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e51a1a-ac96-48ab-8d46-6108ade22761 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:58.844503 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e51a1a-ac96-48ab-8d46-6108ade22761 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:58.860539 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-c3e51a1a-ac96-48ab-8d46-6108ade22761 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:00:58.860539 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:00:58.860539 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:00:58.860539 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:00:58.860539 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:00:58.860539 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:00:58.860539 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:00:58.860539 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:00:58.860539 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:00:58.860539 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:00:58.860539 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:00:58.860539 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:00:58.860539 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 01:00:58.860539 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 01:00:58.860539 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 01:00:58.860539 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 01:00:58.862580 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:00:58.862580 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:00:58.862580 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:00:58.862580 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:00:58.862580 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:00:58.862580 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:00:58.862580 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:00:58.862580 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Aug 30 01:00:58.862580 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:00:58.862580 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:00:58.862580 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:00:58.862580 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:00:58.862580 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:00:58.862580 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:00:58.862580 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:00:58.862580 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:00:58.862580 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 01:00:58.864399 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 01:00:58.864399 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:00:58.864399 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Aug 30 01:00:58.864399 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 556/1094] 10.222.0.79 () {56 vars in 1108 bytes} [Tue Aug 30 01:00:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 01:00:58.869875 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 539/1095] 10.222.0.79 () {58 vars in 1282 bytes} [Tue Aug 30 01:00:58 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 30 01:00:58.870589 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e51a1a-ac96-48ab-8d46-6108ade22761 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:58.876196 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ee0798-9fc4-4226-a21e-aa4b9ed923f4 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:58.927504 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:58.987143 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e51a1a-ac96-48ab-8d46-6108ade22761 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:58.997610 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ee0798-9fc4-4226-a21e-aa4b9ed923f4 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:59.022287 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff467b07-3b5e-4c95-9ad2-d4df9b5ad78a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:59.022904 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff467b07-3b5e-4c95-9ad2-d4df9b5ad78a None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:59.023207 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff467b07-3b5e-4c95-9ad2-d4df9b5ad78a None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:59.023481 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff467b07-3b5e-4c95-9ad2-d4df9b5ad78a None admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:59.024132 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff467b07-3b5e-4c95-9ad2-d4df9b5ad78a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:00:59.024435 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff467b07-3b5e-4c95-9ad2-d4df9b5ad78a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:59.025824 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff467b07-3b5e-4c95-9ad2-d4df9b5ad78a None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:59.035025 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bee8553-e0e1-45ad-a8c8-8911ede09e2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:59.035730 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bee8553-e0e1-45ad-a8c8-8911ede09e2f None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:59.036002 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bee8553-e0e1-45ad-a8c8-8911ede09e2f None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:59.036294 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bee8553-e0e1-45ad-a8c8-8911ede09e2f None admin] PATH_INFO: `/v3/projects/8555a66c304d4264a54e2b2f13dfb1f0` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:59.037440 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bee8553-e0e1-45ad-a8c8-8911ede09e2f None admin] RBAC: Authorizing `identity:get_project(project_id=8555a66c304d4264a54e2b2f13dfb1f0)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:59.038862 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bee8553-e0e1-45ad-a8c8-8911ede09e2f None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:59.039608 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 557/1096] 10.222.0.79 () {56 vars in 1109 bytes} [Tue Aug 30 01:00:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:00:59.040536 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 540/1097] 10.222.0.79 () {56 vars in 1186 bytes} [Tue Aug 30 01:00:58 2022] GET /identity/v3/projects/8555a66c304d4264a54e2b2f13dfb1f0 => generated 311 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:00:59.047213 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff467b07-3b5e-4c95-9ad2-d4df9b5ad78a None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:59.049514 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bee8553-e0e1-45ad-a8c8-8911ede09e2f None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:59.076671 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:59.158559 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bee8553-e0e1-45ad-a8c8-8911ede09e2f None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:59.164324 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff467b07-3b5e-4c95-9ad2-d4df9b5ad78a None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:59.171259 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:59.197831 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed30d8b3-0d4d-47c5-9963-5a8f4d5eddb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:59.198357 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed30d8b3-0d4d-47c5-9963-5a8f4d5eddb2 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:59.198630 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed30d8b3-0d4d-47c5-9963-5a8f4d5eddb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:59.199440 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed30d8b3-0d4d-47c5-9963-5a8f4d5eddb2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:59.205130 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c55680-aad2-42bf-ac7a-e95db6059739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:59.205819 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c55680-aad2-42bf-ac7a-e95db6059739 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:59.206167 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c55680-aad2-42bf-ac7a-e95db6059739 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:59.206499 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c55680-aad2-42bf-ac7a-e95db6059739 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:59.206718 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed30d8b3-0d4d-47c5-9963-5a8f4d5eddb2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:59.207401 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c55680-aad2-42bf-ac7a-e95db6059739 None admin] RBAC: Adding query filter params (role.id=d14c3070c9184d76a7b23df69bd3db07, scope.project.id=8555a66c304d4264a54e2b2f13dfb1f0, user.id=53c5857c209f44718934df86ba6ed0a1) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:00:59.207773 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c55680-aad2-42bf-ac7a-e95db6059739 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:59.208191 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed30d8b3-0d4d-47c5-9963-5a8f4d5eddb2 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:59.209400 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c55680-aad2-42bf-ac7a-e95db6059739 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:59.216843 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 558/1098] 10.222.0.79 () {56 vars in 1374 bytes} [Tue Aug 30 01:00:59 2022] GET /identity/v3/role_assignments?user.id=53c5857c209f44718934df86ba6ed0a1&scope.project.id=8555a66c304d4264a54e2b2f13dfb1f0&role.id=d14c3070c9184d76a7b23df69bd3db07 => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:00:59.220719 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application [None req-ed30d8b3-0d4d-47c5-9963-5a8f4d5eddb2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 30 01:00:59.220719 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:00:59.220719 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:00:59.220719 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:00:59.220719 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:00:59.220719 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:00:59.220719 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:00:59.220719 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:00:59.220719 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:00:59.220719 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:00:59.220719 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:00:59.220719 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:00:59.220719 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 01:00:59.220719 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 01:00:59.220719 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 01:00:59.220719 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 01:00:59.221772 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:00:59.221772 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:00:59.221772 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 01:00:59.221772 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 01:00:59.221772 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 01:00:59.221772 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 01:00:59.221772 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:00:59.221772 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:00:59.221772 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:00:59.221772 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:00:59.221772 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:00:59.221772 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application with Lock( Aug 30 01:00:59.221772 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:00:59.221772 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:00:59.221772 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:00:59.221772 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:00:59.221772 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:00:59.221772 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:00:59.222986 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:00:59.222986 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:00:59.222986 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 01:00:59.222986 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 01:00:59.222986 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 01:00:59.222986 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 01:00:59.222986 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 01:00:59.222986 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 01:00:59.222986 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 30 01:00:59.222986 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Aug 30 01:00:59.222986 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 541/1099] 10.222.0.79 () {56 vars in 1093 bytes} [Tue Aug 30 01:00:59 2022] GET /identity/v3/users/nova => generated 82 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:00:59.228478 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c55680-aad2-42bf-ac7a-e95db6059739 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:59.332841 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:59.351874 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c55680-aad2-42bf-ac7a-e95db6059739 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:59.392760 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08642c17-1f2f-43e7-8339-cbbedd149cb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:59.393375 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08642c17-1f2f-43e7-8339-cbbedd149cb6 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:59.393653 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08642c17-1f2f-43e7-8339-cbbedd149cb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:59.393927 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08642c17-1f2f-43e7-8339-cbbedd149cb6 None admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:59.394671 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08642c17-1f2f-43e7-8339-cbbedd149cb6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:00:59.394970 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08642c17-1f2f-43e7-8339-cbbedd149cb6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:59.396495 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08642c17-1f2f-43e7-8339-cbbedd149cb6 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:59.418847 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 559/1100] 10.222.0.79 () {56 vars in 1133 bytes} [Tue Aug 30 01:00:59 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:00:59.424695 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed30d8b3-0d4d-47c5-9963-5a8f4d5eddb2 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:59.552290 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed30d8b3-0d4d-47c5-9963-5a8f4d5eddb2 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:59.589502 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f8268f-7c20-4c12-9bef-1cbc8f6a187b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:59.590102 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f8268f-7c20-4c12-9bef-1cbc8f6a187b None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:59.590442 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f8268f-7c20-4c12-9bef-1cbc8f6a187b None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:59.590636 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f8268f-7c20-4c12-9bef-1cbc8f6a187b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:59.633819 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:59.668431 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f8268f-7c20-4c12-9bef-1cbc8f6a187b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:59.669956 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f8268f-7c20-4c12-9bef-1cbc8f6a187b None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:59.784889 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 542/1101] 10.222.0.79 () {58 vars in 1282 bytes} [Tue Aug 30 01:00:59 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 30 01:00:59.790828 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08642c17-1f2f-43e7-8339-cbbedd149cb6 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:59.895467 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08642c17-1f2f-43e7-8339-cbbedd149cb6 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:59.940590 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf33c0a7-f117-445f-b1df-fc6d2824b18f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:59.941279 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf33c0a7-f117-445f-b1df-fc6d2824b18f None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:59.941653 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf33c0a7-f117-445f-b1df-fc6d2824b18f None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:59.941940 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf33c0a7-f117-445f-b1df-fc6d2824b18f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:59.953502 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf33c0a7-f117-445f-b1df-fc6d2824b18f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:59.954948 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf33c0a7-f117-445f-b1df-fc6d2824b18f None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:59.957689 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:59.971142 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-cf33c0a7-f117-445f-b1df-fc6d2824b18f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:00:59.971142 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:00:59.971142 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:00:59.971142 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:00:59.971142 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:00:59.971142 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:00:59.971142 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:00:59.971142 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:00:59.971142 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:00:59.971142 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:00:59.971142 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:00:59.971142 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:00:59.971142 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 01:00:59.971142 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 01:00:59.971142 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 01:00:59.971142 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 01:00:59.973129 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:00:59.973129 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:00:59.973129 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:00:59.973129 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:00:59.973129 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:00:59.973129 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:00:59.973129 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:00:59.973129 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Aug 30 01:00:59.973129 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:00:59.973129 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:00:59.973129 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:00:59.973129 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:00:59.973129 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:00:59.973129 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:00:59.973129 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:00:59.973129 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:00:59.973129 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 01:00:59.975009 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 01:00:59.975009 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:00:59.975009 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Aug 30 01:00:59.976841 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 560/1102] 10.222.0.79 () {56 vars in 1108 bytes} [Tue Aug 30 01:00:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:00:59.978204 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f8268f-7c20-4c12-9bef-1cbc8f6a187b None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:01:00.051935 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:01:00.085557 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f8268f-7c20-4c12-9bef-1cbc8f6a187b None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:01:00.122742 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4555c65f-79f9-4e68-95bf-185e042526f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:01:00.123381 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4555c65f-79f9-4e68-95bf-185e042526f9 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:01:00.123659 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4555c65f-79f9-4e68-95bf-185e042526f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:01:00.123926 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4555c65f-79f9-4e68-95bf-185e042526f9 None admin] PATH_INFO: `/v3/domains` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:01:00.124578 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4555c65f-79f9-4e68-95bf-185e042526f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:01:00.124880 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4555c65f-79f9-4e68-95bf-185e042526f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:01:00.126262 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4555c65f-79f9-4e68-95bf-185e042526f9 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:01:00.138926 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 543/1103] 10.222.0.79 () {56 vars in 1109 bytes} [Tue Aug 30 01:00:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:01:00.146888 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf33c0a7-f117-445f-b1df-fc6d2824b18f None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:01:00.264066 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf33c0a7-f117-445f-b1df-fc6d2824b18f None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:01:00.303312 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dd7106-a3ae-426f-ab12-1ae285f58101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:01:00.303948 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dd7106-a3ae-426f-ab12-1ae285f58101 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:01:00.304226 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dd7106-a3ae-426f-ab12-1ae285f58101 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:01:00.304498 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dd7106-a3ae-426f-ab12-1ae285f58101 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:01:00.312687 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dd7106-a3ae-426f-ab12-1ae285f58101 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:01:00.314131 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dd7106-a3ae-426f-ab12-1ae285f58101 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:01:00.327209 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-80dd7106-a3ae-426f-ab12-1ae285f58101 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 01:01:00.327209 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:01:00.327209 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:01:00.327209 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:01:00.327209 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:01:00.327209 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:01:00.327209 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:01:00.327209 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:01:00.327209 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:01:00.327209 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:01:00.327209 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:01:00.327209 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:01:00.327209 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 01:01:00.327209 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 01:01:00.327209 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 01:01:00.328287 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 01:01:00.328287 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:01:00.328287 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:01:00.328287 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:01:00.328287 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:01:00.328287 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:01:00.328287 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:01:00.328287 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:01:00.328287 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Aug 30 01:01:00.328287 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:01:00.328287 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:01:00.328287 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:01:00.328287 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:01:00.328287 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:01:00.328287 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:01:00.328287 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:01:00.328287 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:01:00.329181 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 01:01:00.329181 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 01:01:00.329181 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 01:01:00.329181 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 01:01:00.329181 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 01:01:00.329181 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 01:01:00.329181 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 01:01:00.329181 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Aug 30 01:01:00.329181 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 561/1104] 10.222.0.79 () {56 vars in 1111 bytes} [Tue Aug 30 01:01:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:01:00.334412 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4555c65f-79f9-4e68-95bf-185e042526f9 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:01:00.450883 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4555c65f-79f9-4e68-95bf-185e042526f9 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:01:00.482388 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:01:00.489164 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a36885a-3f9a-4baa-8b64-9d6348225089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:01:00.489779 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a36885a-3f9a-4baa-8b64-9d6348225089 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:01:00.490056 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a36885a-3f9a-4baa-8b64-9d6348225089 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:01:00.490333 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a36885a-3f9a-4baa-8b64-9d6348225089 None admin] PATH_INFO: `/v3/projects` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:01:00.491031 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a36885a-3f9a-4baa-8b64-9d6348225089 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:01:00.491377 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a36885a-3f9a-4baa-8b64-9d6348225089 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:01:00.492810 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a36885a-3f9a-4baa-8b64-9d6348225089 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:01:00.506318 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 544/1105] 10.222.0.79 () {56 vars in 1148 bytes} [Tue Aug 30 01:01:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:01:00.513481 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dd7106-a3ae-426f-ab12-1ae285f58101 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:01:00.574644 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:01:00.619451 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dd7106-a3ae-426f-ab12-1ae285f58101 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:01:00.655420 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3167fc-09a6-4f5e-8624-084a5063f1f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:01:00.655985 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3167fc-09a6-4f5e-8624-084a5063f1f9 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:01:00.656263 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3167fc-09a6-4f5e-8624-084a5063f1f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:01:00.656533 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3167fc-09a6-4f5e-8624-084a5063f1f9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:01:00.657267 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3167fc-09a6-4f5e-8624-084a5063f1f9 None admin] RBAC: Adding query filter params (role.id=3ff248f562e2493b8a0c8f21fe0a08a8, scope.project.id=0eec3a73673e45dc881de586b9b0fbbb, user.id=6480b2f14c37474c89df9fba48f7cd91) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:01:00.657570 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3167fc-09a6-4f5e-8624-084a5063f1f9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:01:00.658988 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3167fc-09a6-4f5e-8624-084a5063f1f9 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:01:00.665501 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 562/1106] 10.222.0.79 () {56 vars in 1374 bytes} [Tue Aug 30 01:01:00 2022] GET /identity/v3/role_assignments?user.id=6480b2f14c37474c89df9fba48f7cd91&scope.project.id=0eec3a73673e45dc881de586b9b0fbbb&role.id=3ff248f562e2493b8a0c8f21fe0a08a8 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:01:01.238888 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738bf241-99ad-4d7c-84bf-3970e053408b None None] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:01:01.238888 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738bf241-99ad-4d7c-84bf-3970e053408b None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:01:01.239363 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738bf241-99ad-4d7c-84bf-3970e053408b None None] PATH_INFO: `/` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:01:01.240896 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 545/1107] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 01:01:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:01:01.246672 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5140b9-02fc-416b-b276-b29c0c228c40 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:01:01.247405 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5140b9-02fc-416b-b276-b29c0c228c40 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:01:01.247573 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5140b9-02fc-416b-b276-b29c0c228c40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:01:01.267558 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-6b5140b9-02fc-416b-b276-b29c0c228c40 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:01:01.268790 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-6b5140b9-02fc-416b-b276-b29c0c228c40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:01:01.344925 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 563/1108] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 01:01:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 01:01:01.624978 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738bf241-99ad-4d7c-84bf-3970e053408b None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:01:01.732607 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738bf241-99ad-4d7c-84bf-3970e053408b None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:01:01.768847 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71803659-8538-4fa7-92db-957a3db9c182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:01:01.769472 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71803659-8538-4fa7-92db-957a3db9c182 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:01:01.769750 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71803659-8538-4fa7-92db-957a3db9c182 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:01:01.770017 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71803659-8538-4fa7-92db-957a3db9c182 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:01:01.771176 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71803659-8538-4fa7-92db-957a3db9c182 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:01:01.772569 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71803659-8538-4fa7-92db-957a3db9c182 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:01:01.774142 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 546/1109] 10.222.0.79 () {56 vars in 1108 bytes} [Tue Aug 30 01:01:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:01:01.780848 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5140b9-02fc-416b-b276-b29c0c228c40 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:01:01.832031 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:01:01.885215 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5140b9-02fc-416b-b276-b29c0c228c40 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:01:01.920119 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b446cd-8ec7-4411-882d-b54528b0deb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:01:01.920715 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b446cd-8ec7-4411-882d-b54528b0deb5 None admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:01:01.920991 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b446cd-8ec7-4411-882d-b54528b0deb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:01:01.921253 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b446cd-8ec7-4411-882d-b54528b0deb5 None admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:01:01.921905 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b446cd-8ec7-4411-882d-b54528b0deb5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:01:01.923334 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b446cd-8ec7-4411-882d-b54528b0deb5 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:01:01.947094 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 564/1110] 10.222.0.79 () {60 vars in 1132 bytes} [Tue Aug 30 01:01:01 2022] POST /identity/v3/users => generated 286 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:01:04.009509 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d561bb-e5bd-4f2d-a5fb-f13f0f3feb31 None None] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:01:04.010101 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d561bb-e5bd-4f2d-a5fb-f13f0f3feb31 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:01:04.010101 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d561bb-e5bd-4f2d-a5fb-f13f0f3feb31 None None] PATH_INFO: `/` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:01:04.011469 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 547/1111] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 01:01:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:01:04.017619 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85c1250-4636-4244-ac5e-cace7c2b94e9 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:01:04.018138 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85c1250-4636-4244-ac5e-cace7c2b94e9 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:01:04.018266 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85c1250-4636-4244-ac5e-cace7c2b94e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:01:04.038311 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-c85c1250-4636-4244-ac5e-cace7c2b94e9 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:01:04.039558 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-c85c1250-4636-4244-ac5e-cace7c2b94e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:01:04.112959 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 565/1112] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 01:01:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 01:01:04.387845 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d561bb-e5bd-4f2d-a5fb-f13f0f3feb31 None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:01:04.455217 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:01:04.500080 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d561bb-e5bd-4f2d-a5fb-f13f0f3feb31 None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:01:04.539812 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f8b7d9-e887-4916-ad45-3aae1f2a4c2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:01:04.540857 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f8b7d9-e887-4916-ad45-3aae1f2a4c2e None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:01:04.541188 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f8b7d9-e887-4916-ad45-3aae1f2a4c2e None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:01:04.541589 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f8b7d9-e887-4916-ad45-3aae1f2a4c2e None admin] PATH_INFO: `/v3/roles/0e24ae0a2cb9401e8f818402105e9fab` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:01:04.543726 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f8b7d9-e887-4916-ad45-3aae1f2a4c2e None admin] RBAC: Authorizing `identity:get_role(role_id=0e24ae0a2cb9401e8f818402105e9fab)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:01:04.545259 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f8b7d9-e887-4916-ad45-3aae1f2a4c2e None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:01:04.546860 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 548/1113] 10.222.0.79 () {56 vars in 1177 bytes} [Tue Aug 30 01:01:04 2022] GET /identity/v3/roles/0e24ae0a2cb9401e8f818402105e9fab => generated 223 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:01:04.552601 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85c1250-4636-4244-ac5e-cace7c2b94e9 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:01:04.587599 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:01:04.655881 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85c1250-4636-4244-ac5e-cace7c2b94e9 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:01:04.689168 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c561adbd-b654-430b-a68e-34766623b71b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:01:04.689795 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c561adbd-b654-430b-a68e-34766623b71b None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:01:04.690066 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c561adbd-b654-430b-a68e-34766623b71b None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:01:04.690329 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c561adbd-b654-430b-a68e-34766623b71b None admin] PATH_INFO: `/v3/users/f95b2576ba4f4d64be6f3bd54b1489c9` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:01:04.704721 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c561adbd-b654-430b-a68e-34766623b71b None admin] RBAC: Authorizing `identity:get_user(user_id=f95b2576ba4f4d64be6f3bd54b1489c9)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:01:04.706168 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c561adbd-b654-430b-a68e-34766623b71b None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:01:04.707856 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 566/1114] 10.222.0.79 () {56 vars in 1177 bytes} [Tue Aug 30 01:01:04 2022] GET /identity/v3/users/f95b2576ba4f4d64be6f3bd54b1489c9 => generated 286 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:01:04.714103 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f8b7d9-e887-4916-ad45-3aae1f2a4c2e None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:01:04.818366 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f8b7d9-e887-4916-ad45-3aae1f2a4c2e None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:01:04.845792 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:01:04.854772 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848e40a0-c5d0-4797-abcc-3c6266eee580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:01:04.855582 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848e40a0-c5d0-4797-abcc-3c6266eee580 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:01:04.855923 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848e40a0-c5d0-4797-abcc-3c6266eee580 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:01:04.856223 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848e40a0-c5d0-4797-abcc-3c6266eee580 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:01:04.925644 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848e40a0-c5d0-4797-abcc-3c6266eee580 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:01:04.927004 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848e40a0-c5d0-4797-abcc-3c6266eee580 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:01:05.029357 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 549/1115] 10.222.0.79 () {58 vars in 1282 bytes} [Tue Aug 30 01:01:04 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 01:01:05.035696 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c561adbd-b654-430b-a68e-34766623b71b None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:01:05.128388 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:01:05.135888 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c561adbd-b654-430b-a68e-34766623b71b None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:01:05.172987 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f6046d-917e-4de2-a909-6ccb6069121e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:01:05.173611 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f6046d-917e-4de2-a909-6ccb6069121e None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:01:05.173885 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f6046d-917e-4de2-a909-6ccb6069121e None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:01:05.174150 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f6046d-917e-4de2-a909-6ccb6069121e None admin] PATH_INFO: `/v3/projects/8555a66c304d4264a54e2b2f13dfb1f0` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:01:05.175300 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f6046d-917e-4de2-a909-6ccb6069121e None admin] RBAC: Authorizing `identity:get_project(project_id=8555a66c304d4264a54e2b2f13dfb1f0)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:01:05.176763 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f6046d-917e-4de2-a909-6ccb6069121e None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:01:05.178332 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 567/1116] 10.222.0.79 () {56 vars in 1186 bytes} [Tue Aug 30 01:01:05 2022] GET /identity/v3/projects/8555a66c304d4264a54e2b2f13dfb1f0 => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:01:05.185425 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848e40a0-c5d0-4797-abcc-3c6266eee580 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:01:05.213770 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:01:05.291422 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848e40a0-c5d0-4797-abcc-3c6266eee580 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:01:05.326734 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d347b739-7d44-4937-8560-62e3237fd8fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:01:05.327358 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d347b739-7d44-4937-8560-62e3237fd8fb None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:01:05.327633 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d347b739-7d44-4937-8560-62e3237fd8fb None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:01:05.327896 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d347b739-7d44-4937-8560-62e3237fd8fb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:01:05.328605 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d347b739-7d44-4937-8560-62e3237fd8fb None admin] RBAC: Adding query filter params (role.id=0e24ae0a2cb9401e8f818402105e9fab, scope.project.id=8555a66c304d4264a54e2b2f13dfb1f0, user.id=f95b2576ba4f4d64be6f3bd54b1489c9) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:01:05.328902 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d347b739-7d44-4937-8560-62e3237fd8fb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:01:05.330320 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d347b739-7d44-4937-8560-62e3237fd8fb None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:01:05.336225 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 550/1117] 10.222.0.79 () {56 vars in 1374 bytes} [Tue Aug 30 01:01:05 2022] GET /identity/v3/role_assignments?user.id=f95b2576ba4f4d64be6f3bd54b1489c9&scope.project.id=8555a66c304d4264a54e2b2f13dfb1f0&role.id=0e24ae0a2cb9401e8f818402105e9fab => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:01:07.267600 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b717b7-4041-4b3b-9b02-5f71160fdbd6 None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:01:07.268134 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b717b7-4041-4b3b-9b02-5f71160fdbd6 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:01:07.268134 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b717b7-4041-4b3b-9b02-5f71160fdbd6 None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:01:07.269469 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 568/1118] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 01:01:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:01:07.275447 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f81c377-cada-4d70-97a0-0b0d00bbc478 None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:01:07.275911 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f81c377-cada-4d70-97a0-0b0d00bbc478 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:01:07.276029 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f81c377-cada-4d70-97a0-0b0d00bbc478 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:01:07.294813 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-4f81c377-cada-4d70-97a0-0b0d00bbc478 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:01:07.296055 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-4f81c377-cada-4d70-97a0-0b0d00bbc478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:01:07.364547 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 551/1119] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 01:01:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 01:01:07.647381 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b717b7-4041-4b3b-9b02-5f71160fdbd6 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:01:07.755299 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b717b7-4041-4b3b-9b02-5f71160fdbd6 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:01:07.789803 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b15482d-1bb9-43ed-ae4f-08d73b1fea78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:01:07.790430 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b15482d-1bb9-43ed-ae4f-08d73b1fea78 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:01:07.790705 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b15482d-1bb9-43ed-ae4f-08d73b1fea78 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:01:07.790977 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b15482d-1bb9-43ed-ae4f-08d73b1fea78 None admin] PATH_INFO: `/v3/roles/0e24ae0a2cb9401e8f818402105e9fab` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:01:07.793007 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b15482d-1bb9-43ed-ae4f-08d73b1fea78 None admin] RBAC: Authorizing `identity:get_role(role_id=0e24ae0a2cb9401e8f818402105e9fab)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:01:07.794599 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b15482d-1bb9-43ed-ae4f-08d73b1fea78 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:01:07.795969 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 569/1120] 10.222.0.79 () {56 vars in 1177 bytes} [Tue Aug 30 01:01:07 2022] GET /identity/v3/roles/0e24ae0a2cb9401e8f818402105e9fab => generated 223 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:01:07.802107 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f81c377-cada-4d70-97a0-0b0d00bbc478 None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:01:07.824541 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:01:07.905840 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f81c377-cada-4d70-97a0-0b0d00bbc478 None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:01:07.939720 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b550b7-defa-4b8d-9c28-2030fdc966ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:01:07.940348 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b550b7-defa-4b8d-9c28-2030fdc966ca None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:01:07.940621 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b550b7-defa-4b8d-9c28-2030fdc966ca None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:01:07.940889 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b550b7-defa-4b8d-9c28-2030fdc966ca None admin] PATH_INFO: `/v3/users/f95b2576ba4f4d64be6f3bd54b1489c9` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:01:07.942006 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b550b7-defa-4b8d-9c28-2030fdc966ca None admin] RBAC: Authorizing `identity:get_user(user_id=f95b2576ba4f4d64be6f3bd54b1489c9)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:01:07.943719 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b550b7-defa-4b8d-9c28-2030fdc966ca None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:01:07.945285 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 552/1121] 10.222.0.79 () {56 vars in 1177 bytes} [Tue Aug 30 01:01:07 2022] GET /identity/v3/users/f95b2576ba4f4d64be6f3bd54b1489c9 => generated 286 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:01:07.951424 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b15482d-1bb9-43ed-ae4f-08d73b1fea78 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:01:07.986037 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:01:08.065096 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b15482d-1bb9-43ed-ae4f-08d73b1fea78 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:01:08.100362 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ffe25a-13bc-4dac-ae5a-a01323d92eff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:01:08.100983 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ffe25a-13bc-4dac-ae5a-a01323d92eff None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:01:08.101264 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ffe25a-13bc-4dac-ae5a-a01323d92eff None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:01:08.101533 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ffe25a-13bc-4dac-ae5a-a01323d92eff None admin] PATH_INFO: `/v3/projects/8555a66c304d4264a54e2b2f13dfb1f0` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:01:08.102657 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ffe25a-13bc-4dac-ae5a-a01323d92eff None admin] RBAC: Authorizing `identity:get_project(project_id=8555a66c304d4264a54e2b2f13dfb1f0)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:01:08.104124 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ffe25a-13bc-4dac-ae5a-a01323d92eff None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:01:08.105849 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 570/1122] 10.222.0.79 () {56 vars in 1186 bytes} [Tue Aug 30 01:01:07 2022] GET /identity/v3/projects/8555a66c304d4264a54e2b2f13dfb1f0 => generated 311 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:01:08.112508 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b550b7-defa-4b8d-9c28-2030fdc966ca None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:01:08.210900 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:01:08.224706 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b550b7-defa-4b8d-9c28-2030fdc966ca None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:01:08.260957 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a13f8e-4e10-48ff-aed4-bd160fa05863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:01:08.262113 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a13f8e-4e10-48ff-aed4-bd160fa05863 None admin] REQUEST_METHOD: `PUT` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:01:08.262391 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a13f8e-4e10-48ff-aed4-bd160fa05863 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:01:08.262774 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a13f8e-4e10-48ff-aed4-bd160fa05863 None admin] PATH_INFO: `/v3/projects/8555a66c304d4264a54e2b2f13dfb1f0/users/f95b2576ba4f4d64be6f3bd54b1489c9/roles/0e24ae0a2cb9401e8f818402105e9fab` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:01:08.265007 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a13f8e-4e10-48ff-aed4-bd160fa05863 None admin] RBAC: Authorizing `identity:create_grant(project_id=8555a66c304d4264a54e2b2f13dfb1f0, user_id=f95b2576ba4f4d64be6f3bd54b1489c9, role_id=0e24ae0a2cb9401e8f818402105e9fab)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:01:08.266445 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a13f8e-4e10-48ff-aed4-bd160fa05863 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:01:08.281036 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 553/1123] 10.222.0.79 () {58 vars in 1439 bytes} [Tue Aug 30 01:01:08 2022] PUT /identity/v3/projects/8555a66c304d4264a54e2b2f13dfb1f0/users/f95b2576ba4f4d64be6f3bd54b1489c9/roles/0e24ae0a2cb9401e8f818402105e9fab => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:01:10.247941 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277e70c6-98e5-4527-aa3b-ba2d61500610 None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:01:10.248438 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277e70c6-98e5-4527-aa3b-ba2d61500610 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:01:10.248538 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277e70c6-98e5-4527-aa3b-ba2d61500610 None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:01:10.249821 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 571/1124] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 01:01:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:01:10.255464 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323a9350-acd5-4836-8d9b-09faac5b57c5 None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:01:10.256190 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323a9350-acd5-4836-8d9b-09faac5b57c5 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:01:10.256391 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323a9350-acd5-4836-8d9b-09faac5b57c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:01:10.275721 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-323a9350-acd5-4836-8d9b-09faac5b57c5 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:01:10.277432 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-323a9350-acd5-4836-8d9b-09faac5b57c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:01:10.350794 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 554/1125] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 01:01:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 01:01:10.635906 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277e70c6-98e5-4527-aa3b-ba2d61500610 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:01:10.752173 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:01:10.757496 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277e70c6-98e5-4527-aa3b-ba2d61500610 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:01:10.793911 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf3d294-d65d-44f6-ba60-6d0bc475066e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:01:10.794532 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf3d294-d65d-44f6-ba60-6d0bc475066e None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:01:10.794809 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf3d294-d65d-44f6-ba60-6d0bc475066e None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:01:10.795081 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf3d294-d65d-44f6-ba60-6d0bc475066e None admin] PATH_INFO: `/v3/roles/0e24ae0a2cb9401e8f818402105e9fab` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:01:10.796536 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf3d294-d65d-44f6-ba60-6d0bc475066e None admin] RBAC: Authorizing `identity:get_role(role_id=0e24ae0a2cb9401e8f818402105e9fab)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:01:10.797909 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf3d294-d65d-44f6-ba60-6d0bc475066e None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:01:10.799267 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 572/1126] 10.222.0.79 () {56 vars in 1177 bytes} [Tue Aug 30 01:01:10 2022] GET /identity/v3/roles/0e24ae0a2cb9401e8f818402105e9fab => generated 223 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:01:10.805186 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323a9350-acd5-4836-8d9b-09faac5b57c5 None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:01:10.889334 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:01:10.924681 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323a9350-acd5-4836-8d9b-09faac5b57c5 None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:01:10.965863 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed28bfa0-343a-4933-a723-9419a5ed4fe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:01:10.966493 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed28bfa0-343a-4933-a723-9419a5ed4fe5 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:01:10.966771 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed28bfa0-343a-4933-a723-9419a5ed4fe5 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:01:10.967038 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed28bfa0-343a-4933-a723-9419a5ed4fe5 None admin] PATH_INFO: `/v3/users/f95b2576ba4f4d64be6f3bd54b1489c9` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:01:10.968210 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed28bfa0-343a-4933-a723-9419a5ed4fe5 None admin] RBAC: Authorizing `identity:get_user(user_id=f95b2576ba4f4d64be6f3bd54b1489c9)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:01:10.969638 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed28bfa0-343a-4933-a723-9419a5ed4fe5 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:01:10.971278 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 555/1127] 10.222.0.79 () {56 vars in 1177 bytes} [Tue Aug 30 01:01:10 2022] GET /identity/v3/users/f95b2576ba4f4d64be6f3bd54b1489c9 => generated 286 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:01:10.978653 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf3d294-d65d-44f6-ba60-6d0bc475066e None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:01:11.083467 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf3d294-d65d-44f6-ba60-6d0bc475066e None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:01:11.119482 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904a7516-3b3e-4fa2-baaf-e13b53dfabd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:01:11.120089 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904a7516-3b3e-4fa2-baaf-e13b53dfabd7 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:01:11.120362 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904a7516-3b3e-4fa2-baaf-e13b53dfabd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:01:11.120664 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904a7516-3b3e-4fa2-baaf-e13b53dfabd7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:01:11.159517 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:01:11.200854 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904a7516-3b3e-4fa2-baaf-e13b53dfabd7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:01:11.202323 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904a7516-3b3e-4fa2-baaf-e13b53dfabd7 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:01:11.311120 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 573/1128] 10.222.0.79 () {58 vars in 1282 bytes} [Tue Aug 30 01:01:10 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 01:01:11.317165 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed28bfa0-343a-4933-a723-9419a5ed4fe5 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:01:11.427271 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed28bfa0-343a-4933-a723-9419a5ed4fe5 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:01:11.464564 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbc7f26-245b-4c81-9762-3dd77c7e4b9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:01:11.465210 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbc7f26-245b-4c81-9762-3dd77c7e4b9f None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:01:11.465484 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbc7f26-245b-4c81-9762-3dd77c7e4b9f None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:01:11.465749 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbc7f26-245b-4c81-9762-3dd77c7e4b9f None admin] PATH_INFO: `/v3/projects/8555a66c304d4264a54e2b2f13dfb1f0` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:01:11.466913 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbc7f26-245b-4c81-9762-3dd77c7e4b9f None admin] RBAC: Authorizing `identity:get_project(project_id=8555a66c304d4264a54e2b2f13dfb1f0)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:01:11.468387 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbc7f26-245b-4c81-9762-3dd77c7e4b9f None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:01:11.470051 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 556/1129] 10.222.0.79 () {56 vars in 1186 bytes} [Tue Aug 30 01:01:11 2022] GET /identity/v3/projects/8555a66c304d4264a54e2b2f13dfb1f0 => generated 311 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:01:11.476829 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904a7516-3b3e-4fa2-baaf-e13b53dfabd7 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:01:11.545058 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:01:11.586870 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904a7516-3b3e-4fa2-baaf-e13b53dfabd7 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:01:11.621315 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa71c4ba-4799-41e1-ac7e-1b04ee6a7879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:01:11.621921 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa71c4ba-4799-41e1-ac7e-1b04ee6a7879 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:01:11.622196 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa71c4ba-4799-41e1-ac7e-1b04ee6a7879 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:01:11.622465 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa71c4ba-4799-41e1-ac7e-1b04ee6a7879 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:01:11.623218 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa71c4ba-4799-41e1-ac7e-1b04ee6a7879 None admin] RBAC: Adding query filter params (role.id=0e24ae0a2cb9401e8f818402105e9fab, scope.project.id=8555a66c304d4264a54e2b2f13dfb1f0, user.id=f95b2576ba4f4d64be6f3bd54b1489c9) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:01:11.623521 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa71c4ba-4799-41e1-ac7e-1b04ee6a7879 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:01:11.624947 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa71c4ba-4799-41e1-ac7e-1b04ee6a7879 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:01:11.630974 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 574/1130] 10.222.0.79 () {56 vars in 1374 bytes} [Tue Aug 30 01:01:11 2022] GET /identity/v3/role_assignments?user.id=f95b2576ba4f4d64be6f3bd54b1489c9&scope.project.id=8555a66c304d4264a54e2b2f13dfb1f0&role.id=0e24ae0a2cb9401e8f818402105e9fab => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:01:13.579436 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8a2214-105c-41a4-9d70-1824055a2da4 None None] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:01:13.579960 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8a2214-105c-41a4-9d70-1824055a2da4 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:01:13.579960 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8a2214-105c-41a4-9d70-1824055a2da4 None None] PATH_INFO: `/` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:01:13.581218 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 557/1131] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 01:01:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:01:13.587618 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1604574c-4eb2-4368-be2e-24dc033f1d9f None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:01:13.588132 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1604574c-4eb2-4368-be2e-24dc033f1d9f None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:01:13.588598 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1604574c-4eb2-4368-be2e-24dc033f1d9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:01:13.608983 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-1604574c-4eb2-4368-be2e-24dc033f1d9f None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:01:13.610177 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-1604574c-4eb2-4368-be2e-24dc033f1d9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:01:13.677472 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 575/1132] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 01:01:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 01:01:13.950995 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8a2214-105c-41a4-9d70-1824055a2da4 None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:01:13.969511 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:01:14.060213 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8a2214-105c-41a4-9d70-1824055a2da4 None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:01:14.095249 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55852a9-28bf-4c4c-bb23-b0104fdc4e5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:01:14.095876 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55852a9-28bf-4c4c-bb23-b0104fdc4e5a None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:01:14.096151 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55852a9-28bf-4c4c-bb23-b0104fdc4e5a None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:01:14.096416 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55852a9-28bf-4c4c-bb23-b0104fdc4e5a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:01:14.097530 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55852a9-28bf-4c4c-bb23-b0104fdc4e5a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:01:14.098966 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55852a9-28bf-4c4c-bb23-b0104fdc4e5a None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:01:14.100627 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 558/1133] 10.222.0.79 () {56 vars in 1108 bytes} [Tue Aug 30 01:01:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:01:14.107647 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1604574c-4eb2-4368-be2e-24dc033f1d9f None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:01:14.172076 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:01:14.213593 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1604574c-4eb2-4368-be2e-24dc033f1d9f None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:01:14.248745 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94524ec-dba8-4cc7-a6ee-bcaa722ec882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:01:14.249352 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94524ec-dba8-4cc7-a6ee-bcaa722ec882 None admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:01:14.249625 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94524ec-dba8-4cc7-a6ee-bcaa722ec882 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:01:14.249890 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94524ec-dba8-4cc7-a6ee-bcaa722ec882 None admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:01:14.250541 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94524ec-dba8-4cc7-a6ee-bcaa722ec882 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:01:14.251981 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94524ec-dba8-4cc7-a6ee-bcaa722ec882 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:01:14.280424 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 576/1134] 10.222.0.79 () {60 vars in 1141 bytes} [Tue Aug 30 01:01:14 2022] POST /identity/v3/projects => generated 311 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:01:16.262782 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bae7a97-a652-4f09-8b66-ae82f0e4518b None None] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:01:16.263387 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bae7a97-a652-4f09-8b66-ae82f0e4518b None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:01:16.263387 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bae7a97-a652-4f09-8b66-ae82f0e4518b None None] PATH_INFO: `/` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:01:16.264677 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 559/1135] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 01:01:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:01:16.270700 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3aaf3f-7bf1-4a1c-9d0f-a7782beac7c1 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:01:16.271227 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3aaf3f-7bf1-4a1c-9d0f-a7782beac7c1 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:01:16.271707 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3aaf3f-7bf1-4a1c-9d0f-a7782beac7c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:01:16.291398 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-1f3aaf3f-7bf1-4a1c-9d0f-a7782beac7c1 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:01:16.293237 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-1f3aaf3f-7bf1-4a1c-9d0f-a7782beac7c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:01:16.361928 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 577/1136] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 01:01:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 01:01:16.633896 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bae7a97-a652-4f09-8b66-ae82f0e4518b None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:01:16.727801 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:01:16.748378 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bae7a97-a652-4f09-8b66-ae82f0e4518b None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:01:16.785168 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26de5848-729d-4bc9-96a7-0857c9658421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:01:16.785795 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26de5848-729d-4bc9-96a7-0857c9658421 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:01:16.786068 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26de5848-729d-4bc9-96a7-0857c9658421 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:01:16.786335 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26de5848-729d-4bc9-96a7-0857c9658421 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:01:16.787482 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26de5848-729d-4bc9-96a7-0857c9658421 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:01:16.789039 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26de5848-729d-4bc9-96a7-0857c9658421 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:01:16.790755 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 560/1137] 10.222.0.79 () {56 vars in 1108 bytes} [Tue Aug 30 01:01:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:01:16.796741 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3aaf3f-7bf1-4a1c-9d0f-a7782beac7c1 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:01:16.839754 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:01:16.898683 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3aaf3f-7bf1-4a1c-9d0f-a7782beac7c1 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:01:16.933572 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3809ba-9968-4a24-ad02-bcc05d0c0ae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:01:16.934478 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3809ba-9968-4a24-ad02-bcc05d0c0ae9 None admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:01:16.934761 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3809ba-9968-4a24-ad02-bcc05d0c0ae9 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:01:16.935026 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3809ba-9968-4a24-ad02-bcc05d0c0ae9 None admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:01:16.935717 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3809ba-9968-4a24-ad02-bcc05d0c0ae9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:01:16.937142 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3809ba-9968-4a24-ad02-bcc05d0c0ae9 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:01:16.965174 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 578/1138] 10.222.0.79 () {60 vars in 1132 bytes} [Tue Aug 30 01:01:16 2022] POST /identity/v3/users => generated 286 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:01:18.960411 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ac2f87-c836-44e9-aa4a-f7a766e6a070 None None] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:01:18.960949 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ac2f87-c836-44e9-aa4a-f7a766e6a070 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:01:18.960949 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ac2f87-c836-44e9-aa4a-f7a766e6a070 None None] PATH_INFO: `/` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:01:18.962291 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 561/1139] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 01:01:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:01:18.967829 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de2352a-1e3d-418d-8cd8-a52f4881d361 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:01:18.968319 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de2352a-1e3d-418d-8cd8-a52f4881d361 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:01:18.968409 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de2352a-1e3d-418d-8cd8-a52f4881d361 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:01:18.987440 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-7de2352a-1e3d-418d-8cd8-a52f4881d361 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:01:18.988627 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-7de2352a-1e3d-418d-8cd8-a52f4881d361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:01:19.055348 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 579/1140] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 01:01:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 01:01:19.323477 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ac2f87-c836-44e9-aa4a-f7a766e6a070 None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:01:19.428928 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ac2f87-c836-44e9-aa4a-f7a766e6a070 None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:01:19.465983 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcf5017-1e98-4b9a-8079-d78fbf4d1f65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:01:19.466599 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcf5017-1e98-4b9a-8079-d78fbf4d1f65 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:01:19.466869 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcf5017-1e98-4b9a-8079-d78fbf4d1f65 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:01:19.467159 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcf5017-1e98-4b9a-8079-d78fbf4d1f65 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:01:19.477345 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcf5017-1e98-4b9a-8079-d78fbf4d1f65 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 01:01:19.482264 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application [None req-2fcf5017-1e98-4b9a-8079-d78fbf4d1f65 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 01:01:19.482264 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:01:19.482264 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:01:19.482264 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:01:19.482264 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:01:19.482264 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:01:19.482264 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:01:19.482264 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:01:19.482264 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:01:19.482264 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:01:19.482264 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:01:19.482264 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:01:19.482264 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 01:01:19.482264 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 01:01:19.482264 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 01:01:19.482264 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 01:01:19.483437 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 01:01:19.483437 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 01:01:19.483437 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 01:01:19.483437 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 01:01:19.483437 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:01:19.483437 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:01:19.483437 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:01:19.483437 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:01:19.483437 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:01:19.483437 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:01:19.483437 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:01:19.483437 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application with Lock( Aug 30 01:01:19.483437 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:01:19.483437 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:01:19.483437 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:01:19.483437 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:01:19.484350 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:01:19.484350 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:01:19.484350 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:01:19.484350 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:01:19.484350 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 01:01:19.484350 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 01:01:19.484350 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 01:01:19.484350 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 01:01:19.484350 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 01:01:19.484350 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 01:01:19.484350 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 01:01:19.484350 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Aug 30 01:01:19.484350 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 562/1141] 10.222.0.79 () {56 vars in 1096 bytes} [Tue Aug 30 01:01:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:01:19.489554 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de2352a-1e3d-418d-8cd8-a52f4881d361 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:01:19.517177 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:01:19.587684 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de2352a-1e3d-418d-8cd8-a52f4881d361 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:01:19.620627 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a090cb1-102b-45b0-9ced-b8fa352ab5b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:01:19.621222 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a090cb1-102b-45b0-9ced-b8fa352ab5b0 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:01:19.621502 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a090cb1-102b-45b0-9ced-b8fa352ab5b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:01:19.621768 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a090cb1-102b-45b0-9ced-b8fa352ab5b0 None admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:01:19.622426 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a090cb1-102b-45b0-9ced-b8fa352ab5b0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:01:19.622719 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a090cb1-102b-45b0-9ced-b8fa352ab5b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:01:19.624081 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a090cb1-102b-45b0-9ced-b8fa352ab5b0 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:01:19.631906 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 580/1142] 10.222.0.79 () {56 vars in 1099 bytes} [Tue Aug 30 01:01:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:01:19.640456 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcf5017-1e98-4b9a-8079-d78fbf4d1f65 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:01:19.653889 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:01:19.746629 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcf5017-1e98-4b9a-8079-d78fbf4d1f65 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:01:19.781302 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a65eb4-cf34-4244-abb4-366e9157660d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:01:19.781932 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a65eb4-cf34-4244-abb4-366e9157660d None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:01:19.782205 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a65eb4-cf34-4244-abb4-366e9157660d None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:01:19.782471 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a65eb4-cf34-4244-abb4-366e9157660d None admin] PATH_INFO: `/v3/users/cd176a55fbaf41b19f5cc66f43336c4b` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:01:19.796233 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a65eb4-cf34-4244-abb4-366e9157660d None admin] RBAC: Authorizing `identity:get_user(user_id=cd176a55fbaf41b19f5cc66f43336c4b)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:01:19.797673 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a65eb4-cf34-4244-abb4-366e9157660d None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:01:19.799393 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 563/1143] 10.222.0.79 () {56 vars in 1177 bytes} [Tue Aug 30 01:01:19 2022] GET /identity/v3/users/cd176a55fbaf41b19f5cc66f43336c4b => generated 286 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:01:19.805460 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a090cb1-102b-45b0-9ced-b8fa352ab5b0 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:01:19.897528 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:01:19.907307 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a090cb1-102b-45b0-9ced-b8fa352ab5b0 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:01:19.939895 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889c74e3-6a2e-46f8-8368-8618f37c6580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:01:19.940507 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889c74e3-6a2e-46f8-8368-8618f37c6580 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:01:19.940767 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889c74e3-6a2e-46f8-8368-8618f37c6580 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:01:19.941032 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889c74e3-6a2e-46f8-8368-8618f37c6580 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:01:20.006229 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889c74e3-6a2e-46f8-8368-8618f37c6580 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:01:20.007603 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889c74e3-6a2e-46f8-8368-8618f37c6580 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:01:20.096516 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:01:20.107103 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 581/1144] 10.222.0.79 () {58 vars in 1282 bytes} [Tue Aug 30 01:01:19 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 01:01:20.112965 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a65eb4-cf34-4244-abb4-366e9157660d None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:01:20.182102 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:01:20.223328 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a65eb4-cf34-4244-abb4-366e9157660d None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:01:20.258520 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbfae0f-c9ee-4b8d-aa80-f690e3616c1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:01:20.259076 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbfae0f-c9ee-4b8d-aa80-f690e3616c1e None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:01:20.259381 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbfae0f-c9ee-4b8d-aa80-f690e3616c1e None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:01:20.259653 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbfae0f-c9ee-4b8d-aa80-f690e3616c1e None admin] PATH_INFO: `/v3/projects/0cbaf6768a1b40fa8106e1110b4e9cc2` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:01:20.260758 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbfae0f-c9ee-4b8d-aa80-f690e3616c1e None admin] RBAC: Authorizing `identity:get_project(project_id=0cbaf6768a1b40fa8106e1110b4e9cc2)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:01:20.262382 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbfae0f-c9ee-4b8d-aa80-f690e3616c1e None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:01:20.264072 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 564/1145] 10.222.0.79 () {56 vars in 1186 bytes} [Tue Aug 30 01:01:20 2022] GET /identity/v3/projects/0cbaf6768a1b40fa8106e1110b4e9cc2 => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:01:20.270169 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889c74e3-6a2e-46f8-8368-8618f37c6580 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:01:20.372189 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889c74e3-6a2e-46f8-8368-8618f37c6580 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:01:20.405926 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b59181-75b2-458d-8755-8e3d5ee941a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:01:20.406523 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b59181-75b2-458d-8755-8e3d5ee941a0 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:01:20.406798 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b59181-75b2-458d-8755-8e3d5ee941a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:01:20.407064 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b59181-75b2-458d-8755-8e3d5ee941a0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:01:20.407812 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b59181-75b2-458d-8755-8e3d5ee941a0 None admin] RBAC: Adding query filter params (role.id=d14c3070c9184d76a7b23df69bd3db07, scope.project.id=0cbaf6768a1b40fa8106e1110b4e9cc2, user.id=cd176a55fbaf41b19f5cc66f43336c4b) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:01:20.408115 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b59181-75b2-458d-8755-8e3d5ee941a0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:01:20.409517 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b59181-75b2-458d-8755-8e3d5ee941a0 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:01:20.415106 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 582/1146] 10.222.0.79 () {56 vars in 1374 bytes} [Tue Aug 30 01:01:20 2022] GET /identity/v3/role_assignments?user.id=cd176a55fbaf41b19f5cc66f43336c4b&scope.project.id=0cbaf6768a1b40fa8106e1110b4e9cc2&role.id=d14c3070c9184d76a7b23df69bd3db07 => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:01:22.520720 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a550418d-fd9e-4f56-89d5-a6f63a451c9d None None] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:01:22.521244 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a550418d-fd9e-4f56-89d5-a6f63a451c9d None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:01:22.521244 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a550418d-fd9e-4f56-89d5-a6f63a451c9d None None] PATH_INFO: `/` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:01:22.522540 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 565/1147] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 01:01:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:01:22.530351 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2a4760-b829-45a5-876d-d0e0feb1078a None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:01:22.531013 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2a4760-b829-45a5-876d-d0e0feb1078a None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:01:22.531013 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2a4760-b829-45a5-876d-d0e0feb1078a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:01:22.551393 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-6a2a4760-b829-45a5-876d-d0e0feb1078a None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:01:22.553234 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-6a2a4760-b829-45a5-876d-d0e0feb1078a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:01:22.624863 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:01:22.644632 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 583/1148] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 01:01:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 01:01:22.912793 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a550418d-fd9e-4f56-89d5-a6f63a451c9d None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:01:23.019262 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a550418d-fd9e-4f56-89d5-a6f63a451c9d None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:01:23.053692 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8778f9-9be3-4acf-8b9e-e7299c6b5ba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:01:23.054319 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8778f9-9be3-4acf-8b9e-e7299c6b5ba1 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:01:23.054594 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8778f9-9be3-4acf-8b9e-e7299c6b5ba1 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:01:23.054862 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8778f9-9be3-4acf-8b9e-e7299c6b5ba1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:01:23.057598 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:01:23.066882 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8778f9-9be3-4acf-8b9e-e7299c6b5ba1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 01:01:23.072027 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application [None req-6b8778f9-9be3-4acf-8b9e-e7299c6b5ba1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 01:01:23.072027 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:01:23.072027 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:01:23.072027 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:01:23.072027 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:01:23.072027 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:01:23.072027 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:01:23.072027 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:01:23.072027 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:01:23.072027 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:01:23.072027 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:01:23.072027 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:01:23.072027 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 01:01:23.072027 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 01:01:23.072027 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 01:01:23.072027 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 01:01:23.075324 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 01:01:23.075324 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 01:01:23.075324 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 01:01:23.075324 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 01:01:23.075324 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:01:23.075324 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:01:23.075324 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:01:23.075324 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:01:23.075324 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:01:23.075324 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:01:23.075324 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:01:23.075324 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application with Lock( Aug 30 01:01:23.075324 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:01:23.075324 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:01:23.075324 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:01:23.075324 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:01:23.076176 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:01:23.076176 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:01:23.076176 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:01:23.076176 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:01:23.076176 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 01:01:23.076176 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 01:01:23.076176 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 01:01:23.076176 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 01:01:23.076176 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 01:01:23.076176 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 01:01:23.076176 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 01:01:23.076176 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Aug 30 01:01:23.076176 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 566/1149] 10.222.0.79 () {56 vars in 1096 bytes} [Tue Aug 30 01:01:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:01:23.080131 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2a4760-b829-45a5-876d-d0e0feb1078a None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:01:23.178528 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2a4760-b829-45a5-876d-d0e0feb1078a None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:01:23.214093 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7a210b-78e8-40f3-b96d-efd853c990db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:01:23.214850 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7a210b-78e8-40f3-b96d-efd853c990db None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:01:23.215170 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7a210b-78e8-40f3-b96d-efd853c990db None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:01:23.215432 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7a210b-78e8-40f3-b96d-efd853c990db None admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:01:23.216132 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7a210b-78e8-40f3-b96d-efd853c990db None admin] RBAC: Adding query filter params (name=admin) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:01:23.216403 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7a210b-78e8-40f3-b96d-efd853c990db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:01:23.217758 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7a210b-78e8-40f3-b96d-efd853c990db None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:01:23.225999 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 584/1150] 10.222.0.79 () {56 vars in 1099 bytes} [Tue Aug 30 01:01:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:01:23.233196 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8778f9-9be3-4acf-8b9e-e7299c6b5ba1 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:01:23.338308 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8778f9-9be3-4acf-8b9e-e7299c6b5ba1 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:01:23.374687 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a44d20-f2d8-43f4-9053-3346c4a017d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:01:23.375357 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a44d20-f2d8-43f4-9053-3346c4a017d9 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:01:23.375634 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a44d20-f2d8-43f4-9053-3346c4a017d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:01:23.375902 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a44d20-f2d8-43f4-9053-3346c4a017d9 None admin] PATH_INFO: `/v3/users/cd176a55fbaf41b19f5cc66f43336c4b` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:01:23.377013 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a44d20-f2d8-43f4-9053-3346c4a017d9 None admin] RBAC: Authorizing `identity:get_user(user_id=cd176a55fbaf41b19f5cc66f43336c4b)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:01:23.378438 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a44d20-f2d8-43f4-9053-3346c4a017d9 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:01:23.380040 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 567/1151] 10.222.0.79 () {56 vars in 1177 bytes} [Tue Aug 30 01:01:23 2022] GET /identity/v3/users/cd176a55fbaf41b19f5cc66f43336c4b => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:01:23.385895 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7a210b-78e8-40f3-b96d-efd853c990db None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:01:23.431796 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:01:23.484586 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7a210b-78e8-40f3-b96d-efd853c990db None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:01:23.519474 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f20ad87-cc75-49dc-8951-e60c4b2913ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:01:23.520099 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f20ad87-cc75-49dc-8951-e60c4b2913ff None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:01:23.520372 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f20ad87-cc75-49dc-8951-e60c4b2913ff None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:01:23.520639 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f20ad87-cc75-49dc-8951-e60c4b2913ff None admin] PATH_INFO: `/v3/projects/0cbaf6768a1b40fa8106e1110b4e9cc2` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:01:23.521746 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f20ad87-cc75-49dc-8951-e60c4b2913ff None admin] RBAC: Authorizing `identity:get_project(project_id=0cbaf6768a1b40fa8106e1110b4e9cc2)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:01:23.523180 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f20ad87-cc75-49dc-8951-e60c4b2913ff None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:01:23.524806 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 585/1152] 10.222.0.79 () {56 vars in 1186 bytes} [Tue Aug 30 01:01:23 2022] GET /identity/v3/projects/0cbaf6768a1b40fa8106e1110b4e9cc2 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:01:23.530852 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a44d20-f2d8-43f4-9053-3346c4a017d9 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:01:23.595915 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:01:23.634980 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a44d20-f2d8-43f4-9053-3346c4a017d9 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:01:23.669644 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d998b523-cda3-48a1-a7a0-f10013a0973e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:01:23.670290 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d998b523-cda3-48a1-a7a0-f10013a0973e None admin] REQUEST_METHOD: `PUT` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:01:23.670568 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d998b523-cda3-48a1-a7a0-f10013a0973e None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:01:23.670838 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d998b523-cda3-48a1-a7a0-f10013a0973e None admin] PATH_INFO: `/v3/projects/0cbaf6768a1b40fa8106e1110b4e9cc2/users/cd176a55fbaf41b19f5cc66f43336c4b/roles/d14c3070c9184d76a7b23df69bd3db07` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:01:23.672877 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d998b523-cda3-48a1-a7a0-f10013a0973e None admin] RBAC: Authorizing `identity:create_grant(project_id=0cbaf6768a1b40fa8106e1110b4e9cc2, user_id=cd176a55fbaf41b19f5cc66f43336c4b, role_id=d14c3070c9184d76a7b23df69bd3db07)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:01:23.674306 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d998b523-cda3-48a1-a7a0-f10013a0973e None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:01:23.687796 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 568/1153] 10.222.0.79 () {58 vars in 1439 bytes} [Tue Aug 30 01:01:23 2022] PUT /identity/v3/projects/0cbaf6768a1b40fa8106e1110b4e9cc2/users/cd176a55fbaf41b19f5cc66f43336c4b/roles/d14c3070c9184d76a7b23df69bd3db07 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:01:25.570667 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32848eaf-ff09-4f75-ad63-abbab88a0027 None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:01:25.571231 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32848eaf-ff09-4f75-ad63-abbab88a0027 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:01:25.571231 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32848eaf-ff09-4f75-ad63-abbab88a0027 None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:01:25.572543 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 586/1154] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 01:01:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:01:25.577777 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5511820f-b093-4c9b-a1fa-13fa4d9d1fde None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:01:25.578219 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5511820f-b093-4c9b-a1fa-13fa4d9d1fde None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:01:25.578309 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5511820f-b093-4c9b-a1fa-13fa4d9d1fde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:01:25.596989 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-5511820f-b093-4c9b-a1fa-13fa4d9d1fde None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:01:25.598174 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-5511820f-b093-4c9b-a1fa-13fa4d9d1fde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:01:25.665197 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 569/1155] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 01:01:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 01:01:25.930596 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32848eaf-ff09-4f75-ad63-abbab88a0027 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:01:26.040819 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32848eaf-ff09-4f75-ad63-abbab88a0027 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:01:26.056853 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:01:26.078006 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae8eca2-c9e4-46a0-8988-b8b709336608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:01:26.078646 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae8eca2-c9e4-46a0-8988-b8b709336608 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:01:26.078920 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae8eca2-c9e4-46a0-8988-b8b709336608 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:01:26.079216 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae8eca2-c9e4-46a0-8988-b8b709336608 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:01:26.090090 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae8eca2-c9e4-46a0-8988-b8b709336608 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 01:01:26.094911 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-aae8eca2-c9e4-46a0-8988-b8b709336608 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 01:01:26.094911 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:01:26.094911 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:01:26.094911 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:01:26.094911 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:01:26.094911 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:01:26.094911 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:01:26.094911 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:01:26.094911 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:01:26.094911 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:01:26.094911 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:01:26.094911 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:01:26.094911 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 01:01:26.094911 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 01:01:26.094911 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 01:01:26.094911 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 01:01:26.096113 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 01:01:26.096113 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 01:01:26.096113 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 01:01:26.096113 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 01:01:26.096113 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:01:26.096113 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:01:26.096113 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:01:26.096113 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:01:26.096113 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:01:26.096113 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:01:26.096113 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:01:26.096113 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Aug 30 01:01:26.096113 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:01:26.096113 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:01:26.096113 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:01:26.096113 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:01:26.097381 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:01:26.097381 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:01:26.097381 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:01:26.097381 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:01:26.097381 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 01:01:26.097381 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 01:01:26.097381 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 01:01:26.097381 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 01:01:26.097381 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 01:01:26.097381 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 01:01:26.097381 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 01:01:26.097381 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Aug 30 01:01:26.097381 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 587/1156] 10.222.0.79 () {56 vars in 1096 bytes} [Tue Aug 30 01:01:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:01:26.102333 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5511820f-b093-4c9b-a1fa-13fa4d9d1fde None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:01:26.159297 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:01:26.209513 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5511820f-b093-4c9b-a1fa-13fa4d9d1fde None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:01:26.246729 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb83956-58bf-4916-80cf-c630e17382a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:01:26.247450 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb83956-58bf-4916-80cf-c630e17382a5 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:01:26.247725 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb83956-58bf-4916-80cf-c630e17382a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:01:26.247992 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb83956-58bf-4916-80cf-c630e17382a5 None admin] PATH_INFO: `/v3/roles` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:01:26.248664 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb83956-58bf-4916-80cf-c630e17382a5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:01:26.248959 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb83956-58bf-4916-80cf-c630e17382a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:01:26.250323 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb83956-58bf-4916-80cf-c630e17382a5 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:01:26.259219 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 570/1157] 10.222.0.79 () {56 vars in 1099 bytes} [Tue Aug 30 01:01:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:01:26.265954 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae8eca2-c9e4-46a0-8988-b8b709336608 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:01:26.377696 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae8eca2-c9e4-46a0-8988-b8b709336608 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:01:26.415079 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a7af50-5ebb-4f85-8a7c-e4d25ce5ffd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:01:26.415739 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a7af50-5ebb-4f85-8a7c-e4d25ce5ffd0 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:01:26.416011 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a7af50-5ebb-4f85-8a7c-e4d25ce5ffd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:01:26.416277 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a7af50-5ebb-4f85-8a7c-e4d25ce5ffd0 None admin] PATH_INFO: `/v3/users/cd176a55fbaf41b19f5cc66f43336c4b` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:01:26.417499 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a7af50-5ebb-4f85-8a7c-e4d25ce5ffd0 None admin] RBAC: Authorizing `identity:get_user(user_id=cd176a55fbaf41b19f5cc66f43336c4b)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:01:26.418940 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a7af50-5ebb-4f85-8a7c-e4d25ce5ffd0 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:01:26.420965 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 588/1158] 10.222.0.79 () {56 vars in 1177 bytes} [Tue Aug 30 01:01:26 2022] GET /identity/v3/users/cd176a55fbaf41b19f5cc66f43336c4b => generated 286 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:01:26.426850 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb83956-58bf-4916-80cf-c630e17382a5 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:01:26.557215 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb83956-58bf-4916-80cf-c630e17382a5 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:01:26.578389 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:01:26.598560 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a3dbef-5844-40c7-b957-47cbba0298fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:01:26.599213 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a3dbef-5844-40c7-b957-47cbba0298fc None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:01:26.599485 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a3dbef-5844-40c7-b957-47cbba0298fc None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:01:26.599747 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a3dbef-5844-40c7-b957-47cbba0298fc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:01:26.669178 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a3dbef-5844-40c7-b957-47cbba0298fc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:01:26.670787 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a3dbef-5844-40c7-b957-47cbba0298fc None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:01:26.770005 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 571/1159] 10.222.0.79 () {58 vars in 1282 bytes} [Tue Aug 30 01:01:26 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 01:01:26.776028 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a7af50-5ebb-4f85-8a7c-e4d25ce5ffd0 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:01:26.819612 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:01:26.876651 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a7af50-5ebb-4f85-8a7c-e4d25ce5ffd0 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:01:26.910348 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a33ec7-34a8-4472-be9b-24ea105c6a68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:01:26.910959 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a33ec7-34a8-4472-be9b-24ea105c6a68 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:01:26.911277 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a33ec7-34a8-4472-be9b-24ea105c6a68 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:01:26.911546 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a33ec7-34a8-4472-be9b-24ea105c6a68 None admin] PATH_INFO: `/v3/projects/0cbaf6768a1b40fa8106e1110b4e9cc2` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:01:26.912651 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a33ec7-34a8-4472-be9b-24ea105c6a68 None admin] RBAC: Authorizing `identity:get_project(project_id=0cbaf6768a1b40fa8106e1110b4e9cc2)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:01:26.914050 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a33ec7-34a8-4472-be9b-24ea105c6a68 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:01:26.915678 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 589/1160] 10.222.0.79 () {56 vars in 1186 bytes} [Tue Aug 30 01:01:26 2022] GET /identity/v3/projects/0cbaf6768a1b40fa8106e1110b4e9cc2 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:01:26.922861 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a3dbef-5844-40c7-b957-47cbba0298fc None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:01:26.944896 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:01:27.038690 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a3dbef-5844-40c7-b957-47cbba0298fc None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:01:27.073689 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad2f9fa-d84c-4405-97bc-fd7139facee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:01:27.074390 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad2f9fa-d84c-4405-97bc-fd7139facee3 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:01:27.074669 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad2f9fa-d84c-4405-97bc-fd7139facee3 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:01:27.074940 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad2f9fa-d84c-4405-97bc-fd7139facee3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:01:27.075691 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad2f9fa-d84c-4405-97bc-fd7139facee3 None admin] RBAC: Adding query filter params (role.id=d14c3070c9184d76a7b23df69bd3db07, scope.project.id=0cbaf6768a1b40fa8106e1110b4e9cc2, user.id=cd176a55fbaf41b19f5cc66f43336c4b) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:01:27.076000 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad2f9fa-d84c-4405-97bc-fd7139facee3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:01:27.077411 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad2f9fa-d84c-4405-97bc-fd7139facee3 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:01:27.083180 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 572/1161] 10.222.0.79 () {56 vars in 1374 bytes} [Tue Aug 30 01:01:26 2022] GET /identity/v3/role_assignments?user.id=cd176a55fbaf41b19f5cc66f43336c4b&scope.project.id=0cbaf6768a1b40fa8106e1110b4e9cc2&role.id=d14c3070c9184d76a7b23df69bd3db07 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:01:29.023903 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b064b4e-d0d8-46cd-a749-58473a53af12 None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:01:29.024592 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b064b4e-d0d8-46cd-a749-58473a53af12 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:01:29.024592 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b064b4e-d0d8-46cd-a749-58473a53af12 None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:01:29.025853 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 590/1162] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 01:01:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:01:29.032536 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9183ddc-287e-4b5c-9e85-6400f29f4eff None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:01:29.033138 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9183ddc-287e-4b5c-9e85-6400f29f4eff None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:01:29.033138 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9183ddc-287e-4b5c-9e85-6400f29f4eff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:01:29.053694 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-c9183ddc-287e-4b5c-9e85-6400f29f4eff None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:01:29.054927 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-c9183ddc-287e-4b5c-9e85-6400f29f4eff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:01:29.129363 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 573/1163] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 01:01:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 01:01:29.395935 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b064b4e-d0d8-46cd-a749-58473a53af12 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:01:29.495750 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b064b4e-d0d8-46cd-a749-58473a53af12 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:01:29.506305 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:01:29.530643 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e740f4-5ff0-4bf5-afec-14e5f2ae6077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:01:29.531294 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e740f4-5ff0-4bf5-afec-14e5f2ae6077 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:01:29.531580 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e740f4-5ff0-4bf5-afec-14e5f2ae6077 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:01:29.531849 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e740f4-5ff0-4bf5-afec-14e5f2ae6077 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:01:29.599305 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e740f4-5ff0-4bf5-afec-14e5f2ae6077 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:01:29.600748 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e740f4-5ff0-4bf5-afec-14e5f2ae6077 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:01:29.705492 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 591/1164] 10.222.0.79 () {58 vars in 1282 bytes} [Tue Aug 30 01:01:29 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 01:01:29.711467 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9183ddc-287e-4b5c-9e85-6400f29f4eff None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:01:29.724292 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:01:29.816646 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9183ddc-287e-4b5c-9e85-6400f29f4eff None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:01:29.857100 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aa4070-5eb9-42e9-8069-5a93a68e6060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:01:29.857736 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aa4070-5eb9-42e9-8069-5a93a68e6060 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:01:29.858006 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aa4070-5eb9-42e9-8069-5a93a68e6060 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:01:29.858265 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aa4070-5eb9-42e9-8069-5a93a68e6060 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:01:29.865395 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5aa4070-5eb9-42e9-8069-5a93a68e6060 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:01:29.866829 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5aa4070-5eb9-42e9-8069-5a93a68e6060 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:01:29.880477 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application [None req-a5aa4070-5eb9-42e9-8069-5a93a68e6060 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 30 01:01:29.880477 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:01:29.880477 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 30 01:01:29.880477 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 30 01:01:29.880477 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 01:01:29.880477 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 01:01:29.880477 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 01:01:29.880477 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 01:01:29.880477 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 30 01:01:29.880477 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Aug 30 01:01:29.880477 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 01:01:29.880477 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Aug 30 01:01:29.880477 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:01:29.880477 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:01:29.880477 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:01:29.880477 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:01:29.880477 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:01:29.881777 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:01:29.881777 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:01:29.881777 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:01:29.881777 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:01:29.881777 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:01:29.881777 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:01:29.881777 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 01:01:29.881777 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 01:01:29.881777 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 01:01:29.881777 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 01:01:29.881777 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:01:29.881777 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:01:29.881777 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:01:29.881777 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:01:29.881777 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:01:29.881777 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:01:29.883084 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:01:29.883084 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application with Lock( Aug 30 01:01:29.883084 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:01:29.883084 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:01:29.883084 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:01:29.883084 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:01:29.883084 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:01:29.883084 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:01:29.883084 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:01:29.883084 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:01:29.883084 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 30 01:01:29.883084 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 01:01:29.883084 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 30 01:01:29.883084 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Aug 30 01:01:29.883084 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 574/1165] 10.222.0.79 () {56 vars in 1117 bytes} [Tue Aug 30 01:01:29 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:01:29.889035 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e740f4-5ff0-4bf5-afec-14e5f2ae6077 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:01:29.900782 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:01:29.991832 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e740f4-5ff0-4bf5-afec-14e5f2ae6077 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:01:30.028869 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c89702e-b68b-4451-8fb1-c0c5d45c293a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:01:30.029545 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c89702e-b68b-4451-8fb1-c0c5d45c293a None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:01:30.029650 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c89702e-b68b-4451-8fb1-c0c5d45c293a None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:01:30.029911 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c89702e-b68b-4451-8fb1-c0c5d45c293a None admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:01:30.030579 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c89702e-b68b-4451-8fb1-c0c5d45c293a None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:01:30.030878 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c89702e-b68b-4451-8fb1-c0c5d45c293a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:01:30.032340 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c89702e-b68b-4451-8fb1-c0c5d45c293a None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:01:30.040941 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 592/1166] 10.222.0.79 () {56 vars in 1115 bytes} [Tue Aug 30 01:01:29 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:01:31.967703 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d29cac8-7d10-4098-b5e0-16a128bd9761 None None] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:01:31.968307 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d29cac8-7d10-4098-b5e0-16a128bd9761 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:01:31.968307 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d29cac8-7d10-4098-b5e0-16a128bd9761 None None] PATH_INFO: `/` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:01:31.969595 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 575/1167] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 01:01:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 01:01:31.975607 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90794b8-ff76-4e9e-a108-6bd6951cccdc None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:01:31.976157 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90794b8-ff76-4e9e-a108-6bd6951cccdc None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:01:31.976275 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90794b8-ff76-4e9e-a108-6bd6951cccdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:01:31.994726 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-a90794b8-ff76-4e9e-a108-6bd6951cccdc None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:01:31.996242 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-a90794b8-ff76-4e9e-a108-6bd6951cccdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:01:32.068373 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 593/1168] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 01:01:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 01:01:32.339551 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d29cac8-7d10-4098-b5e0-16a128bd9761 None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:01:32.410694 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:01:32.444425 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d29cac8-7d10-4098-b5e0-16a128bd9761 None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:01:32.478430 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6544600-98a7-4758-8dc4-70b8016f3b09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:01:32.479026 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6544600-98a7-4758-8dc4-70b8016f3b09 None admin] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:01:32.479891 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6544600-98a7-4758-8dc4-70b8016f3b09 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:01:32.480161 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6544600-98a7-4758-8dc4-70b8016f3b09 None admin] PATH_INFO: `/v3/domains` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:01:32.480820 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6544600-98a7-4758-8dc4-70b8016f3b09 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:01:32.482320 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6544600-98a7-4758-8dc4-70b8016f3b09 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:01:32.499459 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 576/1169] 10.222.0.79 () {60 vars in 1138 bytes} [Tue Aug 30 01:01:32 2022] POST /identity/v3/domains => generated 267 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:01:34.469220 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4513dd2e-6e84-44a4-b5fd-33ad7ad12dde None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:01:34.469766 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4513dd2e-6e84-44a4-b5fd-33ad7ad12dde None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:01:34.469766 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4513dd2e-6e84-44a4-b5fd-33ad7ad12dde None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:01:34.471117 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 594/1170] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 01:01:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:01:34.476320 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685c89dc-518e-4e4d-9c9f-18678006d4a3 None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:01:34.476742 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685c89dc-518e-4e4d-9c9f-18678006d4a3 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:01:34.476869 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685c89dc-518e-4e4d-9c9f-18678006d4a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:01:34.495461 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-685c89dc-518e-4e4d-9c9f-18678006d4a3 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:01:34.496579 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-685c89dc-518e-4e4d-9c9f-18678006d4a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:01:34.562973 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 577/1171] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 01:01:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 01:01:34.832077 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4513dd2e-6e84-44a4-b5fd-33ad7ad12dde None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:01:34.835830 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:01:34.944322 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4513dd2e-6e84-44a4-b5fd-33ad7ad12dde None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:01:34.978451 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ef089f-8d54-468f-a45e-431203059212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:01:34.979076 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ef089f-8d54-468f-a45e-431203059212 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:01:34.979954 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ef089f-8d54-468f-a45e-431203059212 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:01:34.980402 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ef089f-8d54-468f-a45e-431203059212 None admin] PATH_INFO: `/v3/domains/e00db70c399442489de839d5345f552a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:01:34.990432 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ef089f-8d54-468f-a45e-431203059212 None admin] RBAC: Authorizing `identity:get_domain(domain_id=e00db70c399442489de839d5345f552a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:01:34.991888 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ef089f-8d54-468f-a45e-431203059212 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:01:34.993470 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 595/1172] 10.222.0.79 () {56 vars in 1183 bytes} [Tue Aug 30 01:01:34 2022] GET /identity/v3/domains/e00db70c399442489de839d5345f552a => generated 267 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:01:34.999656 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685c89dc-518e-4e4d-9c9f-18678006d4a3 None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:01:35.057088 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:01:35.098028 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685c89dc-518e-4e4d-9c9f-18678006d4a3 None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:01:35.131016 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b3ee35-f638-403f-8eac-e3ffce2ec9c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:01:35.131645 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b3ee35-f638-403f-8eac-e3ffce2ec9c2 None admin] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:01:35.131925 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b3ee35-f638-403f-8eac-e3ffce2ec9c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:01:35.132197 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b3ee35-f638-403f-8eac-e3ffce2ec9c2 None admin] PATH_INFO: `/v3/projects` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:01:35.132845 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b3ee35-f638-403f-8eac-e3ffce2ec9c2 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:01:35.134269 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b3ee35-f638-403f-8eac-e3ffce2ec9c2 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:01:35.160825 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 578/1173] 10.222.0.79 () {60 vars in 1141 bytes} [Tue Aug 30 01:01:34 2022] POST /identity/v3/projects => generated 361 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:01:37.144315 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3877b98a-f708-459c-a6f4-847004064626 None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:01:37.144892 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3877b98a-f708-459c-a6f4-847004064626 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:01:37.144892 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3877b98a-f708-459c-a6f4-847004064626 None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:01:37.146185 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 596/1174] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 01:01:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:01:37.152139 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c314b7e-10cc-4db9-bed8-1ecf8ff147f6 None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:01:37.152733 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c314b7e-10cc-4db9-bed8-1ecf8ff147f6 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:01:37.152842 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c314b7e-10cc-4db9-bed8-1ecf8ff147f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:01:37.172170 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-4c314b7e-10cc-4db9-bed8-1ecf8ff147f6 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:01:37.173362 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-4c314b7e-10cc-4db9-bed8-1ecf8ff147f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:01:37.245373 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 579/1175] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 01:01:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 01:01:37.508710 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3877b98a-f708-459c-a6f4-847004064626 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:01:37.578009 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:01:37.618254 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3877b98a-f708-459c-a6f4-847004064626 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:01:37.655558 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3c41eb-7f99-425f-b0a0-3c2640a11eaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:01:37.656184 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3c41eb-7f99-425f-b0a0-3c2640a11eaf None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:01:37.656462 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3c41eb-7f99-425f-b0a0-3c2640a11eaf None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:01:37.656735 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3c41eb-7f99-425f-b0a0-3c2640a11eaf None admin] PATH_INFO: `/v3/domains/e00db70c399442489de839d5345f552a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:01:37.657847 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3c41eb-7f99-425f-b0a0-3c2640a11eaf None admin] RBAC: Authorizing `identity:get_domain(domain_id=e00db70c399442489de839d5345f552a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:01:37.659296 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3c41eb-7f99-425f-b0a0-3c2640a11eaf None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:01:37.660876 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 597/1176] 10.222.0.79 () {56 vars in 1183 bytes} [Tue Aug 30 01:01:37 2022] GET /identity/v3/domains/e00db70c399442489de839d5345f552a => generated 267 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:01:37.666560 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c314b7e-10cc-4db9-bed8-1ecf8ff147f6 None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:01:37.709543 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:01:37.769843 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c314b7e-10cc-4db9-bed8-1ecf8ff147f6 None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:01:37.803650 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fbd917-aee2-47be-a576-4243b072a88c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:01:37.804260 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fbd917-aee2-47be-a576-4243b072a88c None admin] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:01:37.804539 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fbd917-aee2-47be-a576-4243b072a88c None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:01:37.804808 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fbd917-aee2-47be-a576-4243b072a88c None admin] PATH_INFO: `/v3/users` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:01:37.805468 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fbd917-aee2-47be-a576-4243b072a88c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:01:37.806890 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fbd917-aee2-47be-a576-4243b072a88c None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:01:37.830802 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 580/1177] 10.222.0.79 () {60 vars in 1132 bytes} [Tue Aug 30 01:01:37 2022] POST /identity/v3/users => generated 311 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:01:39.813476 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b32894-e799-43e4-b702-bd04edb22787 None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:01:39.814032 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b32894-e799-43e4-b702-bd04edb22787 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:01:39.814032 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b32894-e799-43e4-b702-bd04edb22787 None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:01:39.815380 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 598/1178] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 01:01:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:01:39.820762 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035a6799-d7c9-43ae-a2a3-3870017cd53b None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:01:39.821152 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035a6799-d7c9-43ae-a2a3-3870017cd53b None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:01:39.821314 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035a6799-d7c9-43ae-a2a3-3870017cd53b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:01:39.840675 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-035a6799-d7c9-43ae-a2a3-3870017cd53b None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:01:39.841857 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-035a6799-d7c9-43ae-a2a3-3870017cd53b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:01:39.907761 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 581/1179] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 01:01:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 01:01:40.176823 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b32894-e799-43e4-b702-bd04edb22787 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:01:40.281244 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b32894-e799-43e4-b702-bd04edb22787 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:01:40.310337 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:01:40.315429 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452f7286-0f8d-4230-a1f6-b6796ee3a9b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:01:40.316044 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452f7286-0f8d-4230-a1f6-b6796ee3a9b2 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:01:40.316318 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452f7286-0f8d-4230-a1f6-b6796ee3a9b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:01:40.316584 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452f7286-0f8d-4230-a1f6-b6796ee3a9b2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:01:40.327352 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452f7286-0f8d-4230-a1f6-b6796ee3a9b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 01:01:40.332024 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-452f7286-0f8d-4230-a1f6-b6796ee3a9b2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 01:01:40.332024 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:01:40.332024 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:01:40.332024 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:01:40.332024 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:01:40.332024 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:01:40.332024 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:01:40.332024 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:01:40.332024 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:01:40.332024 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:01:40.332024 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:01:40.332024 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:01:40.332024 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 01:01:40.332024 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 01:01:40.332024 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 01:01:40.332024 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 01:01:40.333173 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 01:01:40.333173 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 01:01:40.333173 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 01:01:40.333173 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 01:01:40.333173 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:01:40.333173 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:01:40.333173 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:01:40.333173 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:01:40.333173 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:01:40.333173 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:01:40.333173 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:01:40.333173 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Aug 30 01:01:40.333173 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:01:40.333173 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:01:40.333173 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:01:40.333173 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:01:40.334056 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:01:40.334056 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:01:40.334056 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:01:40.334056 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:01:40.334056 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 01:01:40.334056 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 01:01:40.334056 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 01:01:40.334056 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 01:01:40.334056 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 01:01:40.334056 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 01:01:40.334056 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 01:01:40.334056 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Aug 30 01:01:40.334056 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 599/1180] 10.222.0.79 () {56 vars in 1096 bytes} [Tue Aug 30 01:01:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:01:40.339489 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035a6799-d7c9-43ae-a2a3-3870017cd53b None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:01:40.366510 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:01:40.442812 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035a6799-d7c9-43ae-a2a3-3870017cd53b None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:01:40.477805 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7c3657-bc04-47ad-a249-835f4ec27690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:01:40.478404 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7c3657-bc04-47ad-a249-835f4ec27690 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:01:40.478676 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7c3657-bc04-47ad-a249-835f4ec27690 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:01:40.478940 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7c3657-bc04-47ad-a249-835f4ec27690 None admin] PATH_INFO: `/v3/roles` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:01:40.480139 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7c3657-bc04-47ad-a249-835f4ec27690 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:01:40.480516 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7c3657-bc04-47ad-a249-835f4ec27690 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:01:40.481890 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7c3657-bc04-47ad-a249-835f4ec27690 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:01:40.489662 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 582/1181] 10.222.0.79 () {56 vars in 1099 bytes} [Tue Aug 30 01:01:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:01:40.496195 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452f7286-0f8d-4230-a1f6-b6796ee3a9b2 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:01:40.593867 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452f7286-0f8d-4230-a1f6-b6796ee3a9b2 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:01:40.627891 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734d4f69-3b19-4d18-8e50-9bb7d93cc45e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:01:40.628514 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734d4f69-3b19-4d18-8e50-9bb7d93cc45e None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:01:40.628791 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734d4f69-3b19-4d18-8e50-9bb7d93cc45e None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:01:40.629062 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734d4f69-3b19-4d18-8e50-9bb7d93cc45e None admin] PATH_INFO: `/v3/users/1e30080b1c1f44d9917cb761bf940ccb` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:01:40.642652 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734d4f69-3b19-4d18-8e50-9bb7d93cc45e None admin] RBAC: Authorizing `identity:get_user(user_id=1e30080b1c1f44d9917cb761bf940ccb)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:01:40.644131 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734d4f69-3b19-4d18-8e50-9bb7d93cc45e None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:01:40.645779 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 600/1182] 10.222.0.79 () {56 vars in 1177 bytes} [Tue Aug 30 01:01:40 2022] GET /identity/v3/users/1e30080b1c1f44d9917cb761bf940ccb => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:01:40.652014 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7c3657-bc04-47ad-a249-835f4ec27690 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:01:40.743450 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:01:40.758050 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7c3657-bc04-47ad-a249-835f4ec27690 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:01:40.793271 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3322f205-05af-4d05-b13e-a431faf82108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:01:40.793894 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3322f205-05af-4d05-b13e-a431faf82108 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:01:40.794147 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3322f205-05af-4d05-b13e-a431faf82108 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:01:40.794413 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3322f205-05af-4d05-b13e-a431faf82108 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:01:40.861752 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3322f205-05af-4d05-b13e-a431faf82108 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:01:40.863207 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3322f205-05af-4d05-b13e-a431faf82108 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:01:40.949303 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:01:40.960081 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 583/1183] 10.222.0.79 () {58 vars in 1282 bytes} [Tue Aug 30 01:01:40 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 01:01:40.967441 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734d4f69-3b19-4d18-8e50-9bb7d93cc45e None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:01:41.021430 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:01:41.071559 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734d4f69-3b19-4d18-8e50-9bb7d93cc45e None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:01:41.106148 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8bd798-8b30-4ad8-b201-b9b493af83ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:01:41.106763 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8bd798-8b30-4ad8-b201-b9b493af83ae None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:01:41.107037 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8bd798-8b30-4ad8-b201-b9b493af83ae None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:01:41.107334 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8bd798-8b30-4ad8-b201-b9b493af83ae None admin] PATH_INFO: `/v3/projects/ceab7b85a6944e45b8183806970c49a9` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:01:41.108441 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8bd798-8b30-4ad8-b201-b9b493af83ae None admin] RBAC: Authorizing `identity:get_project(project_id=ceab7b85a6944e45b8183806970c49a9)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:01:41.109850 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8bd798-8b30-4ad8-b201-b9b493af83ae None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:01:41.111488 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 601/1184] 10.222.0.79 () {56 vars in 1186 bytes} [Tue Aug 30 01:01:40 2022] GET /identity/v3/projects/ceab7b85a6944e45b8183806970c49a9 => generated 361 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:01:41.117703 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3322f205-05af-4d05-b13e-a431faf82108 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:01:41.220222 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3322f205-05af-4d05-b13e-a431faf82108 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:01:41.254956 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc92a81f-bfe9-4e73-b40a-f3544028acfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:01:41.255592 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc92a81f-bfe9-4e73-b40a-f3544028acfb None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:01:41.255871 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc92a81f-bfe9-4e73-b40a-f3544028acfb None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:01:41.256143 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc92a81f-bfe9-4e73-b40a-f3544028acfb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:01:41.256864 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc92a81f-bfe9-4e73-b40a-f3544028acfb None admin] RBAC: Adding query filter params (role.id=d14c3070c9184d76a7b23df69bd3db07, scope.project.id=ceab7b85a6944e45b8183806970c49a9, user.id=1e30080b1c1f44d9917cb761bf940ccb) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:01:41.257169 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc92a81f-bfe9-4e73-b40a-f3544028acfb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:01:41.258642 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc92a81f-bfe9-4e73-b40a-f3544028acfb None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:01:41.264694 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 584/1185] 10.222.0.79 () {56 vars in 1374 bytes} [Tue Aug 30 01:01:41 2022] GET /identity/v3/role_assignments?user.id=1e30080b1c1f44d9917cb761bf940ccb&scope.project.id=ceab7b85a6944e45b8183806970c49a9&role.id=d14c3070c9184d76a7b23df69bd3db07 => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:01:43.297053 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4143fa-2df9-498a-bae2-6e4eb636b561 None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:01:43.297577 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4143fa-2df9-498a-bae2-6e4eb636b561 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:01:43.297577 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4143fa-2df9-498a-bae2-6e4eb636b561 None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:01:43.298899 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 602/1186] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 01:01:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:01:43.304312 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8ed458-684f-403d-bb87-5ffc15d5dcf2 None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:01:43.304732 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8ed458-684f-403d-bb87-5ffc15d5dcf2 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:01:43.304857 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8ed458-684f-403d-bb87-5ffc15d5dcf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:01:43.324915 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-6b8ed458-684f-403d-bb87-5ffc15d5dcf2 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:01:43.326112 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-6b8ed458-684f-403d-bb87-5ffc15d5dcf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:01:43.387219 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:01:43.409089 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 585/1187] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 01:01:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 01:01:43.685176 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4143fa-2df9-498a-bae2-6e4eb636b561 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:01:43.784934 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4143fa-2df9-498a-bae2-6e4eb636b561 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:01:43.802541 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:01:43.819699 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfbe3ee-5b1a-4d27-9383-b51accc8dda0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:01:43.820321 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfbe3ee-5b1a-4d27-9383-b51accc8dda0 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:01:43.820595 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfbe3ee-5b1a-4d27-9383-b51accc8dda0 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:01:43.820862 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfbe3ee-5b1a-4d27-9383-b51accc8dda0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:01:43.830677 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfbe3ee-5b1a-4d27-9383-b51accc8dda0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 01:01:43.835362 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-ddfbe3ee-5b1a-4d27-9383-b51accc8dda0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 01:01:43.835362 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:01:43.835362 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:01:43.835362 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:01:43.835362 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:01:43.835362 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:01:43.835362 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:01:43.835362 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:01:43.835362 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:01:43.835362 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:01:43.835362 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:01:43.835362 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:01:43.835362 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 01:01:43.835362 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 01:01:43.835362 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 01:01:43.835362 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 01:01:43.836434 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 01:01:43.836434 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 01:01:43.836434 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 01:01:43.836434 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 01:01:43.836434 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:01:43.836434 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:01:43.836434 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:01:43.836434 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:01:43.836434 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:01:43.836434 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:01:43.836434 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:01:43.836434 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Aug 30 01:01:43.836434 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:01:43.836434 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:01:43.836434 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:01:43.836434 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:01:43.837368 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:01:43.837368 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:01:43.837368 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:01:43.837368 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:01:43.837368 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 01:01:43.837368 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 01:01:43.837368 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 01:01:43.837368 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 01:01:43.837368 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 01:01:43.837368 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 01:01:43.837368 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 01:01:43.837368 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Aug 30 01:01:43.837368 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 603/1188] 10.222.0.79 () {56 vars in 1096 bytes} [Tue Aug 30 01:01:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:01:43.843229 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8ed458-684f-403d-bb87-5ffc15d5dcf2 None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:01:43.943791 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8ed458-684f-403d-bb87-5ffc15d5dcf2 None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:01:43.977974 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fb1813-bbf0-4118-8234-68a6bea337a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:01:43.978576 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fb1813-bbf0-4118-8234-68a6bea337a8 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:01:43.978860 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fb1813-bbf0-4118-8234-68a6bea337a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:01:43.979335 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fb1813-bbf0-4118-8234-68a6bea337a8 None admin] PATH_INFO: `/v3/roles` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:01:43.980019 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fb1813-bbf0-4118-8234-68a6bea337a8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:01:43.980311 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fb1813-bbf0-4118-8234-68a6bea337a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:01:43.981673 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fb1813-bbf0-4118-8234-68a6bea337a8 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:01:43.989892 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 586/1189] 10.222.0.79 () {56 vars in 1099 bytes} [Tue Aug 30 01:01:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:01:43.996782 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfbe3ee-5b1a-4d27-9383-b51accc8dda0 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:01:44.098005 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfbe3ee-5b1a-4d27-9383-b51accc8dda0 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:01:44.131427 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5e1a54-19eb-4070-9d1d-6fa07ee50e84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:01:44.132041 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5e1a54-19eb-4070-9d1d-6fa07ee50e84 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:01:44.132311 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5e1a54-19eb-4070-9d1d-6fa07ee50e84 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:01:44.132578 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5e1a54-19eb-4070-9d1d-6fa07ee50e84 None admin] PATH_INFO: `/v3/users/1e30080b1c1f44d9917cb761bf940ccb` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:01:44.133704 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5e1a54-19eb-4070-9d1d-6fa07ee50e84 None admin] RBAC: Authorizing `identity:get_user(user_id=1e30080b1c1f44d9917cb761bf940ccb)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:01:44.135158 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5e1a54-19eb-4070-9d1d-6fa07ee50e84 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:01:44.137311 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 604/1190] 10.222.0.79 () {56 vars in 1177 bytes} [Tue Aug 30 01:01:43 2022] GET /identity/v3/users/1e30080b1c1f44d9917cb761bf940ccb => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:01:44.143221 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fb1813-bbf0-4118-8234-68a6bea337a8 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:01:44.190328 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:01:44.246186 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fb1813-bbf0-4118-8234-68a6bea337a8 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:01:44.279509 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d11773-0a96-4734-8d5f-851e1a77b6d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:01:44.280136 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d11773-0a96-4734-8d5f-851e1a77b6d6 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:01:44.280410 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d11773-0a96-4734-8d5f-851e1a77b6d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:01:44.280678 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d11773-0a96-4734-8d5f-851e1a77b6d6 None admin] PATH_INFO: `/v3/projects/ceab7b85a6944e45b8183806970c49a9` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:01:44.281782 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d11773-0a96-4734-8d5f-851e1a77b6d6 None admin] RBAC: Authorizing `identity:get_project(project_id=ceab7b85a6944e45b8183806970c49a9)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:01:44.283225 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d11773-0a96-4734-8d5f-851e1a77b6d6 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:01:44.284847 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 587/1191] 10.222.0.79 () {56 vars in 1186 bytes} [Tue Aug 30 01:01:44 2022] GET /identity/v3/projects/ceab7b85a6944e45b8183806970c49a9 => generated 361 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:01:44.290851 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5e1a54-19eb-4070-9d1d-6fa07ee50e84 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:01:44.338078 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:01:44.389488 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5e1a54-19eb-4070-9d1d-6fa07ee50e84 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:01:44.422248 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6466dfb-f363-45af-81d6-ab3b31588370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:01:44.422905 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6466dfb-f363-45af-81d6-ab3b31588370 None admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:01:44.423204 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6466dfb-f363-45af-81d6-ab3b31588370 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:01:44.423476 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6466dfb-f363-45af-81d6-ab3b31588370 None admin] PATH_INFO: `/v3/projects/ceab7b85a6944e45b8183806970c49a9/users/1e30080b1c1f44d9917cb761bf940ccb/roles/d14c3070c9184d76a7b23df69bd3db07` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:01:44.425357 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6466dfb-f363-45af-81d6-ab3b31588370 None admin] RBAC: Authorizing `identity:create_grant(project_id=ceab7b85a6944e45b8183806970c49a9, user_id=1e30080b1c1f44d9917cb761bf940ccb, role_id=d14c3070c9184d76a7b23df69bd3db07)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:01:44.426785 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6466dfb-f363-45af-81d6-ab3b31588370 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:01:44.440397 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 605/1192] 10.222.0.79 () {58 vars in 1439 bytes} [Tue Aug 30 01:01:44 2022] PUT /identity/v3/projects/ceab7b85a6944e45b8183806970c49a9/users/1e30080b1c1f44d9917cb761bf940ccb/roles/d14c3070c9184d76a7b23df69bd3db07 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:01:46.343335 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc06d90-6abd-44f1-91ed-cf9def98d95c None None] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:01:46.343865 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc06d90-6abd-44f1-91ed-cf9def98d95c None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:01:46.343865 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc06d90-6abd-44f1-91ed-cf9def98d95c None None] PATH_INFO: `/` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:01:46.345207 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 588/1193] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 01:01:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:01:46.350294 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49731cb8-e5fc-4bad-8396-b0c8f563aec4 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:01:46.350717 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49731cb8-e5fc-4bad-8396-b0c8f563aec4 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:01:46.350830 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49731cb8-e5fc-4bad-8396-b0c8f563aec4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:01:46.369241 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-49731cb8-e5fc-4bad-8396-b0c8f563aec4 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:01:46.370719 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-49731cb8-e5fc-4bad-8396-b0c8f563aec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:01:46.437174 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 606/1194] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 01:01:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 01:01:46.713343 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc06d90-6abd-44f1-91ed-cf9def98d95c None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:01:46.817302 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc06d90-6abd-44f1-91ed-cf9def98d95c None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:01:46.831621 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:01:46.852577 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a268ee0-bcb8-4a8c-8dc5-d078458cdb67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:01:46.853198 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a268ee0-bcb8-4a8c-8dc5-d078458cdb67 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:01:46.853476 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a268ee0-bcb8-4a8c-8dc5-d078458cdb67 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:01:46.853745 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a268ee0-bcb8-4a8c-8dc5-d078458cdb67 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:01:46.864674 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a268ee0-bcb8-4a8c-8dc5-d078458cdb67 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 01:01:46.869470 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application [None req-1a268ee0-bcb8-4a8c-8dc5-d078458cdb67 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 01:01:46.869470 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:01:46.869470 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:01:46.869470 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:01:46.869470 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:01:46.869470 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:01:46.869470 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:01:46.869470 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:01:46.869470 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:01:46.869470 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:01:46.869470 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:01:46.869470 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:01:46.869470 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 01:01:46.869470 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 01:01:46.869470 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 01:01:46.869470 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 01:01:46.871360 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 01:01:46.871360 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 01:01:46.871360 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 01:01:46.871360 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 01:01:46.871360 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:01:46.871360 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:01:46.871360 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:01:46.871360 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:01:46.871360 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:01:46.871360 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:01:46.871360 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:01:46.871360 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application with Lock( Aug 30 01:01:46.871360 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:01:46.871360 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:01:46.871360 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:01:46.871360 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:01:46.872430 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:01:46.872430 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:01:46.872430 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:01:46.872430 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:01:46.872430 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 01:01:46.872430 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 01:01:46.872430 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 01:01:46.872430 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 01:01:46.872430 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 01:01:46.872430 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 01:01:46.872430 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 01:01:46.872430 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Aug 30 01:01:46.872430 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 589/1195] 10.222.0.79 () {56 vars in 1096 bytes} [Tue Aug 30 01:01:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:01:46.877730 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49731cb8-e5fc-4bad-8396-b0c8f563aec4 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:01:46.911530 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:01:46.977079 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49731cb8-e5fc-4bad-8396-b0c8f563aec4 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:01:47.009824 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee045d66-351a-4708-96ff-d17bb35aa27a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:01:47.011010 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee045d66-351a-4708-96ff-d17bb35aa27a None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:01:47.011313 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee045d66-351a-4708-96ff-d17bb35aa27a None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:01:47.011578 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee045d66-351a-4708-96ff-d17bb35aa27a None admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:01:47.012230 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee045d66-351a-4708-96ff-d17bb35aa27a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:01:47.012525 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee045d66-351a-4708-96ff-d17bb35aa27a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:01:47.013874 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee045d66-351a-4708-96ff-d17bb35aa27a None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:01:47.021734 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 607/1196] 10.222.0.79 () {56 vars in 1099 bytes} [Tue Aug 30 01:01:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:01:47.028103 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a268ee0-bcb8-4a8c-8dc5-d078458cdb67 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:01:47.129748 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a268ee0-bcb8-4a8c-8dc5-d078458cdb67 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:01:47.163251 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659449a9-1748-44e0-9fc4-7c8e26ee5738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:01:47.163870 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659449a9-1748-44e0-9fc4-7c8e26ee5738 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:01:47.164151 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659449a9-1748-44e0-9fc4-7c8e26ee5738 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:01:47.164421 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659449a9-1748-44e0-9fc4-7c8e26ee5738 None admin] PATH_INFO: `/v3/users/1e30080b1c1f44d9917cb761bf940ccb` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:01:47.165546 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659449a9-1748-44e0-9fc4-7c8e26ee5738 None admin] RBAC: Authorizing `identity:get_user(user_id=1e30080b1c1f44d9917cb761bf940ccb)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:01:47.167631 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659449a9-1748-44e0-9fc4-7c8e26ee5738 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:01:47.169211 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 590/1197] 10.222.0.79 () {56 vars in 1177 bytes} [Tue Aug 30 01:01:47 2022] GET /identity/v3/users/1e30080b1c1f44d9917cb761bf940ccb => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:01:47.175159 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee045d66-351a-4708-96ff-d17bb35aa27a None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:01:47.270059 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:01:47.274359 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee045d66-351a-4708-96ff-d17bb35aa27a None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:01:47.307154 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230b1a92-ac2a-41ad-92ec-50c359410b53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:01:47.307961 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230b1a92-ac2a-41ad-92ec-50c359410b53 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:01:47.308239 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230b1a92-ac2a-41ad-92ec-50c359410b53 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:01:47.308512 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230b1a92-ac2a-41ad-92ec-50c359410b53 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:01:47.374566 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230b1a92-ac2a-41ad-92ec-50c359410b53 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:01:47.379265 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230b1a92-ac2a-41ad-92ec-50c359410b53 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:01:47.467532 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:01:47.472431 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 608/1198] 10.222.0.79 () {58 vars in 1282 bytes} [Tue Aug 30 01:01:47 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 01:01:47.478037 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659449a9-1748-44e0-9fc4-7c8e26ee5738 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:01:47.520825 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:01:47.578212 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659449a9-1748-44e0-9fc4-7c8e26ee5738 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:01:47.610827 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d844a56-ea83-4d90-9d1d-b1c35c11f044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:01:47.611466 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d844a56-ea83-4d90-9d1d-b1c35c11f044 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:01:47.611746 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d844a56-ea83-4d90-9d1d-b1c35c11f044 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:01:47.612019 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d844a56-ea83-4d90-9d1d-b1c35c11f044 None admin] PATH_INFO: `/v3/projects/ceab7b85a6944e45b8183806970c49a9` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:01:47.613157 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d844a56-ea83-4d90-9d1d-b1c35c11f044 None admin] RBAC: Authorizing `identity:get_project(project_id=ceab7b85a6944e45b8183806970c49a9)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:01:47.614669 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d844a56-ea83-4d90-9d1d-b1c35c11f044 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:01:47.616458 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 591/1199] 10.222.0.79 () {56 vars in 1186 bytes} [Tue Aug 30 01:01:47 2022] GET /identity/v3/projects/ceab7b85a6944e45b8183806970c49a9 => generated 361 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:01:47.623177 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230b1a92-ac2a-41ad-92ec-50c359410b53 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:01:47.719363 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230b1a92-ac2a-41ad-92ec-50c359410b53 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:01:47.754302 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f6dc3a-0f89-4f82-a745-7e7c6ecbf989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:01:47.754912 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f6dc3a-0f89-4f82-a745-7e7c6ecbf989 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:01:47.755228 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f6dc3a-0f89-4f82-a745-7e7c6ecbf989 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:01:47.755500 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f6dc3a-0f89-4f82-a745-7e7c6ecbf989 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:01:47.756238 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f6dc3a-0f89-4f82-a745-7e7c6ecbf989 None admin] RBAC: Adding query filter params (role.id=d14c3070c9184d76a7b23df69bd3db07, scope.project.id=ceab7b85a6944e45b8183806970c49a9, user.id=1e30080b1c1f44d9917cb761bf940ccb) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:01:47.756543 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f6dc3a-0f89-4f82-a745-7e7c6ecbf989 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:01:47.758000 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f6dc3a-0f89-4f82-a745-7e7c6ecbf989 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:01:47.764663 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 609/1200] 10.222.0.79 () {56 vars in 1374 bytes} [Tue Aug 30 01:01:47 2022] GET /identity/v3/role_assignments?user.id=1e30080b1c1f44d9917cb761bf940ccb&scope.project.id=ceab7b85a6944e45b8183806970c49a9&role.id=d14c3070c9184d76a7b23df69bd3db07 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:01:57.606853 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=45 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:01:57.762079 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=69 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:02:48.958937 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c588181-1b46-43f1-9942-e1d3ba25e9d9 None None] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:48.959896 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c588181-1b46-43f1-9942-e1d3ba25e9d9 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:48.960279 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c588181-1b46-43f1-9942-e1d3ba25e9d9 None None] PATH_INFO: `/` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:48.967163 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 592/1201] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 01:02:48 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:02:48.972334 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9859ddb-641b-410f-9f13-61d32d5494ae None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:48.973138 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9859ddb-641b-410f-9f13-61d32d5494ae None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:48.973138 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9859ddb-641b-410f-9f13-61d32d5494ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:49.004080 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-b9859ddb-641b-410f-9f13-61d32d5494ae None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:02:49.005660 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-b9859ddb-641b-410f-9f13-61d32d5494ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:02:49.151182 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 610/1202] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 01:02:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 01:02:49.491661 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c588181-1b46-43f1-9942-e1d3ba25e9d9 None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:02:49.724919 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c588181-1b46-43f1-9942-e1d3ba25e9d9 None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:02:49.798389 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113fb08c-5340-4b20-b162-4c3d584509fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:02:49.799366 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113fb08c-5340-4b20-b162-4c3d584509fc None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:49.799841 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113fb08c-5340-4b20-b162-4c3d584509fc None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:49.800320 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113fb08c-5340-4b20-b162-4c3d584509fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:49.819385 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113fb08c-5340-4b20-b162-4c3d584509fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:02:49.822563 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113fb08c-5340-4b20-b162-4c3d584509fc None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:02:49.855377 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application [None req-113fb08c-5340-4b20-b162-4c3d584509fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:02:49.855377 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:02:49.855377 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:02:49.855377 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:02:49.855377 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:02:49.855377 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:02:49.855377 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:02:49.855377 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:02:49.855377 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:02:49.855377 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:02:49.855377 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:02:49.855377 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:02:49.855377 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 01:02:49.855377 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 01:02:49.855377 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 01:02:49.855377 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 01:02:49.857408 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:02:49.857408 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:02:49.857408 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:02:49.857408 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:02:49.857408 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:02:49.857408 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:02:49.857408 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:02:49.857408 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application with Lock( Aug 30 01:02:49.857408 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:02:49.857408 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:02:49.857408 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:02:49.857408 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:02:49.857408 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:02:49.857408 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:02:49.857408 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:02:49.857408 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:02:49.857408 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 01:02:49.861264 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 01:02:49.861264 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:02:49.861264 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Aug 30 01:02:49.861264 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 593/1203] 10.222.0.79 () {56 vars in 1108 bytes} [Tue Aug 30 01:02:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 367 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:02:49.870468 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9859ddb-641b-410f-9f13-61d32d5494ae None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:02:50.105601 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9859ddb-641b-410f-9f13-61d32d5494ae None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:02:50.156939 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:02:50.163475 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13c23e2-dd49-4e44-8a1f-20cc480a8a8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:02:50.164432 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13c23e2-dd49-4e44-8a1f-20cc480a8a8e None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:50.164973 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13c23e2-dd49-4e44-8a1f-20cc480a8a8e None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:50.165340 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13c23e2-dd49-4e44-8a1f-20cc480a8a8e None admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:50.166236 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13c23e2-dd49-4e44-8a1f-20cc480a8a8e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:02:50.166570 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13c23e2-dd49-4e44-8a1f-20cc480a8a8e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:02:50.168506 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13c23e2-dd49-4e44-8a1f-20cc480a8a8e None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:02:50.190324 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 611/1204] 10.222.0.79 () {56 vars in 1109 bytes} [Tue Aug 30 01:02:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:02:50.197655 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113fb08c-5340-4b20-b162-4c3d584509fc None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:02:50.314929 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:02:50.428887 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113fb08c-5340-4b20-b162-4c3d584509fc None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:02:50.504094 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b81c171-709f-4809-8e90-80289239abf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:02:50.505710 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b81c171-709f-4809-8e90-80289239abf2 None admin] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:50.507848 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b81c171-709f-4809-8e90-80289239abf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:50.511966 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b81c171-709f-4809-8e90-80289239abf2 None admin] PATH_INFO: `/v3/users` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:50.513287 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b81c171-709f-4809-8e90-80289239abf2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:02:50.516037 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b81c171-709f-4809-8e90-80289239abf2 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:02:50.567568 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 594/1205] 10.222.0.79 () {60 vars in 1132 bytes} [Tue Aug 30 01:02:50 2022] POST /identity/v3/users => generated 251 bytes in 371 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:02:54.287458 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f740a9d0-f4bb-4d12-9d04-e055d53e541b None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:54.287458 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f740a9d0-f4bb-4d12-9d04-e055d53e541b None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:54.287458 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f740a9d0-f4bb-4d12-9d04-e055d53e541b None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:54.293746 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 612/1206] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 01:02:54 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:02:54.301943 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21930453-0ad6-4039-8583-cb01d18a2e8c None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:54.302490 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21930453-0ad6-4039-8583-cb01d18a2e8c None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:54.302490 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21930453-0ad6-4039-8583-cb01d18a2e8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:54.328163 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-21930453-0ad6-4039-8583-cb01d18a2e8c None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:02:54.329876 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-21930453-0ad6-4039-8583-cb01d18a2e8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:02:54.441234 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 595/1207] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 01:02:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 01:02:54.769874 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f740a9d0-f4bb-4d12-9d04-e055d53e541b None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:02:54.958265 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f740a9d0-f4bb-4d12-9d04-e055d53e541b None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:02:55.012508 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5a80a8-f29f-4132-a38a-e9b045d9fbf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:02:55.013184 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5a80a8-f29f-4132-a38a-e9b045d9fbf2 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:55.013401 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5a80a8-f29f-4132-a38a-e9b045d9fbf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:55.013709 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5a80a8-f29f-4132-a38a-e9b045d9fbf2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:55.026139 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5a80a8-f29f-4132-a38a-e9b045d9fbf2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 01:02:55.030920 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-7f5a80a8-f29f-4132-a38a-e9b045d9fbf2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 01:02:55.030920 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:02:55.030920 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:02:55.030920 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:02:55.030920 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:02:55.030920 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:02:55.030920 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:02:55.030920 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:02:55.030920 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:02:55.030920 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:02:55.030920 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:02:55.030920 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:02:55.030920 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 01:02:55.030920 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 01:02:55.030920 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 01:02:55.030920 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 01:02:55.035619 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 01:02:55.035619 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 01:02:55.035619 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 01:02:55.035619 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 01:02:55.035619 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:02:55.035619 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:02:55.035619 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:02:55.035619 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:02:55.035619 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:02:55.035619 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:02:55.035619 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:02:55.035619 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Aug 30 01:02:55.035619 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:02:55.035619 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:02:55.035619 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:02:55.035619 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:02:55.036509 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:02:55.036509 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:02:55.036509 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:02:55.036509 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:02:55.036509 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 01:02:55.036509 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 01:02:55.036509 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 01:02:55.036509 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 01:02:55.036509 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 01:02:55.036509 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 01:02:55.036509 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 01:02:55.036509 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Aug 30 01:02:55.036509 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 613/1208] 10.222.0.79 () {56 vars in 1102 bytes} [Tue Aug 30 01:02:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:02:55.044834 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21930453-0ad6-4039-8583-cb01d18a2e8c None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:02:55.157075 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:02:55.294186 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21930453-0ad6-4039-8583-cb01d18a2e8c None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:02:55.363603 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c9036f-976e-493a-9069-4db11e62ea3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:02:55.367221 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c9036f-976e-493a-9069-4db11e62ea3e None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:55.368585 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c9036f-976e-493a-9069-4db11e62ea3e None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:55.369096 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c9036f-976e-493a-9069-4db11e62ea3e None admin] PATH_INFO: `/v3/roles` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:55.370123 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c9036f-976e-493a-9069-4db11e62ea3e None admin] RBAC: Adding query filter params (name=service) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:02:55.370631 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c9036f-976e-493a-9069-4db11e62ea3e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:02:55.372665 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c9036f-976e-493a-9069-4db11e62ea3e None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:02:55.387986 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 596/1209] 10.222.0.79 () {56 vars in 1103 bytes} [Tue Aug 30 01:02:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:02:55.399374 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5a80a8-f29f-4132-a38a-e9b045d9fbf2 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:02:55.479671 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:02:55.605654 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5a80a8-f29f-4132-a38a-e9b045d9fbf2 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:02:55.647818 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57eb9735-08b5-460c-bb6b-4cf787cea39d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:02:55.648494 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eb9735-08b5-460c-bb6b-4cf787cea39d None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:55.648738 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eb9735-08b5-460c-bb6b-4cf787cea39d None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:55.649330 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eb9735-08b5-460c-bb6b-4cf787cea39d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:55.661507 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57eb9735-08b5-460c-bb6b-4cf787cea39d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:02:55.662996 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57eb9735-08b5-460c-bb6b-4cf787cea39d None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:02:55.699827 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-57eb9735-08b5-460c-bb6b-4cf787cea39d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:02:55.699827 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:02:55.699827 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:02:55.699827 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:02:55.699827 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:02:55.699827 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:02:55.699827 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:02:55.699827 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:02:55.699827 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:02:55.699827 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:02:55.699827 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:02:55.699827 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:02:55.699827 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 01:02:55.699827 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 01:02:55.699827 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 01:02:55.699827 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 01:02:55.701684 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:02:55.701684 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:02:55.701684 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:02:55.701684 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:02:55.701684 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:02:55.701684 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:02:55.701684 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:02:55.701684 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Aug 30 01:02:55.701684 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:02:55.701684 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:02:55.701684 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:02:55.701684 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:02:55.701684 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:02:55.701684 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:02:55.701684 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:02:55.701684 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:02:55.701684 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 01:02:55.703235 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 01:02:55.703235 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:02:55.703235 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Aug 30 01:02:55.703235 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 614/1210] 10.222.0.79 () {56 vars in 1108 bytes} [Tue Aug 30 01:02:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:02:55.711960 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c9036f-976e-493a-9069-4db11e62ea3e None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:02:55.906780 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:02:55.912183 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c9036f-976e-493a-9069-4db11e62ea3e None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:02:55.960723 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526d381a-ed41-40d2-858d-0d39c2ab00b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:02:55.962301 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526d381a-ed41-40d2-858d-0d39c2ab00b8 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:55.962743 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526d381a-ed41-40d2-858d-0d39c2ab00b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:55.963213 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526d381a-ed41-40d2-858d-0d39c2ab00b8 None admin] PATH_INFO: `/v3/domains` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:55.964144 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526d381a-ed41-40d2-858d-0d39c2ab00b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:02:55.964654 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526d381a-ed41-40d2-858d-0d39c2ab00b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:02:55.966514 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526d381a-ed41-40d2-858d-0d39c2ab00b8 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:02:55.999201 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 597/1211] 10.222.0.79 () {56 vars in 1109 bytes} [Tue Aug 30 01:02:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:02:56.011333 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57eb9735-08b5-460c-bb6b-4cf787cea39d None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:02:56.200327 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57eb9735-08b5-460c-bb6b-4cf787cea39d None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:02:56.202459 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:02:56.254044 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6aaedf-8668-4678-adeb-5dbe323e17b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:02:56.254784 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6aaedf-8668-4678-adeb-5dbe323e17b5 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:56.255183 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6aaedf-8668-4678-adeb-5dbe323e17b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:56.255472 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6aaedf-8668-4678-adeb-5dbe323e17b5 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:56.267068 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6aaedf-8668-4678-adeb-5dbe323e17b5 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:02:56.268580 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6aaedf-8668-4678-adeb-5dbe323e17b5 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:02:56.282941 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-ba6aaedf-8668-4678-adeb-5dbe323e17b5 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 30 01:02:56.282941 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:02:56.282941 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:02:56.282941 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:02:56.282941 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:02:56.282941 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:02:56.282941 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:02:56.282941 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:02:56.282941 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:02:56.282941 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:02:56.282941 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:02:56.282941 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:02:56.282941 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 01:02:56.282941 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 01:02:56.282941 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 01:02:56.282941 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 01:02:56.284070 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:02:56.284070 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:02:56.284070 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 01:02:56.284070 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 01:02:56.284070 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 01:02:56.284070 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 01:02:56.284070 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:02:56.284070 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:02:56.284070 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:02:56.284070 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:02:56.284070 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:02:56.284070 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Aug 30 01:02:56.284070 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:02:56.284070 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:02:56.284070 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:02:56.284070 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:02:56.284070 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:02:56.284070 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:02:56.285099 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:02:56.285099 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:02:56.285099 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 01:02:56.285099 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 01:02:56.285099 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 01:02:56.285099 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 01:02:56.285099 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 01:02:56.285099 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 01:02:56.285099 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 30 01:02:56.285099 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Aug 30 01:02:56.285099 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 615/1212] 10.222.0.79 () {56 vars in 1108 bytes} [Tue Aug 30 01:02:56 2022] GET /identity/v3/users/placement => generated 87 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:02:56.291679 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526d381a-ed41-40d2-858d-0d39c2ab00b8 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:02:56.456270 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526d381a-ed41-40d2-858d-0d39c2ab00b8 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:02:56.516919 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782b9798-d01b-47a4-944f-4e3b0612ed64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:02:56.517540 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782b9798-d01b-47a4-944f-4e3b0612ed64 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:56.517816 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782b9798-d01b-47a4-944f-4e3b0612ed64 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:56.518086 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782b9798-d01b-47a4-944f-4e3b0612ed64 None admin] PATH_INFO: `/v3/users` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:56.518826 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782b9798-d01b-47a4-944f-4e3b0612ed64 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:02:56.519138 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782b9798-d01b-47a4-944f-4e3b0612ed64 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:02:56.520662 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782b9798-d01b-47a4-944f-4e3b0612ed64 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:02:56.548394 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 598/1213] 10.222.0.79 () {56 vars in 1143 bytes} [Tue Aug 30 01:02:56 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:02:56.551099 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6aaedf-8668-4678-adeb-5dbe323e17b5 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:02:56.739793 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6aaedf-8668-4678-adeb-5dbe323e17b5 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:02:56.784069 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6207e2b-226e-4f3b-ad11-b0f0d1ee8ea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:02:56.784716 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6207e2b-226e-4f3b-ad11-b0f0d1ee8ea2 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:56.784991 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6207e2b-226e-4f3b-ad11-b0f0d1ee8ea2 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:56.785264 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6207e2b-226e-4f3b-ad11-b0f0d1ee8ea2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:56.818664 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:02:56.870354 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6207e2b-226e-4f3b-ad11-b0f0d1ee8ea2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:02:56.872991 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6207e2b-226e-4f3b-ad11-b0f0d1ee8ea2 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:02:57.007510 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 616/1214] 10.222.0.79 () {58 vars in 1282 bytes} [Tue Aug 30 01:02:56 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 30 01:02:57.012270 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782b9798-d01b-47a4-944f-4e3b0612ed64 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:02:57.042340 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:02:57.205533 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782b9798-d01b-47a4-944f-4e3b0612ed64 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:02:57.280058 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c02fa60-b0de-4d76-90e8-908861e38c34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:02:57.281077 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c02fa60-b0de-4d76-90e8-908861e38c34 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:57.281574 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c02fa60-b0de-4d76-90e8-908861e38c34 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:57.282065 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c02fa60-b0de-4d76-90e8-908861e38c34 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:57.303886 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c02fa60-b0de-4d76-90e8-908861e38c34 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:02:57.307442 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c02fa60-b0de-4d76-90e8-908861e38c34 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:02:57.337566 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application [None req-0c02fa60-b0de-4d76-90e8-908861e38c34 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:02:57.337566 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:02:57.337566 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:02:57.337566 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:02:57.337566 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:02:57.337566 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:02:57.337566 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:02:57.337566 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:02:57.337566 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:02:57.337566 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:02:57.337566 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:02:57.337566 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:02:57.337566 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 01:02:57.337566 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 01:02:57.337566 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 01:02:57.337566 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 01:02:57.338857 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:02:57.338857 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:02:57.338857 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:02:57.338857 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:02:57.338857 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:02:57.338857 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:02:57.338857 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:02:57.338857 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application with Lock( Aug 30 01:02:57.338857 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:02:57.338857 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:02:57.338857 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:02:57.338857 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:02:57.338857 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:02:57.338857 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:02:57.338857 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:02:57.338857 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:02:57.338857 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 01:02:57.345115 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 01:02:57.345115 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:02:57.345115 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Aug 30 01:02:57.345115 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 599/1215] 10.222.0.79 () {56 vars in 1108 bytes} [Tue Aug 30 01:02:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:02:57.347009 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6207e2b-226e-4f3b-ad11-b0f0d1ee8ea2 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:02:57.433665 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:02:57.513781 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6207e2b-226e-4f3b-ad11-b0f0d1ee8ea2 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:02:57.572375 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7054efce-3bb0-4cef-81ac-8cb5a2489cf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:02:57.574137 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7054efce-3bb0-4cef-81ac-8cb5a2489cf3 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:57.574639 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7054efce-3bb0-4cef-81ac-8cb5a2489cf3 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:57.574873 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7054efce-3bb0-4cef-81ac-8cb5a2489cf3 None admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:57.575689 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7054efce-3bb0-4cef-81ac-8cb5a2489cf3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:02:57.576041 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7054efce-3bb0-4cef-81ac-8cb5a2489cf3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:02:57.577887 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7054efce-3bb0-4cef-81ac-8cb5a2489cf3 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:02:57.594065 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 617/1216] 10.222.0.79 () {56 vars in 1109 bytes} [Tue Aug 30 01:02:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:02:57.605518 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c02fa60-b0de-4d76-90e8-908861e38c34 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:02:57.737250 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:02:57.778793 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c02fa60-b0de-4d76-90e8-908861e38c34 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:02:57.824859 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a9cf6a-8c8d-4ea5-8202-e15e3be0ec58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:02:57.825770 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a9cf6a-8c8d-4ea5-8202-e15e3be0ec58 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:57.826105 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a9cf6a-8c8d-4ea5-8202-e15e3be0ec58 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:57.826434 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a9cf6a-8c8d-4ea5-8202-e15e3be0ec58 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:57.837244 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a9cf6a-8c8d-4ea5-8202-e15e3be0ec58 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:02:57.839575 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a9cf6a-8c8d-4ea5-8202-e15e3be0ec58 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:02:57.856336 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application [None req-39a9cf6a-8c8d-4ea5-8202-e15e3be0ec58 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 01:02:57.856336 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:02:57.856336 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:02:57.856336 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:02:57.856336 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:02:57.856336 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:02:57.856336 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:02:57.856336 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:02:57.856336 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:02:57.856336 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:02:57.856336 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:02:57.856336 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:02:57.856336 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 01:02:57.856336 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 01:02:57.856336 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 01:02:57.857527 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 01:02:57.857527 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:02:57.857527 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:02:57.857527 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:02:57.857527 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:02:57.857527 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:02:57.857527 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:02:57.857527 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:02:57.857527 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application with Lock( Aug 30 01:02:57.857527 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:02:57.857527 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:02:57.857527 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:02:57.857527 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:02:57.857527 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:02:57.857527 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:02:57.857527 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:02:57.857527 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:02:57.858445 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 01:02:57.858445 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 01:02:57.858445 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 01:02:57.858445 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 01:02:57.858445 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 01:02:57.858445 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 01:02:57.858445 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 01:02:57.858445 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Aug 30 01:02:57.858445 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 600/1217] 10.222.0.79 () {56 vars in 1111 bytes} [Tue Aug 30 01:02:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:02:57.865025 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7054efce-3bb0-4cef-81ac-8cb5a2489cf3 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:02:57.996931 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7054efce-3bb0-4cef-81ac-8cb5a2489cf3 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:02:58.033381 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:02:58.052369 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803f4504-2676-4c85-a12f-c186f803703a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:02:58.053100 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803f4504-2676-4c85-a12f-c186f803703a None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:58.053436 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803f4504-2676-4c85-a12f-c186f803703a None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:58.053792 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803f4504-2676-4c85-a12f-c186f803703a None admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:58.054704 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803f4504-2676-4c85-a12f-c186f803703a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:02:58.055048 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803f4504-2676-4c85-a12f-c186f803703a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:02:58.057163 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803f4504-2676-4c85-a12f-c186f803703a None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:02:58.076266 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 618/1218] 10.222.0.79 () {56 vars in 1148 bytes} [Tue Aug 30 01:02:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:02:58.088082 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a9cf6a-8c8d-4ea5-8202-e15e3be0ec58 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:02:58.261279 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a9cf6a-8c8d-4ea5-8202-e15e3be0ec58 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:02:58.300023 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:02:58.310199 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d906e3-0236-4e22-801c-40bfab8be8fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:02:58.311234 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d906e3-0236-4e22-801c-40bfab8be8fc None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:58.311696 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d906e3-0236-4e22-801c-40bfab8be8fc None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:58.312064 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d906e3-0236-4e22-801c-40bfab8be8fc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:58.312931 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d906e3-0236-4e22-801c-40bfab8be8fc None admin] RBAC: Adding query filter params (role.id=687d3359d6b2413b84ca5a54d30d5488, scope.project.id=0eec3a73673e45dc881de586b9b0fbbb, user.id=d68e91e4259e449797fb83de548aec1e) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:02:58.313334 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d906e3-0236-4e22-801c-40bfab8be8fc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:02:58.315424 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d906e3-0236-4e22-801c-40bfab8be8fc None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:02:58.325408 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 601/1219] 10.222.0.79 () {56 vars in 1374 bytes} [Tue Aug 30 01:02:58 2022] GET /identity/v3/role_assignments?user.id=d68e91e4259e449797fb83de548aec1e&scope.project.id=0eec3a73673e45dc881de586b9b0fbbb&role.id=687d3359d6b2413b84ca5a54d30d5488 => generated 259 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:03:00.515545 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1df2e5-3cc0-41b6-9c3a-5712a461b122 None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:00.516077 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1df2e5-3cc0-41b6-9c3a-5712a461b122 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:00.516077 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1df2e5-3cc0-41b6-9c3a-5712a461b122 None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:00.517388 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 619/1220] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 01:03:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:03:00.523459 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead82a36-978f-47df-a434-9ca842225c7e None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:00.524106 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead82a36-978f-47df-a434-9ca842225c7e None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:00.524106 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead82a36-978f-47df-a434-9ca842225c7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:00.547290 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-ead82a36-978f-47df-a434-9ca842225c7e None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:03:00.548992 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-ead82a36-978f-47df-a434-9ca842225c7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:03:00.653839 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 602/1221] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 01:03:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 01:03:00.936063 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1df2e5-3cc0-41b6-9c3a-5712a461b122 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:01.067410 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1df2e5-3cc0-41b6-9c3a-5712a461b122 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:01.116873 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df096043-4a1f-4ebb-9c36-ac098f68f035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:01.117564 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df096043-4a1f-4ebb-9c36-ac098f68f035 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:01.117870 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df096043-4a1f-4ebb-9c36-ac098f68f035 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:01.118359 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df096043-4a1f-4ebb-9c36-ac098f68f035 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:01.136308 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df096043-4a1f-4ebb-9c36-ac098f68f035 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 01:03:01.141685 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-df096043-4a1f-4ebb-9c36-ac098f68f035 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 01:03:01.141685 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:03:01.141685 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:03:01.141685 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:03:01.141685 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:03:01.141685 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:03:01.141685 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:03:01.141685 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:03:01.141685 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:03:01.141685 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:03:01.141685 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:03:01.141685 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:03:01.141685 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 01:03:01.141685 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 01:03:01.141685 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 01:03:01.141685 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 01:03:01.142842 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 01:03:01.142842 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 01:03:01.142842 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 01:03:01.142842 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 01:03:01.142842 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:03:01.142842 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:03:01.142842 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:03:01.142842 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:03:01.142842 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:03:01.142842 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:03:01.142842 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:03:01.142842 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Aug 30 01:03:01.142842 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:03:01.142842 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:03:01.142842 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:03:01.142842 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:03:01.143865 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:03:01.143865 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:03:01.143865 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:03:01.143865 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:03:01.143865 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 01:03:01.143865 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 01:03:01.143865 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 01:03:01.143865 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 01:03:01.143865 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 01:03:01.143865 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 01:03:01.143865 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 01:03:01.143865 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Aug 30 01:03:01.147345 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 620/1222] 10.222.0.79 () {56 vars in 1102 bytes} [Tue Aug 30 01:03:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:03:01.149756 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead82a36-978f-47df-a434-9ca842225c7e None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:01.319621 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead82a36-978f-47df-a434-9ca842225c7e None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:01.348253 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:03:01.362964 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf751baa-37be-4d0d-851f-67ed2f73f14e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:01.363694 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf751baa-37be-4d0d-851f-67ed2f73f14e None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:01.364104 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf751baa-37be-4d0d-851f-67ed2f73f14e None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:01.364490 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf751baa-37be-4d0d-851f-67ed2f73f14e None admin] PATH_INFO: `/v3/roles` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:01.365559 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf751baa-37be-4d0d-851f-67ed2f73f14e None admin] RBAC: Adding query filter params (name=service) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:03:01.365910 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf751baa-37be-4d0d-851f-67ed2f73f14e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:01.368893 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf751baa-37be-4d0d-851f-67ed2f73f14e None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:01.384425 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 603/1223] 10.222.0.79 () {56 vars in 1103 bytes} [Tue Aug 30 01:03:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:03:01.392918 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df096043-4a1f-4ebb-9c36-ac098f68f035 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:01.454318 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:03:01.527098 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df096043-4a1f-4ebb-9c36-ac098f68f035 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:01.565262 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313b8a6e-bd11-48cd-808b-d1a020b5c19d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:01.565943 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313b8a6e-bd11-48cd-808b-d1a020b5c19d None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:01.566261 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313b8a6e-bd11-48cd-808b-d1a020b5c19d None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:01.566469 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313b8a6e-bd11-48cd-808b-d1a020b5c19d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:01.579226 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313b8a6e-bd11-48cd-808b-d1a020b5c19d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:01.580755 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313b8a6e-bd11-48cd-808b-d1a020b5c19d None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:01.598685 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-313b8a6e-bd11-48cd-808b-d1a020b5c19d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:03:01.598685 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:03:01.598685 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:03:01.598685 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:03:01.598685 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:03:01.598685 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:03:01.598685 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:03:01.598685 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:03:01.598685 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:03:01.598685 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:03:01.598685 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:03:01.598685 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:03:01.598685 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 01:03:01.598685 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 01:03:01.598685 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 01:03:01.598685 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 01:03:01.599996 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:03:01.599996 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:03:01.599996 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:03:01.599996 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:03:01.599996 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:03:01.599996 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:03:01.599996 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:03:01.599996 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Aug 30 01:03:01.599996 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:03:01.599996 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:03:01.599996 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:03:01.599996 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:03:01.599996 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:03:01.599996 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:03:01.599996 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:03:01.599996 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:03:01.599996 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 01:03:01.601141 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 01:03:01.601141 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:03:01.601141 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Aug 30 01:03:01.601141 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 621/1224] 10.222.0.79 () {56 vars in 1108 bytes} [Tue Aug 30 01:03:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:03:01.607991 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf751baa-37be-4d0d-851f-67ed2f73f14e None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:01.739178 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf751baa-37be-4d0d-851f-67ed2f73f14e None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:01.782017 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e00288-1936-4149-9635-ebb41abb17d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:01.782543 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e00288-1936-4149-9635-ebb41abb17d0 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:01.782817 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e00288-1936-4149-9635-ebb41abb17d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:01.783084 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e00288-1936-4149-9635-ebb41abb17d0 None admin] PATH_INFO: `/v3/domains` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:01.783782 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e00288-1936-4149-9635-ebb41abb17d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:03:01.784085 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e00288-1936-4149-9635-ebb41abb17d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:01.785669 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e00288-1936-4149-9635-ebb41abb17d0 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:01.801500 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 604/1225] 10.222.0.79 () {56 vars in 1109 bytes} [Tue Aug 30 01:03:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:03:01.808508 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313b8a6e-bd11-48cd-808b-d1a020b5c19d None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:01.915718 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:03:01.924845 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313b8a6e-bd11-48cd-808b-d1a020b5c19d None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:01.968296 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae2dc24-b585-4dc3-b436-ddd58600e58b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:01.968930 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae2dc24-b585-4dc3-b436-ddd58600e58b None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:01.969227 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae2dc24-b585-4dc3-b436-ddd58600e58b None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:01.969493 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae2dc24-b585-4dc3-b436-ddd58600e58b None admin] PATH_INFO: `/v3/users/placement` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:01.978836 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae2dc24-b585-4dc3-b436-ddd58600e58b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:01.980309 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae2dc24-b585-4dc3-b436-ddd58600e58b None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:01.993313 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-0ae2dc24-b585-4dc3-b436-ddd58600e58b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 30 01:03:01.993313 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:03:01.993313 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:03:01.993313 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:03:01.993313 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:03:01.993313 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:03:01.993313 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:03:01.993313 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:03:01.993313 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:03:01.993313 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:03:01.993313 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:03:01.993313 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:03:01.993313 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 01:03:01.993313 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 01:03:01.993313 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 01:03:01.993313 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 01:03:01.994673 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:03:01.994673 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:03:01.994673 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 01:03:01.994673 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 01:03:01.994673 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 01:03:01.994673 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 01:03:01.994673 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:03:01.994673 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:03:01.994673 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:03:01.994673 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:03:01.994673 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:03:01.994673 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Aug 30 01:03:01.994673 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:03:01.994673 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:03:01.994673 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:03:01.994673 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:03:01.994673 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:03:01.994673 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:03:01.996027 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:03:01.996027 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:03:01.996027 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 01:03:01.996027 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 01:03:01.996027 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 01:03:01.996027 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 01:03:01.996027 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 01:03:01.996027 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 01:03:01.996027 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 30 01:03:01.996027 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Aug 30 01:03:02.000420 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 622/1226] 10.222.0.79 () {56 vars in 1108 bytes} [Tue Aug 30 01:03:01 2022] GET /identity/v3/users/placement => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:03:02.001300 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e00288-1936-4149-9635-ebb41abb17d0 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:02.061181 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:03:02.140384 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e00288-1936-4149-9635-ebb41abb17d0 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:02.187869 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e4659f-a3af-4dbb-91ee-9aa5a4bb8293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:02.188719 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e4659f-a3af-4dbb-91ee-9aa5a4bb8293 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:02.189573 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e4659f-a3af-4dbb-91ee-9aa5a4bb8293 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:02.189573 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e4659f-a3af-4dbb-91ee-9aa5a4bb8293 None admin] PATH_INFO: `/v3/users` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:02.190368 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e4659f-a3af-4dbb-91ee-9aa5a4bb8293 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:03:02.190775 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e4659f-a3af-4dbb-91ee-9aa5a4bb8293 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:02.192989 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e4659f-a3af-4dbb-91ee-9aa5a4bb8293 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:02.215350 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 605/1227] 10.222.0.79 () {56 vars in 1143 bytes} [Tue Aug 30 01:03:02 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:03:02.224284 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae2dc24-b585-4dc3-b436-ddd58600e58b None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:02.345481 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae2dc24-b585-4dc3-b436-ddd58600e58b None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:02.401199 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b8e698-b4b3-4ce8-b656-935f8ec9ba2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:02.402006 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b8e698-b4b3-4ce8-b656-935f8ec9ba2d None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:02.402394 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b8e698-b4b3-4ce8-b656-935f8ec9ba2d None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:02.402779 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b8e698-b4b3-4ce8-b656-935f8ec9ba2d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:02.415730 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b8e698-b4b3-4ce8-b656-935f8ec9ba2d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:02.417534 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b8e698-b4b3-4ce8-b656-935f8ec9ba2d None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:02.437460 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-a3b8e698-b4b3-4ce8-b656-935f8ec9ba2d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:03:02.437460 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:03:02.437460 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:03:02.437460 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:03:02.437460 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:03:02.437460 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:03:02.437460 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:03:02.437460 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:03:02.437460 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:03:02.437460 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:03:02.437460 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:03:02.437460 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:03:02.437460 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 01:03:02.437460 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 01:03:02.437460 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 01:03:02.437460 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 01:03:02.438724 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:03:02.438724 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:03:02.438724 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:03:02.438724 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:03:02.438724 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:03:02.438724 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:03:02.438724 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:03:02.438724 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Aug 30 01:03:02.438724 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:03:02.438724 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:03:02.438724 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:03:02.438724 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:03:02.438724 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:03:02.438724 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:03:02.438724 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:03:02.438724 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:03:02.438724 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 01:03:02.439884 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 01:03:02.439884 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:03:02.439884 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Aug 30 01:03:02.439884 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 623/1228] 10.222.0.79 () {56 vars in 1108 bytes} [Tue Aug 30 01:03:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 01:03:02.446708 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e4659f-a3af-4dbb-91ee-9aa5a4bb8293 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:02.584296 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e4659f-a3af-4dbb-91ee-9aa5a4bb8293 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:02.588954 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:03:02.636502 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e737e5b-ba38-43fc-9061-82d15ab9fe74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:02.637826 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e737e5b-ba38-43fc-9061-82d15ab9fe74 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:02.638559 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e737e5b-ba38-43fc-9061-82d15ab9fe74 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:02.639038 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e737e5b-ba38-43fc-9061-82d15ab9fe74 None admin] PATH_INFO: `/v3/domains` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:02.640314 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e737e5b-ba38-43fc-9061-82d15ab9fe74 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:03:02.640833 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e737e5b-ba38-43fc-9061-82d15ab9fe74 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:02.644300 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e737e5b-ba38-43fc-9061-82d15ab9fe74 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:02.673419 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 606/1229] 10.222.0.79 () {56 vars in 1109 bytes} [Tue Aug 30 01:03:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:03:02.682245 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b8e698-b4b3-4ce8-b656-935f8ec9ba2d None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:02.698903 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:03:02.851017 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b8e698-b4b3-4ce8-b656-935f8ec9ba2d None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:02.903622 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc15ba19-e62e-4614-8462-d6b3f0cc2742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:02.904546 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc15ba19-e62e-4614-8462-d6b3f0cc2742 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:02.905025 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc15ba19-e62e-4614-8462-d6b3f0cc2742 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:02.905486 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc15ba19-e62e-4614-8462-d6b3f0cc2742 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:02.918794 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc15ba19-e62e-4614-8462-d6b3f0cc2742 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:02.921069 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc15ba19-e62e-4614-8462-d6b3f0cc2742 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:02.936951 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-fc15ba19-e62e-4614-8462-d6b3f0cc2742 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 01:03:02.936951 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:03:02.936951 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:03:02.936951 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:03:02.936951 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:03:02.936951 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:03:02.936951 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:03:02.936951 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:03:02.936951 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:03:02.936951 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:03:02.936951 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:03:02.936951 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:03:02.936951 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 01:03:02.936951 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 01:03:02.936951 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 01:03:02.938277 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 01:03:02.938277 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:03:02.938277 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:03:02.938277 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:03:02.938277 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:03:02.938277 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:03:02.938277 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:03:02.938277 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:03:02.938277 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Aug 30 01:03:02.938277 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:03:02.938277 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:03:02.938277 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:03:02.938277 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:03:02.938277 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:03:02.938277 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:03:02.938277 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:03:02.938277 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:03:02.939526 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 01:03:02.939526 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 01:03:02.939526 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 01:03:02.939526 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 01:03:02.939526 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 01:03:02.939526 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 01:03:02.939526 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 01:03:02.939526 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Aug 30 01:03:02.939526 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 624/1230] 10.222.0.79 () {56 vars in 1111 bytes} [Tue Aug 30 01:03:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 01:03:02.944629 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e737e5b-ba38-43fc-9061-82d15ab9fe74 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:03.080731 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e737e5b-ba38-43fc-9061-82d15ab9fe74 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:03.127556 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bc92e3-8c13-4d88-889b-43f095f087d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:03.128899 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bc92e3-8c13-4d88-889b-43f095f087d3 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:03.129245 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bc92e3-8c13-4d88-889b-43f095f087d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:03.129708 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bc92e3-8c13-4d88-889b-43f095f087d3 None admin] PATH_INFO: `/v3/projects` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:03.130696 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bc92e3-8c13-4d88-889b-43f095f087d3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:03:03.131090 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bc92e3-8c13-4d88-889b-43f095f087d3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:03.132743 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bc92e3-8c13-4d88-889b-43f095f087d3 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:03.147568 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 607/1231] 10.222.0.79 () {56 vars in 1148 bytes} [Tue Aug 30 01:03:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:03:03.154470 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc15ba19-e62e-4614-8462-d6b3f0cc2742 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:03.241209 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:03:03.290813 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc15ba19-e62e-4614-8462-d6b3f0cc2742 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:03.351683 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0135145-f42d-4a8e-97df-3eb76b60a4f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:03.352420 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0135145-f42d-4a8e-97df-3eb76b60a4f2 None admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:03.352700 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0135145-f42d-4a8e-97df-3eb76b60a4f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:03.353020 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0135145-f42d-4a8e-97df-3eb76b60a4f2 None admin] PATH_INFO: `/v3/projects/0eec3a73673e45dc881de586b9b0fbbb/users/d68e91e4259e449797fb83de548aec1e/roles/687d3359d6b2413b84ca5a54d30d5488` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:03.371230 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0135145-f42d-4a8e-97df-3eb76b60a4f2 None admin] RBAC: Authorizing `identity:create_grant(project_id=0eec3a73673e45dc881de586b9b0fbbb, user_id=d68e91e4259e449797fb83de548aec1e, role_id=687d3359d6b2413b84ca5a54d30d5488)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:03.375215 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0135145-f42d-4a8e-97df-3eb76b60a4f2 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:03.391797 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 625/1232] 10.222.0.79 () {58 vars in 1439 bytes} [Tue Aug 30 01:03:03 2022] PUT /identity/v3/projects/0eec3a73673e45dc881de586b9b0fbbb/users/d68e91e4259e449797fb83de548aec1e/roles/687d3359d6b2413b84ca5a54d30d5488 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:03:05.393597 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19d2f44-0418-44a8-9807-529ba018942a None None] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:05.394264 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19d2f44-0418-44a8-9807-529ba018942a None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:05.394527 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19d2f44-0418-44a8-9807-529ba018942a None None] PATH_INFO: `/` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:05.396929 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 608/1233] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 01:03:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:03:05.405150 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cdeb2b-a8aa-4d3d-9a0c-603c152286ce None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:05.405864 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cdeb2b-a8aa-4d3d-9a0c-603c152286ce None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:05.406358 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cdeb2b-a8aa-4d3d-9a0c-603c152286ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:05.439004 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-c7cdeb2b-a8aa-4d3d-9a0c-603c152286ce None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:03:05.440752 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-c7cdeb2b-a8aa-4d3d-9a0c-603c152286ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:03:05.548987 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 626/1234] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 01:03:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 01:03:05.849765 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19d2f44-0418-44a8-9807-529ba018942a None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:05.890598 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:03:06.012518 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19d2f44-0418-44a8-9807-529ba018942a None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:06.070958 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ea6a4c-3ea4-4fed-83b5-eeec504cc32f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:06.071817 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ea6a4c-3ea4-4fed-83b5-eeec504cc32f None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:06.071979 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ea6a4c-3ea4-4fed-83b5-eeec504cc32f None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:06.072310 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ea6a4c-3ea4-4fed-83b5-eeec504cc32f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:06.088483 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ea6a4c-3ea4-4fed-83b5-eeec504cc32f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 01:03:06.094565 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application [None req-05ea6a4c-3ea4-4fed-83b5-eeec504cc32f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 01:03:06.094565 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:03:06.094565 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:03:06.094565 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:03:06.094565 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:03:06.094565 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:03:06.094565 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:03:06.094565 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:03:06.094565 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:03:06.094565 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:03:06.094565 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:03:06.094565 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:03:06.094565 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 01:03:06.094565 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 01:03:06.094565 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 01:03:06.094565 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 01:03:06.096744 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 01:03:06.096744 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 01:03:06.096744 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 01:03:06.096744 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 01:03:06.096744 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:03:06.096744 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:03:06.096744 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:03:06.096744 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:03:06.096744 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:03:06.096744 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:03:06.096744 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:03:06.096744 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application with Lock( Aug 30 01:03:06.096744 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:03:06.096744 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:03:06.096744 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:03:06.096744 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:03:06.097930 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:03:06.097930 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:03:06.097930 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:03:06.097930 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:03:06.097930 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 01:03:06.097930 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 01:03:06.097930 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 01:03:06.097930 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 01:03:06.097930 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 01:03:06.097930 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 01:03:06.097930 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 01:03:06.097930 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Aug 30 01:03:06.097930 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 609/1235] 10.222.0.79 () {56 vars in 1102 bytes} [Tue Aug 30 01:03:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 01:03:06.105782 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cdeb2b-a8aa-4d3d-9a0c-603c152286ce None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:06.187544 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:03:06.280144 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cdeb2b-a8aa-4d3d-9a0c-603c152286ce None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:06.340987 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a85d92-afe5-4718-b38e-882148541ac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:06.342012 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a85d92-afe5-4718-b38e-882148541ac9 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:06.342590 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a85d92-afe5-4718-b38e-882148541ac9 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:06.343038 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a85d92-afe5-4718-b38e-882148541ac9 None admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:06.344102 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a85d92-afe5-4718-b38e-882148541ac9 None admin] RBAC: Adding query filter params (name=service) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:03:06.344469 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a85d92-afe5-4718-b38e-882148541ac9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:06.346451 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a85d92-afe5-4718-b38e-882148541ac9 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:06.358418 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 627/1236] 10.222.0.79 () {56 vars in 1103 bytes} [Tue Aug 30 01:03:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:03:06.368175 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ea6a4c-3ea4-4fed-83b5-eeec504cc32f None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:06.511786 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:03:06.539071 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ea6a4c-3ea4-4fed-83b5-eeec504cc32f None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:06.609665 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29e8b7b-5100-489a-8561-b89d5213c081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:06.610542 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29e8b7b-5100-489a-8561-b89d5213c081 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:06.610899 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29e8b7b-5100-489a-8561-b89d5213c081 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:06.611469 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29e8b7b-5100-489a-8561-b89d5213c081 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:06.628635 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29e8b7b-5100-489a-8561-b89d5213c081 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:06.631095 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29e8b7b-5100-489a-8561-b89d5213c081 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:06.654855 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application [None req-f29e8b7b-5100-489a-8561-b89d5213c081 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:03:06.654855 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:03:06.654855 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:03:06.654855 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:03:06.654855 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:03:06.654855 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:03:06.654855 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:03:06.654855 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:03:06.654855 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:03:06.654855 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:03:06.654855 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:03:06.654855 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:03:06.654855 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 01:03:06.654855 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 01:03:06.654855 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 01:03:06.654855 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 01:03:06.665909 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:03:06.665909 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:03:06.665909 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:03:06.665909 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:03:06.665909 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:03:06.665909 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:03:06.665909 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:03:06.665909 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application with Lock( Aug 30 01:03:06.665909 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:03:06.665909 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:03:06.665909 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:03:06.665909 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:03:06.665909 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:03:06.665909 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:03:06.665909 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:03:06.665909 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:03:06.665909 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 01:03:06.667560 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 01:03:06.667560 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:03:06.667560 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Aug 30 01:03:06.667560 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 610/1237] 10.222.0.79 () {56 vars in 1108 bytes} [Tue Aug 30 01:03:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:03:06.667972 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a85d92-afe5-4718-b38e-882148541ac9 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:06.835940 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a85d92-afe5-4718-b38e-882148541ac9 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:06.848386 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:03:06.893255 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d2ac5d-dcc7-4587-a16f-1bce7dd903f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:06.894059 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d2ac5d-dcc7-4587-a16f-1bce7dd903f6 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:06.894459 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d2ac5d-dcc7-4587-a16f-1bce7dd903f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:06.894864 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d2ac5d-dcc7-4587-a16f-1bce7dd903f6 None admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:06.895887 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d2ac5d-dcc7-4587-a16f-1bce7dd903f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:03:06.896521 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d2ac5d-dcc7-4587-a16f-1bce7dd903f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:06.898742 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d2ac5d-dcc7-4587-a16f-1bce7dd903f6 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:06.920196 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 628/1238] 10.222.0.79 () {56 vars in 1109 bytes} [Tue Aug 30 01:03:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:03:06.928996 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29e8b7b-5100-489a-8561-b89d5213c081 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:07.082929 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29e8b7b-5100-489a-8561-b89d5213c081 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:07.134157 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a0b856-64a9-437c-b452-8c7ae133eefb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:07.135249 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a0b856-64a9-437c-b452-8c7ae133eefb None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:07.135735 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a0b856-64a9-437c-b452-8c7ae133eefb None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:07.136205 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a0b856-64a9-437c-b452-8c7ae133eefb None admin] PATH_INFO: `/v3/users/placement` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:07.141331 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:03:07.153778 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a0b856-64a9-437c-b452-8c7ae133eefb None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:07.156416 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a0b856-64a9-437c-b452-8c7ae133eefb None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:07.176041 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application [None req-02a0b856-64a9-437c-b452-8c7ae133eefb None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 30 01:03:07.176041 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:03:07.176041 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:03:07.176041 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:03:07.176041 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:03:07.176041 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:03:07.176041 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:03:07.176041 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:03:07.176041 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:03:07.176041 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:03:07.176041 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:03:07.176041 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:03:07.176041 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 01:03:07.176041 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 01:03:07.176041 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 01:03:07.176041 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 01:03:07.178200 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:03:07.178200 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:03:07.178200 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 01:03:07.178200 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 01:03:07.178200 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 01:03:07.178200 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 01:03:07.178200 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:03:07.178200 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:03:07.178200 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:03:07.178200 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:03:07.178200 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:03:07.178200 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application with Lock( Aug 30 01:03:07.178200 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:03:07.178200 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:03:07.178200 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:03:07.178200 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:03:07.178200 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:03:07.178200 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:03:07.180250 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:03:07.180250 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:03:07.180250 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 01:03:07.180250 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 01:03:07.180250 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 01:03:07.180250 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 01:03:07.180250 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 01:03:07.180250 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 01:03:07.180250 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 30 01:03:07.180250 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Aug 30 01:03:07.180250 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 611/1239] 10.222.0.79 () {56 vars in 1108 bytes} [Tue Aug 30 01:03:06 2022] GET /identity/v3/users/placement => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:03:07.183994 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d2ac5d-dcc7-4587-a16f-1bce7dd903f6 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:07.331870 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d2ac5d-dcc7-4587-a16f-1bce7dd903f6 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:07.381673 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0933799-04a4-49e3-a76e-bdc5ff8bbcac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:07.382421 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0933799-04a4-49e3-a76e-bdc5ff8bbcac None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:07.382776 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0933799-04a4-49e3-a76e-bdc5ff8bbcac None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:07.383226 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0933799-04a4-49e3-a76e-bdc5ff8bbcac None admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:07.384315 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0933799-04a4-49e3-a76e-bdc5ff8bbcac None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:03:07.384765 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0933799-04a4-49e3-a76e-bdc5ff8bbcac None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:07.387032 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0933799-04a4-49e3-a76e-bdc5ff8bbcac None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:07.427318 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 629/1240] 10.222.0.79 () {56 vars in 1143 bytes} [Tue Aug 30 01:03:07 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:03:07.435365 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a0b856-64a9-437c-b452-8c7ae133eefb None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:07.628624 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a0b856-64a9-437c-b452-8c7ae133eefb None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:07.686605 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29612610-a32c-4425-b22e-37267b5e300c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:07.687345 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29612610-a32c-4425-b22e-37267b5e300c None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:07.687672 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29612610-a32c-4425-b22e-37267b5e300c None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:07.687946 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29612610-a32c-4425-b22e-37267b5e300c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:07.796827 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:03:07.811574 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29612610-a32c-4425-b22e-37267b5e300c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:07.814244 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29612610-a32c-4425-b22e-37267b5e300c None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:07.973590 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 612/1241] 10.222.0.79 () {58 vars in 1282 bytes} [Tue Aug 30 01:03:07 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 539 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 01:03:07.981421 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0933799-04a4-49e3-a76e-bdc5ff8bbcac None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:08.022213 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:03:08.129430 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0933799-04a4-49e3-a76e-bdc5ff8bbcac None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:08.182557 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1cf236-51d4-4bca-9bac-ad6a1e37428a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:08.183501 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1cf236-51d4-4bca-9bac-ad6a1e37428a None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:08.183933 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1cf236-51d4-4bca-9bac-ad6a1e37428a None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:08.184370 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1cf236-51d4-4bca-9bac-ad6a1e37428a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:08.198852 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1cf236-51d4-4bca-9bac-ad6a1e37428a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:08.200487 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1cf236-51d4-4bca-9bac-ad6a1e37428a None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:08.220413 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-0b1cf236-51d4-4bca-9bac-ad6a1e37428a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:03:08.220413 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:03:08.220413 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:03:08.220413 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:03:08.220413 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:03:08.220413 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:03:08.220413 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:03:08.220413 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:03:08.220413 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:03:08.220413 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:03:08.220413 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:03:08.220413 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:03:08.220413 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 01:03:08.220413 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 01:03:08.220413 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 01:03:08.220413 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 01:03:08.223659 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:03:08.223659 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:03:08.223659 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:03:08.223659 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:03:08.223659 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:03:08.223659 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:03:08.223659 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:03:08.223659 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Aug 30 01:03:08.223659 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:03:08.223659 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:03:08.223659 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:03:08.223659 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:03:08.223659 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:03:08.223659 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:03:08.223659 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:03:08.223659 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:03:08.223659 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 01:03:08.225433 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 01:03:08.225433 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:03:08.225433 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Aug 30 01:03:08.225433 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 630/1242] 10.222.0.79 () {56 vars in 1108 bytes} [Tue Aug 30 01:03:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 01:03:08.232203 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29612610-a32c-4425-b22e-37267b5e300c None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:08.364954 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:03:08.376574 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29612610-a32c-4425-b22e-37267b5e300c None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:08.430676 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f7cb5a-53cb-4f51-abee-9b9f7a1860dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:08.431490 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f7cb5a-53cb-4f51-abee-9b9f7a1860dc None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:08.431846 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f7cb5a-53cb-4f51-abee-9b9f7a1860dc None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:08.432178 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f7cb5a-53cb-4f51-abee-9b9f7a1860dc None admin] PATH_INFO: `/v3/domains` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:08.432976 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f7cb5a-53cb-4f51-abee-9b9f7a1860dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:03:08.433453 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f7cb5a-53cb-4f51-abee-9b9f7a1860dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:08.435917 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f7cb5a-53cb-4f51-abee-9b9f7a1860dc None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:08.457298 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 613/1243] 10.222.0.79 () {56 vars in 1109 bytes} [Tue Aug 30 01:03:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:03:08.464027 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1cf236-51d4-4bca-9bac-ad6a1e37428a None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:08.579892 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:03:08.608153 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1cf236-51d4-4bca-9bac-ad6a1e37428a None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:08.656100 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1a20a3-d3f4-47c1-ae62-82f7f534478d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:08.656919 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1a20a3-d3f4-47c1-ae62-82f7f534478d None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:08.657354 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1a20a3-d3f4-47c1-ae62-82f7f534478d None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:08.657799 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1a20a3-d3f4-47c1-ae62-82f7f534478d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:08.668515 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1a20a3-d3f4-47c1-ae62-82f7f534478d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:08.670459 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1a20a3-d3f4-47c1-ae62-82f7f534478d None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:08.685868 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-1d1a20a3-d3f4-47c1-ae62-82f7f534478d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 01:03:08.685868 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:03:08.685868 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:03:08.685868 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:03:08.685868 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:03:08.685868 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:03:08.685868 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:03:08.685868 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:03:08.685868 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:03:08.685868 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:03:08.685868 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:03:08.685868 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:03:08.685868 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 01:03:08.685868 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 01:03:08.685868 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 01:03:08.687890 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 01:03:08.687890 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:03:08.687890 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:03:08.687890 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:03:08.687890 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:03:08.687890 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:03:08.687890 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:03:08.687890 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:03:08.687890 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Aug 30 01:03:08.687890 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:03:08.687890 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:03:08.687890 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:03:08.687890 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:03:08.687890 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:03:08.687890 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:03:08.687890 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:03:08.687890 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:03:08.689590 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 01:03:08.689590 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 01:03:08.689590 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 01:03:08.689590 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 01:03:08.689590 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 01:03:08.689590 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 01:03:08.689590 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 01:03:08.689590 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Aug 30 01:03:08.689590 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 631/1244] 10.222.0.79 () {56 vars in 1111 bytes} [Tue Aug 30 01:03:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:03:08.696575 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f7cb5a-53cb-4f51-abee-9b9f7a1860dc None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:08.846677 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f7cb5a-53cb-4f51-abee-9b9f7a1860dc None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:08.895097 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbb6e02-b3d7-47cc-b002-f28514dd0267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:08.896213 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbb6e02-b3d7-47cc-b002-f28514dd0267 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:08.896638 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbb6e02-b3d7-47cc-b002-f28514dd0267 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:08.897047 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbb6e02-b3d7-47cc-b002-f28514dd0267 None admin] PATH_INFO: `/v3/projects` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:08.897875 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbb6e02-b3d7-47cc-b002-f28514dd0267 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:03:08.898318 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbb6e02-b3d7-47cc-b002-f28514dd0267 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:08.901115 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbb6e02-b3d7-47cc-b002-f28514dd0267 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:08.921397 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 614/1245] 10.222.0.79 () {56 vars in 1148 bytes} [Tue Aug 30 01:03:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:03:08.931337 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1a20a3-d3f4-47c1-ae62-82f7f534478d None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:09.081097 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1a20a3-d3f4-47c1-ae62-82f7f534478d None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:09.124869 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de116083-66be-4989-a4d6-b504ae3b4367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:09.125364 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de116083-66be-4989-a4d6-b504ae3b4367 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:09.125650 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de116083-66be-4989-a4d6-b504ae3b4367 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:09.125902 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de116083-66be-4989-a4d6-b504ae3b4367 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:09.126632 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de116083-66be-4989-a4d6-b504ae3b4367 None admin] RBAC: Adding query filter params (role.id=687d3359d6b2413b84ca5a54d30d5488, scope.project.id=0eec3a73673e45dc881de586b9b0fbbb, user.id=d68e91e4259e449797fb83de548aec1e) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:03:09.126954 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de116083-66be-4989-a4d6-b504ae3b4367 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:09.128489 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de116083-66be-4989-a4d6-b504ae3b4367 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:09.138990 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 632/1246] 10.222.0.79 () {56 vars in 1374 bytes} [Tue Aug 30 01:03:08 2022] GET /identity/v3/role_assignments?user.id=d68e91e4259e449797fb83de548aec1e&scope.project.id=0eec3a73673e45dc881de586b9b0fbbb&role.id=687d3359d6b2413b84ca5a54d30d5488 => generated 608 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:03:11.360346 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22eec4b-aecb-4324-92da-f184b3eb3196 None None] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:11.361258 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22eec4b-aecb-4324-92da-f184b3eb3196 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:11.361258 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22eec4b-aecb-4324-92da-f184b3eb3196 None None] PATH_INFO: `/` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:11.362200 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 615/1247] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 01:03:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 01:03:11.368215 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f78dcc-a5b7-4bcf-9b0e-7ab842bac80c None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:11.369116 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f78dcc-a5b7-4bcf-9b0e-7ab842bac80c None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:11.369116 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f78dcc-a5b7-4bcf-9b0e-7ab842bac80c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:11.375787 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:03:11.393284 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-60f78dcc-a5b7-4bcf-9b0e-7ab842bac80c None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:03:11.394552 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-60f78dcc-a5b7-4bcf-9b0e-7ab842bac80c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:03:11.487409 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 633/1248] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 01:03:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 01:03:11.819470 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22eec4b-aecb-4324-92da-f184b3eb3196 None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:11.845077 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:03:11.962802 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22eec4b-aecb-4324-92da-f184b3eb3196 None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:12.016152 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c20258-93d7-4e2d-af98-440429d01afa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:12.016972 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c20258-93d7-4e2d-af98-440429d01afa None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:12.017434 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c20258-93d7-4e2d-af98-440429d01afa None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:12.017760 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c20258-93d7-4e2d-af98-440429d01afa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:12.033627 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c20258-93d7-4e2d-af98-440429d01afa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 01:03:12.041550 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application [None req-01c20258-93d7-4e2d-af98-440429d01afa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 01:03:12.041550 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:03:12.041550 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:03:12.041550 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:03:12.041550 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:03:12.041550 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:03:12.041550 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:03:12.041550 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:03:12.041550 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:03:12.041550 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:03:12.041550 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:03:12.041550 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:03:12.041550 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 01:03:12.041550 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 01:03:12.041550 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 01:03:12.041550 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 01:03:12.042816 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 01:03:12.042816 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 01:03:12.042816 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 01:03:12.042816 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 01:03:12.042816 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:03:12.042816 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:03:12.042816 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:03:12.042816 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:03:12.042816 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:03:12.042816 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:03:12.042816 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:03:12.042816 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application with Lock( Aug 30 01:03:12.042816 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:03:12.042816 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:03:12.042816 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:03:12.042816 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:03:12.043880 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:03:12.043880 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:03:12.043880 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:03:12.043880 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:03:12.043880 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 01:03:12.043880 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 01:03:12.043880 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 01:03:12.043880 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 01:03:12.043880 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 01:03:12.043880 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 01:03:12.043880 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 01:03:12.043880 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Aug 30 01:03:12.043880 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 616/1249] 10.222.0.79 () {56 vars in 1096 bytes} [Tue Aug 30 01:03:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:03:12.050603 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f78dcc-a5b7-4bcf-9b0e-7ab842bac80c None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:12.196309 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f78dcc-a5b7-4bcf-9b0e-7ab842bac80c None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:12.245534 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:03:12.252192 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9728c9-a2c9-49c7-a9dd-7d9e8e0f0e28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:12.252860 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9728c9-a2c9-49c7-a9dd-7d9e8e0f0e28 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:12.253175 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9728c9-a2c9-49c7-a9dd-7d9e8e0f0e28 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:12.253465 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9728c9-a2c9-49c7-a9dd-7d9e8e0f0e28 None admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:12.254219 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9728c9-a2c9-49c7-a9dd-7d9e8e0f0e28 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:03:12.254521 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9728c9-a2c9-49c7-a9dd-7d9e8e0f0e28 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:12.255930 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9728c9-a2c9-49c7-a9dd-7d9e8e0f0e28 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:12.268458 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 634/1250] 10.222.0.79 () {56 vars in 1099 bytes} [Tue Aug 30 01:03:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:03:12.274875 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c20258-93d7-4e2d-af98-440429d01afa None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:12.401111 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:03:12.427499 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c20258-93d7-4e2d-af98-440429d01afa None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:12.481525 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e953de8-82e1-4bf6-be32-f30a6c60381a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:12.482509 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e953de8-82e1-4bf6-be32-f30a6c60381a None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:12.483011 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e953de8-82e1-4bf6-be32-f30a6c60381a None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:12.483692 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e953de8-82e1-4bf6-be32-f30a6c60381a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:12.501795 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e953de8-82e1-4bf6-be32-f30a6c60381a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:12.503403 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e953de8-82e1-4bf6-be32-f30a6c60381a None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:12.530524 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application [None req-2e953de8-82e1-4bf6-be32-f30a6c60381a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:03:12.530524 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:03:12.530524 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:03:12.530524 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:03:12.530524 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:03:12.530524 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:03:12.530524 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:03:12.530524 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:03:12.530524 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:03:12.530524 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:03:12.530524 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:03:12.530524 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:03:12.530524 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 01:03:12.530524 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 01:03:12.530524 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 01:03:12.530524 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 01:03:12.531772 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:03:12.531772 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:03:12.531772 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:03:12.531772 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:03:12.531772 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:03:12.531772 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:03:12.531772 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:03:12.531772 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application with Lock( Aug 30 01:03:12.531772 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:03:12.531772 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:03:12.531772 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:03:12.531772 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:03:12.531772 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:03:12.531772 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:03:12.531772 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:03:12.531772 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:03:12.531772 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 01:03:12.532851 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 01:03:12.532851 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:03:12.532851 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Aug 30 01:03:12.532851 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 617/1251] 10.222.0.79 () {56 vars in 1108 bytes} [Tue Aug 30 01:03:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:03:12.540267 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9728c9-a2c9-49c7-a9dd-7d9e8e0f0e28 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:12.684299 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9728c9-a2c9-49c7-a9dd-7d9e8e0f0e28 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:12.738391 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77295c12-e5f8-4778-a458-b6dc73c44d58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:12.739308 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77295c12-e5f8-4778-a458-b6dc73c44d58 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:12.739632 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77295c12-e5f8-4778-a458-b6dc73c44d58 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:12.739975 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77295c12-e5f8-4778-a458-b6dc73c44d58 None admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:12.741122 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77295c12-e5f8-4778-a458-b6dc73c44d58 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:03:12.741646 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77295c12-e5f8-4778-a458-b6dc73c44d58 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:12.744137 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77295c12-e5f8-4778-a458-b6dc73c44d58 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:12.764983 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 635/1252] 10.222.0.79 () {56 vars in 1109 bytes} [Tue Aug 30 01:03:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:03:12.772262 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e953de8-82e1-4bf6-be32-f30a6c60381a None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:12.944575 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e953de8-82e1-4bf6-be32-f30a6c60381a None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:12.980420 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:03:12.996594 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1cf793-7c87-4b00-ae6c-175935d8761b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:12.997377 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1cf793-7c87-4b00-ae6c-175935d8761b None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:12.997831 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1cf793-7c87-4b00-ae6c-175935d8761b None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:12.998123 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1cf793-7c87-4b00-ae6c-175935d8761b None admin] PATH_INFO: `/v3/users/placement` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:13.007655 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1cf793-7c87-4b00-ae6c-175935d8761b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:13.010422 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1cf793-7c87-4b00-ae6c-175935d8761b None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:13.031388 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application [None req-6f1cf793-7c87-4b00-ae6c-175935d8761b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 30 01:03:13.031388 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:03:13.031388 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:03:13.031388 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:03:13.031388 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:03:13.031388 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:03:13.031388 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:03:13.031388 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:03:13.031388 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:03:13.031388 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:03:13.031388 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:03:13.031388 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:03:13.031388 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 01:03:13.031388 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 01:03:13.031388 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 01:03:13.031388 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 01:03:13.033613 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:03:13.033613 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:03:13.033613 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 01:03:13.033613 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 01:03:13.033613 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 01:03:13.033613 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 01:03:13.033613 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:03:13.033613 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:03:13.033613 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:03:13.033613 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:03:13.033613 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:03:13.033613 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application with Lock( Aug 30 01:03:13.033613 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:03:13.033613 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:03:13.033613 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:03:13.033613 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:03:13.033613 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:03:13.033613 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:03:13.035119 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:03:13.035119 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:03:13.035119 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 01:03:13.035119 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 01:03:13.035119 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 01:03:13.035119 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 01:03:13.035119 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 01:03:13.035119 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 01:03:13.035119 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 30 01:03:13.035119 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Aug 30 01:03:13.035119 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 618/1253] 10.222.0.79 () {56 vars in 1108 bytes} [Tue Aug 30 01:03:12 2022] GET /identity/v3/users/placement => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:03:13.040910 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77295c12-e5f8-4778-a458-b6dc73c44d58 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:13.116958 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:03:13.185288 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77295c12-e5f8-4778-a458-b6dc73c44d58 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:13.229580 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c06b87-490f-4155-b3cd-e51617f6ce93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:13.230957 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c06b87-490f-4155-b3cd-e51617f6ce93 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:13.231592 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c06b87-490f-4155-b3cd-e51617f6ce93 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:13.232285 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c06b87-490f-4155-b3cd-e51617f6ce93 None admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:13.233909 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c06b87-490f-4155-b3cd-e51617f6ce93 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:03:13.234725 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c06b87-490f-4155-b3cd-e51617f6ce93 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:13.237585 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c06b87-490f-4155-b3cd-e51617f6ce93 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:13.266192 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 636/1254] 10.222.0.79 () {56 vars in 1143 bytes} [Tue Aug 30 01:03:13 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:03:13.267733 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1cf793-7c87-4b00-ae6c-175935d8761b None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:13.388384 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1cf793-7c87-4b00-ae6c-175935d8761b None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:13.426890 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acf32bd-1e65-4e5b-81e9-b368670bdf65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:13.427593 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acf32bd-1e65-4e5b-81e9-b368670bdf65 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:13.427930 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acf32bd-1e65-4e5b-81e9-b368670bdf65 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:13.428200 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acf32bd-1e65-4e5b-81e9-b368670bdf65 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:13.493787 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:03:13.508875 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acf32bd-1e65-4e5b-81e9-b368670bdf65 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:13.510940 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acf32bd-1e65-4e5b-81e9-b368670bdf65 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:13.650605 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 619/1255] 10.222.0.79 () {58 vars in 1282 bytes} [Tue Aug 30 01:03:13 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 01:03:13.657544 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c06b87-490f-4155-b3cd-e51617f6ce93 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:13.812933 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c06b87-490f-4155-b3cd-e51617f6ce93 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:13.830136 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:03:13.858016 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56bdb83-f382-4d2b-b0a0-c222254d2d74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:13.858697 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56bdb83-f382-4d2b-b0a0-c222254d2d74 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:13.858982 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56bdb83-f382-4d2b-b0a0-c222254d2d74 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:13.859269 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56bdb83-f382-4d2b-b0a0-c222254d2d74 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:13.873177 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56bdb83-f382-4d2b-b0a0-c222254d2d74 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:13.874896 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56bdb83-f382-4d2b-b0a0-c222254d2d74 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:13.892574 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-c56bdb83-f382-4d2b-b0a0-c222254d2d74 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:03:13.892574 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:03:13.892574 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:03:13.892574 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:03:13.892574 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:03:13.892574 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:03:13.892574 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:03:13.892574 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:03:13.892574 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:03:13.892574 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:03:13.892574 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:03:13.892574 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:03:13.892574 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 01:03:13.892574 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 01:03:13.892574 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 01:03:13.892574 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 01:03:13.894584 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:03:13.894584 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:03:13.894584 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:03:13.894584 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:03:13.894584 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:03:13.894584 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:03:13.894584 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:03:13.894584 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Aug 30 01:03:13.894584 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:03:13.894584 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:03:13.894584 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:03:13.894584 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:03:13.894584 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:03:13.894584 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:03:13.894584 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:03:13.894584 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:03:13.894584 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 01:03:13.896447 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 01:03:13.896447 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:03:13.896447 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Aug 30 01:03:13.896447 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 637/1256] 10.222.0.79 () {56 vars in 1108 bytes} [Tue Aug 30 01:03:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:03:13.901170 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acf32bd-1e65-4e5b-81e9-b368670bdf65 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:14.032843 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:03:14.047333 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acf32bd-1e65-4e5b-81e9-b368670bdf65 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:14.089844 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa29e23a-156a-4031-ae8a-caabcdb04c20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:14.090524 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa29e23a-156a-4031-ae8a-caabcdb04c20 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:14.090842 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa29e23a-156a-4031-ae8a-caabcdb04c20 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:14.091182 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa29e23a-156a-4031-ae8a-caabcdb04c20 None admin] PATH_INFO: `/v3/domains` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:14.091892 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa29e23a-156a-4031-ae8a-caabcdb04c20 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:03:14.092237 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa29e23a-156a-4031-ae8a-caabcdb04c20 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:14.094430 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa29e23a-156a-4031-ae8a-caabcdb04c20 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:14.113261 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 620/1257] 10.222.0.79 () {56 vars in 1109 bytes} [Tue Aug 30 01:03:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:03:14.121518 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56bdb83-f382-4d2b-b0a0-c222254d2d74 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:14.266217 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56bdb83-f382-4d2b-b0a0-c222254d2d74 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:14.315998 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69634881-22a9-4f4a-9bf9-f2f3199909ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:14.316652 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69634881-22a9-4f4a-9bf9-f2f3199909ed None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:14.316983 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69634881-22a9-4f4a-9bf9-f2f3199909ed None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:14.317321 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69634881-22a9-4f4a-9bf9-f2f3199909ed None admin] PATH_INFO: `/v3/projects/service` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:14.327002 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69634881-22a9-4f4a-9bf9-f2f3199909ed None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:14.328506 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69634881-22a9-4f4a-9bf9-f2f3199909ed None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:14.342599 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-69634881-22a9-4f4a-9bf9-f2f3199909ed None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 01:03:14.342599 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:03:14.342599 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:03:14.342599 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:03:14.342599 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:03:14.342599 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:03:14.342599 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:03:14.342599 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:03:14.342599 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:03:14.342599 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:03:14.342599 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:03:14.342599 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:03:14.342599 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 01:03:14.342599 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 01:03:14.342599 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 01:03:14.343766 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 01:03:14.343766 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:03:14.343766 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:03:14.343766 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:03:14.343766 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:03:14.343766 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:03:14.343766 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:03:14.343766 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:03:14.343766 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Aug 30 01:03:14.343766 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:03:14.343766 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:03:14.343766 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:03:14.343766 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:03:14.343766 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:03:14.343766 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:03:14.343766 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:03:14.343766 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:03:14.345327 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 01:03:14.345327 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 01:03:14.345327 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 01:03:14.345327 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 01:03:14.345327 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 01:03:14.345327 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 01:03:14.345327 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 01:03:14.345327 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Aug 30 01:03:14.345327 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 638/1258] 10.222.0.79 () {56 vars in 1111 bytes} [Tue Aug 30 01:03:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 01:03:14.353605 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa29e23a-156a-4031-ae8a-caabcdb04c20 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:14.510205 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa29e23a-156a-4031-ae8a-caabcdb04c20 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:14.565147 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab4bdae-e524-4bc9-a48f-16660561275a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:14.565983 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab4bdae-e524-4bc9-a48f-16660561275a None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:14.566261 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab4bdae-e524-4bc9-a48f-16660561275a None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:14.566530 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab4bdae-e524-4bc9-a48f-16660561275a None admin] PATH_INFO: `/v3/projects` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:14.567277 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab4bdae-e524-4bc9-a48f-16660561275a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:03:14.567577 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab4bdae-e524-4bc9-a48f-16660561275a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:14.569308 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab4bdae-e524-4bc9-a48f-16660561275a None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:14.588236 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 621/1259] 10.222.0.79 () {56 vars in 1148 bytes} [Tue Aug 30 01:03:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:03:14.594627 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69634881-22a9-4f4a-9bf9-f2f3199909ed None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:14.631446 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:03:14.738921 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69634881-22a9-4f4a-9bf9-f2f3199909ed None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:14.779878 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f04fa1-d00f-41e5-8f1f-4c7b95663b78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:14.780406 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f04fa1-d00f-41e5-8f1f-4c7b95663b78 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:14.780680 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f04fa1-d00f-41e5-8f1f-4c7b95663b78 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:14.780946 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f04fa1-d00f-41e5-8f1f-4c7b95663b78 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:14.781694 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f04fa1-d00f-41e5-8f1f-4c7b95663b78 None admin] RBAC: Adding query filter params (role.id=d14c3070c9184d76a7b23df69bd3db07, scope.project.id=0eec3a73673e45dc881de586b9b0fbbb, user.id=d68e91e4259e449797fb83de548aec1e) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:03:14.781996 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f04fa1-d00f-41e5-8f1f-4c7b95663b78 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:14.783528 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f04fa1-d00f-41e5-8f1f-4c7b95663b78 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:14.790089 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 639/1260] 10.222.0.79 () {56 vars in 1374 bytes} [Tue Aug 30 01:03:14 2022] GET /identity/v3/role_assignments?user.id=d68e91e4259e449797fb83de548aec1e&scope.project.id=0eec3a73673e45dc881de586b9b0fbbb&role.id=d14c3070c9184d76a7b23df69bd3db07 => generated 259 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:03:16.822133 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387a37fb-4733-473f-a598-f578fed90412 None None] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:16.822767 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387a37fb-4733-473f-a598-f578fed90412 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:16.822767 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387a37fb-4733-473f-a598-f578fed90412 None None] PATH_INFO: `/` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:16.824048 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 622/1261] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 01:03:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 01:03:16.829717 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af4a1b4-046e-4877-bd30-f2ed7bb58ff9 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:16.830237 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af4a1b4-046e-4877-bd30-f2ed7bb58ff9 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:16.830237 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af4a1b4-046e-4877-bd30-f2ed7bb58ff9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:16.849145 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-0af4a1b4-046e-4877-bd30-f2ed7bb58ff9 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:03:16.850352 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-0af4a1b4-046e-4877-bd30-f2ed7bb58ff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:03:16.926255 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 640/1262] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 01:03:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 01:03:17.202258 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387a37fb-4733-473f-a598-f578fed90412 None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:17.214363 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:03:17.368908 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387a37fb-4733-473f-a598-f578fed90412 None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:17.424583 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cb857b-99d7-46f5-88fa-be1488ac2f41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:17.425218 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cb857b-99d7-46f5-88fa-be1488ac2f41 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:17.425491 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cb857b-99d7-46f5-88fa-be1488ac2f41 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:17.425756 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cb857b-99d7-46f5-88fa-be1488ac2f41 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:17.437797 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cb857b-99d7-46f5-88fa-be1488ac2f41 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 01:03:17.442755 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application [None req-c2cb857b-99d7-46f5-88fa-be1488ac2f41 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 01:03:17.442755 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:03:17.442755 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:03:17.442755 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:03:17.442755 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:03:17.442755 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:03:17.442755 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:03:17.442755 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:03:17.442755 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:03:17.442755 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:03:17.442755 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:03:17.442755 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:03:17.442755 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 01:03:17.442755 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 01:03:17.442755 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 01:03:17.442755 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 01:03:17.444760 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 01:03:17.444760 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 01:03:17.444760 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 01:03:17.444760 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 01:03:17.444760 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:03:17.444760 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:03:17.444760 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:03:17.444760 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:03:17.444760 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:03:17.444760 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:03:17.444760 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:03:17.444760 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application with Lock( Aug 30 01:03:17.444760 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:03:17.444760 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:03:17.444760 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:03:17.444760 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:03:17.446546 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:03:17.446546 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:03:17.446546 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:03:17.446546 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:03:17.446546 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 01:03:17.446546 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 01:03:17.446546 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 01:03:17.446546 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 01:03:17.446546 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 01:03:17.446546 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 01:03:17.446546 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 01:03:17.446546 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Aug 30 01:03:17.446546 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 623/1263] 10.222.0.79 () {56 vars in 1096 bytes} [Tue Aug 30 01:03:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:03:17.451994 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af4a1b4-046e-4877-bd30-f2ed7bb58ff9 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:17.472641 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:03:17.611319 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af4a1b4-046e-4877-bd30-f2ed7bb58ff9 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:17.656197 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ad42b2-cf3b-4660-a50e-d160007d9d55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:17.656856 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ad42b2-cf3b-4660-a50e-d160007d9d55 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:17.657180 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ad42b2-cf3b-4660-a50e-d160007d9d55 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:17.657501 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ad42b2-cf3b-4660-a50e-d160007d9d55 None admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:17.658229 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ad42b2-cf3b-4660-a50e-d160007d9d55 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:03:17.658580 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ad42b2-cf3b-4660-a50e-d160007d9d55 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:17.660026 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ad42b2-cf3b-4660-a50e-d160007d9d55 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:17.669809 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 641/1264] 10.222.0.79 () {56 vars in 1099 bytes} [Tue Aug 30 01:03:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:03:17.675843 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cb857b-99d7-46f5-88fa-be1488ac2f41 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:17.750521 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:03:17.787801 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cb857b-99d7-46f5-88fa-be1488ac2f41 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:17.826786 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042f572b-9445-44f7-92f6-2037363574fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:17.827577 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042f572b-9445-44f7-92f6-2037363574fe None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:17.827724 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042f572b-9445-44f7-92f6-2037363574fe None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:17.827984 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042f572b-9445-44f7-92f6-2037363574fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:17.839651 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042f572b-9445-44f7-92f6-2037363574fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:17.841238 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042f572b-9445-44f7-92f6-2037363574fe None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:17.857842 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application [None req-042f572b-9445-44f7-92f6-2037363574fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:03:17.857842 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:03:17.857842 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:03:17.857842 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:03:17.857842 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:03:17.857842 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:03:17.857842 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:03:17.857842 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:03:17.857842 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:03:17.857842 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:03:17.857842 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:03:17.857842 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:03:17.857842 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 01:03:17.857842 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 01:03:17.857842 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 01:03:17.857842 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 01:03:17.859118 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:03:17.859118 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:03:17.859118 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:03:17.859118 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:03:17.859118 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:03:17.859118 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:03:17.859118 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:03:17.859118 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application with Lock( Aug 30 01:03:17.859118 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:03:17.859118 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:03:17.859118 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:03:17.859118 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:03:17.859118 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:03:17.859118 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:03:17.859118 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:03:17.859118 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:03:17.859118 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 01:03:17.860837 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 01:03:17.860837 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:03:17.860837 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Aug 30 01:03:17.860837 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 624/1265] 10.222.0.79 () {56 vars in 1108 bytes} [Tue Aug 30 01:03:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 01:03:17.868996 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ad42b2-cf3b-4660-a50e-d160007d9d55 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:17.979096 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:03:18.000109 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ad42b2-cf3b-4660-a50e-d160007d9d55 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:18.040397 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b8a53d-ac83-48de-a0ad-b2e3fcaefa8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:18.040916 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b8a53d-ac83-48de-a0ad-b2e3fcaefa8e None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:18.041198 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b8a53d-ac83-48de-a0ad-b2e3fcaefa8e None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:18.041470 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b8a53d-ac83-48de-a0ad-b2e3fcaefa8e None admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:18.042122 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b8a53d-ac83-48de-a0ad-b2e3fcaefa8e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:03:18.042420 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b8a53d-ac83-48de-a0ad-b2e3fcaefa8e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:18.043815 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b8a53d-ac83-48de-a0ad-b2e3fcaefa8e None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:18.056885 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 642/1266] 10.222.0.79 () {56 vars in 1109 bytes} [Tue Aug 30 01:03:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:03:18.065692 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042f572b-9445-44f7-92f6-2037363574fe None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:18.178720 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042f572b-9445-44f7-92f6-2037363574fe None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:18.200915 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:03:18.218236 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7861de70-3ab3-467b-9448-a1422afcedba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:18.218941 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7861de70-3ab3-467b-9448-a1422afcedba None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:18.219283 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7861de70-3ab3-467b-9448-a1422afcedba None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:18.219555 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7861de70-3ab3-467b-9448-a1422afcedba None admin] PATH_INFO: `/v3/users/placement` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:18.228119 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7861de70-3ab3-467b-9448-a1422afcedba None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:18.229648 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7861de70-3ab3-467b-9448-a1422afcedba None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:18.242481 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application [None req-7861de70-3ab3-467b-9448-a1422afcedba None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 30 01:03:18.242481 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:03:18.242481 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:03:18.242481 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:03:18.242481 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:03:18.242481 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:03:18.242481 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:03:18.242481 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:03:18.242481 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:03:18.242481 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:03:18.242481 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:03:18.242481 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:03:18.242481 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 01:03:18.242481 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 01:03:18.242481 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 01:03:18.242481 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 01:03:18.244314 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:03:18.244314 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:03:18.244314 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 01:03:18.244314 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 01:03:18.244314 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 01:03:18.244314 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 01:03:18.244314 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:03:18.244314 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:03:18.244314 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:03:18.244314 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:03:18.244314 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:03:18.244314 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application with Lock( Aug 30 01:03:18.244314 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:03:18.244314 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:03:18.244314 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:03:18.244314 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:03:18.244314 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:03:18.244314 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:03:18.246648 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:03:18.246648 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:03:18.246648 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 01:03:18.246648 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 01:03:18.246648 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 01:03:18.246648 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 01:03:18.246648 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 01:03:18.246648 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 01:03:18.246648 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 30 01:03:18.246648 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Aug 30 01:03:18.246648 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 625/1267] 10.222.0.79 () {56 vars in 1108 bytes} [Tue Aug 30 01:03:18 2022] GET /identity/v3/users/placement => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:03:18.251353 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b8a53d-ac83-48de-a0ad-b2e3fcaefa8e None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:18.359933 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b8a53d-ac83-48de-a0ad-b2e3fcaefa8e None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:18.396012 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c56cdc2-a952-4631-b348-5555870bd17c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:18.396625 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c56cdc2-a952-4631-b348-5555870bd17c None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:18.396902 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c56cdc2-a952-4631-b348-5555870bd17c None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:18.397171 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c56cdc2-a952-4631-b348-5555870bd17c None admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:18.397907 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c56cdc2-a952-4631-b348-5555870bd17c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:03:18.398211 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c56cdc2-a952-4631-b348-5555870bd17c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:18.399989 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c56cdc2-a952-4631-b348-5555870bd17c None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:18.410070 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:03:18.420940 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 643/1268] 10.222.0.79 () {56 vars in 1143 bytes} [Tue Aug 30 01:03:18 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:03:18.427383 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7861de70-3ab3-467b-9448-a1422afcedba None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:18.617789 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7861de70-3ab3-467b-9448-a1422afcedba None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:18.676982 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68400354-aa55-4f05-bfd7-743458f12861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:18.678154 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68400354-aa55-4f05-bfd7-743458f12861 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:18.678644 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68400354-aa55-4f05-bfd7-743458f12861 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:18.679161 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68400354-aa55-4f05-bfd7-743458f12861 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:18.701227 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68400354-aa55-4f05-bfd7-743458f12861 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:18.704415 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68400354-aa55-4f05-bfd7-743458f12861 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:18.732129 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application [None req-68400354-aa55-4f05-bfd7-743458f12861 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:03:18.732129 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:03:18.732129 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:03:18.732129 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:03:18.732129 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:03:18.732129 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:03:18.732129 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:03:18.732129 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:03:18.732129 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:03:18.732129 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:03:18.732129 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:03:18.732129 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:03:18.732129 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 01:03:18.732129 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 01:03:18.732129 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 01:03:18.732129 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 01:03:18.733754 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:03:18.733754 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:03:18.733754 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:03:18.733754 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:03:18.733754 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:03:18.733754 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:03:18.733754 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:03:18.733754 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application with Lock( Aug 30 01:03:18.733754 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:03:18.733754 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:03:18.733754 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:03:18.733754 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:03:18.733754 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:03:18.733754 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:03:18.733754 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:03:18.733754 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:03:18.733754 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 01:03:18.735714 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 01:03:18.735714 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:03:18.735714 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Aug 30 01:03:18.735714 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 626/1269] 10.222.0.79 () {56 vars in 1108 bytes} [Tue Aug 30 01:03:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:03:18.741052 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c56cdc2-a952-4631-b348-5555870bd17c None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:18.851911 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c56cdc2-a952-4631-b348-5555870bd17c None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:18.888236 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d93395a-3793-44de-a1f8-4a74c62e7005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:18.888941 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d93395a-3793-44de-a1f8-4a74c62e7005 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:18.889066 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d93395a-3793-44de-a1f8-4a74c62e7005 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:18.889299 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d93395a-3793-44de-a1f8-4a74c62e7005 None admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:18.890060 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d93395a-3793-44de-a1f8-4a74c62e7005 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:03:18.890368 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d93395a-3793-44de-a1f8-4a74c62e7005 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:18.891771 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d93395a-3793-44de-a1f8-4a74c62e7005 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:18.903863 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 644/1270] 10.222.0.79 () {56 vars in 1109 bytes} [Tue Aug 30 01:03:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:03:18.910185 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68400354-aa55-4f05-bfd7-743458f12861 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:18.966325 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:03:19.083019 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68400354-aa55-4f05-bfd7-743458f12861 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:19.121563 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb2ab93-91f8-4268-b579-0fcbff1798ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:19.122201 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb2ab93-91f8-4268-b579-0fcbff1798ac None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:19.122478 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb2ab93-91f8-4268-b579-0fcbff1798ac None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:19.122780 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb2ab93-91f8-4268-b579-0fcbff1798ac None admin] PATH_INFO: `/v3/projects/service` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:19.130010 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb2ab93-91f8-4268-b579-0fcbff1798ac None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:19.131490 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb2ab93-91f8-4268-b579-0fcbff1798ac None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:19.143655 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application [None req-ceb2ab93-91f8-4268-b579-0fcbff1798ac None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 01:03:19.143655 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:03:19.143655 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:03:19.143655 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:03:19.143655 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:03:19.143655 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:03:19.143655 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:03:19.143655 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:03:19.143655 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:03:19.143655 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:03:19.143655 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:03:19.143655 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:03:19.143655 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 01:03:19.143655 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 01:03:19.143655 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 01:03:19.145333 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 01:03:19.145333 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:03:19.145333 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:03:19.145333 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:03:19.145333 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:03:19.145333 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:03:19.145333 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:03:19.145333 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:03:19.145333 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application with Lock( Aug 30 01:03:19.145333 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:03:19.145333 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:03:19.145333 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:03:19.145333 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:03:19.145333 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:03:19.145333 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:03:19.145333 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:03:19.145333 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:03:19.147221 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 01:03:19.147221 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 01:03:19.147221 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 01:03:19.147221 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 01:03:19.147221 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 01:03:19.147221 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 01:03:19.147221 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 01:03:19.147221 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Aug 30 01:03:19.147221 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 627/1271] 10.222.0.79 () {56 vars in 1111 bytes} [Tue Aug 30 01:03:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 01:03:19.152884 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d93395a-3793-44de-a1f8-4a74c62e7005 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:19.219506 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:03:19.265726 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d93395a-3793-44de-a1f8-4a74c62e7005 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:19.302661 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86ac7d9-fc39-431a-a8fc-b203ab12014c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:19.303297 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86ac7d9-fc39-431a-a8fc-b203ab12014c None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:19.303573 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86ac7d9-fc39-431a-a8fc-b203ab12014c None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:19.303840 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86ac7d9-fc39-431a-a8fc-b203ab12014c None admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:19.304676 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86ac7d9-fc39-431a-a8fc-b203ab12014c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:03:19.305036 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86ac7d9-fc39-431a-a8fc-b203ab12014c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:19.306455 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86ac7d9-fc39-431a-a8fc-b203ab12014c None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:19.319636 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 645/1272] 10.222.0.79 () {56 vars in 1148 bytes} [Tue Aug 30 01:03:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:03:19.328754 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb2ab93-91f8-4268-b579-0fcbff1798ac None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:19.429686 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:03:19.440714 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb2ab93-91f8-4268-b579-0fcbff1798ac None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:19.482439 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0bfe89-6c6b-48d5-a6f3-4d8a1f98040b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:19.483097 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0bfe89-6c6b-48d5-a6f3-4d8a1f98040b None admin] REQUEST_METHOD: `PUT` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:19.483403 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0bfe89-6c6b-48d5-a6f3-4d8a1f98040b None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:19.483676 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0bfe89-6c6b-48d5-a6f3-4d8a1f98040b None admin] PATH_INFO: `/v3/projects/0eec3a73673e45dc881de586b9b0fbbb/users/d68e91e4259e449797fb83de548aec1e/roles/d14c3070c9184d76a7b23df69bd3db07` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:19.485603 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0bfe89-6c6b-48d5-a6f3-4d8a1f98040b None admin] RBAC: Authorizing `identity:create_grant(project_id=0eec3a73673e45dc881de586b9b0fbbb, user_id=d68e91e4259e449797fb83de548aec1e, role_id=d14c3070c9184d76a7b23df69bd3db07)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:19.487067 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0bfe89-6c6b-48d5-a6f3-4d8a1f98040b None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:19.500718 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 628/1273] 10.222.0.79 () {58 vars in 1439 bytes} [Tue Aug 30 01:03:19 2022] PUT /identity/v3/projects/0eec3a73673e45dc881de586b9b0fbbb/users/d68e91e4259e449797fb83de548aec1e/roles/d14c3070c9184d76a7b23df69bd3db07 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:03:21.472624 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef0014b-71a5-4a34-ab63-6f70d41b4c47 None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:21.473193 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef0014b-71a5-4a34-ab63-6f70d41b4c47 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:21.473193 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef0014b-71a5-4a34-ab63-6f70d41b4c47 None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:21.474529 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 646/1274] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 01:03:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 01:03:21.481563 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56cf5b2-b11d-4d7b-9ede-7a1f7446aa6f None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:21.482135 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56cf5b2-b11d-4d7b-9ede-7a1f7446aa6f None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:21.482254 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56cf5b2-b11d-4d7b-9ede-7a1f7446aa6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:21.501822 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-e56cf5b2-b11d-4d7b-9ede-7a1f7446aa6f None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:03:21.503334 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-e56cf5b2-b11d-4d7b-9ede-7a1f7446aa6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:03:21.594053 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 629/1275] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 01:03:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 01:03:21.877921 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef0014b-71a5-4a34-ab63-6f70d41b4c47 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:21.985393 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef0014b-71a5-4a34-ab63-6f70d41b4c47 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:22.005438 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:03:22.023705 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91660e15-8eb6-40ae-8ae9-39c45b5f4af4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:22.024395 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91660e15-8eb6-40ae-8ae9-39c45b5f4af4 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:22.024674 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91660e15-8eb6-40ae-8ae9-39c45b5f4af4 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:22.024940 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91660e15-8eb6-40ae-8ae9-39c45b5f4af4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:22.035946 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91660e15-8eb6-40ae-8ae9-39c45b5f4af4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 01:03:22.041323 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-91660e15-8eb6-40ae-8ae9-39c45b5f4af4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 01:03:22.041323 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:03:22.041323 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:03:22.041323 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:03:22.041323 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:03:22.041323 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:03:22.041323 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:03:22.041323 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:03:22.041323 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:03:22.041323 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:03:22.041323 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:03:22.041323 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:03:22.041323 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 01:03:22.041323 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 01:03:22.041323 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 01:03:22.041323 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 01:03:22.043070 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 01:03:22.043070 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 01:03:22.043070 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 01:03:22.043070 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 01:03:22.043070 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:03:22.043070 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:03:22.043070 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:03:22.043070 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:03:22.043070 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:03:22.043070 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:03:22.043070 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:03:22.043070 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Aug 30 01:03:22.043070 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:03:22.043070 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:03:22.043070 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:03:22.043070 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:03:22.044763 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:03:22.044763 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:03:22.044763 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:03:22.044763 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:03:22.044763 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 01:03:22.044763 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 01:03:22.044763 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 01:03:22.044763 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 01:03:22.044763 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 01:03:22.044763 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 01:03:22.044763 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 01:03:22.044763 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Aug 30 01:03:22.044763 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 647/1276] 10.222.0.79 () {56 vars in 1096 bytes} [Tue Aug 30 01:03:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:03:22.050237 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56cf5b2-b11d-4d7b-9ede-7a1f7446aa6f None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:22.140380 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:03:22.161223 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56cf5b2-b11d-4d7b-9ede-7a1f7446aa6f None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:22.198825 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85ba0e1-052b-475c-a219-4d36c76fd275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:22.199474 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85ba0e1-052b-475c-a219-4d36c76fd275 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:22.199752 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85ba0e1-052b-475c-a219-4d36c76fd275 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:22.200018 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85ba0e1-052b-475c-a219-4d36c76fd275 None admin] PATH_INFO: `/v3/roles` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:22.200688 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85ba0e1-052b-475c-a219-4d36c76fd275 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:03:22.200984 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85ba0e1-052b-475c-a219-4d36c76fd275 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:22.202341 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85ba0e1-052b-475c-a219-4d36c76fd275 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:22.212420 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 630/1277] 10.222.0.79 () {56 vars in 1099 bytes} [Tue Aug 30 01:03:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:03:22.218301 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91660e15-8eb6-40ae-8ae9-39c45b5f4af4 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:22.324630 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91660e15-8eb6-40ae-8ae9-39c45b5f4af4 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:22.362035 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf9c3e0-e61b-4851-962f-8f4dfd9ff6e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:22.362669 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf9c3e0-e61b-4851-962f-8f4dfd9ff6e3 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:22.362942 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf9c3e0-e61b-4851-962f-8f4dfd9ff6e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:22.363234 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf9c3e0-e61b-4851-962f-8f4dfd9ff6e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:22.374158 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf9c3e0-e61b-4851-962f-8f4dfd9ff6e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:22.375643 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf9c3e0-e61b-4851-962f-8f4dfd9ff6e3 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:22.390828 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-cbf9c3e0-e61b-4851-962f-8f4dfd9ff6e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:03:22.390828 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:03:22.390828 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:03:22.390828 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:03:22.390828 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:03:22.390828 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:03:22.390828 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:03:22.390828 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:03:22.390828 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:03:22.390828 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:03:22.390828 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:03:22.390828 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:03:22.390828 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 01:03:22.390828 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 01:03:22.390828 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 01:03:22.390828 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 01:03:22.392724 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:03:22.392724 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:03:22.392724 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:03:22.392724 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:03:22.392724 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:03:22.392724 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:03:22.392724 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:03:22.392724 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Aug 30 01:03:22.392724 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:03:22.392724 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:03:22.392724 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:03:22.392724 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:03:22.392724 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:03:22.392724 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:03:22.392724 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:03:22.392724 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:03:22.392724 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 01:03:22.394754 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 01:03:22.394754 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:03:22.394754 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Aug 30 01:03:22.394754 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 648/1278] 10.222.0.79 () {56 vars in 1108 bytes} [Tue Aug 30 01:03:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:03:22.400336 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85ba0e1-052b-475c-a219-4d36c76fd275 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:22.518628 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85ba0e1-052b-475c-a219-4d36c76fd275 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:22.556440 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cb4db2-81ce-4df9-94eb-13a2ffcb5c1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:22.557050 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cb4db2-81ce-4df9-94eb-13a2ffcb5c1c None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:22.557324 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cb4db2-81ce-4df9-94eb-13a2ffcb5c1c None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:22.557586 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cb4db2-81ce-4df9-94eb-13a2ffcb5c1c None admin] PATH_INFO: `/v3/domains` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:22.558224 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cb4db2-81ce-4df9-94eb-13a2ffcb5c1c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:03:22.558518 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cb4db2-81ce-4df9-94eb-13a2ffcb5c1c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:22.559984 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cb4db2-81ce-4df9-94eb-13a2ffcb5c1c None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:22.574026 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 631/1279] 10.222.0.79 () {56 vars in 1109 bytes} [Tue Aug 30 01:03:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:03:22.581015 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf9c3e0-e61b-4851-962f-8f4dfd9ff6e3 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:22.614004 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:03:22.692444 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf9c3e0-e61b-4851-962f-8f4dfd9ff6e3 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:22.730156 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d824b68f-4612-4ce3-9bc8-0cb474aa7ec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:22.730791 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d824b68f-4612-4ce3-9bc8-0cb474aa7ec7 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:22.731073 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d824b68f-4612-4ce3-9bc8-0cb474aa7ec7 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:22.731373 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d824b68f-4612-4ce3-9bc8-0cb474aa7ec7 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:22.740138 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d824b68f-4612-4ce3-9bc8-0cb474aa7ec7 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:22.741577 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d824b68f-4612-4ce3-9bc8-0cb474aa7ec7 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:22.753464 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-d824b68f-4612-4ce3-9bc8-0cb474aa7ec7 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 30 01:03:22.753464 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:03:22.753464 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:03:22.753464 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:03:22.753464 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:03:22.753464 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:03:22.753464 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:03:22.753464 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:03:22.753464 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:03:22.753464 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:03:22.753464 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:03:22.753464 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:03:22.753464 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 01:03:22.753464 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 01:03:22.753464 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 01:03:22.753464 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 01:03:22.754620 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:03:22.754620 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:03:22.754620 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 01:03:22.754620 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 01:03:22.754620 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 01:03:22.754620 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 01:03:22.754620 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:03:22.754620 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:03:22.754620 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:03:22.754620 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:03:22.754620 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:03:22.754620 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Aug 30 01:03:22.754620 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:03:22.754620 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:03:22.754620 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:03:22.754620 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:03:22.754620 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:03:22.754620 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:03:22.755608 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:03:22.755608 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:03:22.755608 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 01:03:22.755608 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 01:03:22.755608 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 01:03:22.755608 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 01:03:22.755608 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 01:03:22.755608 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 01:03:22.755608 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 30 01:03:22.755608 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Aug 30 01:03:22.755608 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 649/1280] 10.222.0.79 () {56 vars in 1108 bytes} [Tue Aug 30 01:03:22 2022] GET /identity/v3/users/placement => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:03:22.761176 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cb4db2-81ce-4df9-94eb-13a2ffcb5c1c None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:22.765115 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:03:22.871571 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cb4db2-81ce-4df9-94eb-13a2ffcb5c1c None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:22.909379 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0908de1-ab8a-492e-9abc-e2834698857f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:22.909992 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0908de1-ab8a-492e-9abc-e2834698857f None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:22.910270 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0908de1-ab8a-492e-9abc-e2834698857f None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:22.910541 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0908de1-ab8a-492e-9abc-e2834698857f None admin] PATH_INFO: `/v3/users` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:22.911307 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0908de1-ab8a-492e-9abc-e2834698857f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:03:22.911617 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0908de1-ab8a-492e-9abc-e2834698857f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:22.913056 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0908de1-ab8a-492e-9abc-e2834698857f None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:22.933348 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 632/1281] 10.222.0.79 () {56 vars in 1143 bytes} [Tue Aug 30 01:03:22 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:03:22.939888 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d824b68f-4612-4ce3-9bc8-0cb474aa7ec7 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:23.046839 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:03:23.058350 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d824b68f-4612-4ce3-9bc8-0cb474aa7ec7 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:23.096803 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc89e37-f8eb-4fb1-9fc2-3c776e511461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:23.097405 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc89e37-f8eb-4fb1-9fc2-3c776e511461 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:23.097675 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc89e37-f8eb-4fb1-9fc2-3c776e511461 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:23.097937 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc89e37-f8eb-4fb1-9fc2-3c776e511461 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:23.169583 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc89e37-f8eb-4fb1-9fc2-3c776e511461 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:23.171082 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc89e37-f8eb-4fb1-9fc2-3c776e511461 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:23.300344 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:03:23.319510 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 650/1282] 10.222.0.79 () {58 vars in 1282 bytes} [Tue Aug 30 01:03:22 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 01:03:23.325978 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0908de1-ab8a-492e-9abc-e2834698857f None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:23.404097 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:03:23.454509 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0908de1-ab8a-492e-9abc-e2834698857f None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:23.497711 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b093ef-7d2f-4ba6-ad48-8891ba2ef942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:23.498354 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b093ef-7d2f-4ba6-ad48-8891ba2ef942 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:23.498626 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b093ef-7d2f-4ba6-ad48-8891ba2ef942 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:23.498893 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b093ef-7d2f-4ba6-ad48-8891ba2ef942 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:23.511628 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b093ef-7d2f-4ba6-ad48-8891ba2ef942 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:23.513437 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b093ef-7d2f-4ba6-ad48-8891ba2ef942 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:23.531159 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application [None req-50b093ef-7d2f-4ba6-ad48-8891ba2ef942 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:03:23.531159 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:03:23.531159 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:03:23.531159 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:03:23.531159 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:03:23.531159 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:03:23.531159 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:03:23.531159 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:03:23.531159 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:03:23.531159 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:03:23.531159 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:03:23.531159 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:03:23.531159 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 01:03:23.531159 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 01:03:23.531159 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 01:03:23.531159 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 01:03:23.533144 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:03:23.533144 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:03:23.533144 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:03:23.533144 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:03:23.533144 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:03:23.533144 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:03:23.533144 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:03:23.533144 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application with Lock( Aug 30 01:03:23.533144 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:03:23.533144 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:03:23.533144 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:03:23.533144 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:03:23.533144 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:03:23.533144 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:03:23.533144 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:03:23.533144 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:03:23.533144 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 01:03:23.534325 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 01:03:23.534325 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:03:23.534325 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Aug 30 01:03:23.534325 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 633/1283] 10.222.0.79 () {56 vars in 1108 bytes} [Tue Aug 30 01:03:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:03:23.543263 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc89e37-f8eb-4fb1-9fc2-3c776e511461 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:23.694224 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc89e37-f8eb-4fb1-9fc2-3c776e511461 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:23.733385 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f127fdc6-27dc-4521-92f9-2ad19f843ad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:23.733991 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f127fdc6-27dc-4521-92f9-2ad19f843ad2 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:23.734269 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f127fdc6-27dc-4521-92f9-2ad19f843ad2 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:23.734537 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f127fdc6-27dc-4521-92f9-2ad19f843ad2 None admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:23.735216 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f127fdc6-27dc-4521-92f9-2ad19f843ad2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:03:23.735518 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f127fdc6-27dc-4521-92f9-2ad19f843ad2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:23.736893 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f127fdc6-27dc-4521-92f9-2ad19f843ad2 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:23.750277 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 651/1284] 10.222.0.79 () {56 vars in 1109 bytes} [Tue Aug 30 01:03:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:03:23.760199 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b093ef-7d2f-4ba6-ad48-8891ba2ef942 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:23.874590 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b093ef-7d2f-4ba6-ad48-8891ba2ef942 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:23.890174 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:03:23.912433 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2c3b87-61c8-4fce-8790-7791ee69596e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:23.913073 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2c3b87-61c8-4fce-8790-7791ee69596e None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:23.913351 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2c3b87-61c8-4fce-8790-7791ee69596e None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:23.913622 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2c3b87-61c8-4fce-8790-7791ee69596e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:23.921361 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2c3b87-61c8-4fce-8790-7791ee69596e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:23.922819 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2c3b87-61c8-4fce-8790-7791ee69596e None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:23.935958 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application [None req-ef2c3b87-61c8-4fce-8790-7791ee69596e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 01:03:23.935958 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:03:23.935958 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:03:23.935958 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:03:23.935958 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:03:23.935958 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:03:23.935958 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:03:23.935958 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:03:23.935958 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:03:23.935958 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:03:23.935958 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:03:23.935958 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:03:23.935958 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 01:03:23.935958 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 01:03:23.935958 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 01:03:23.942274 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 01:03:23.942274 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:03:23.942274 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:03:23.942274 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:03:23.942274 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:03:23.942274 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:03:23.942274 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:03:23.942274 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:03:23.942274 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application with Lock( Aug 30 01:03:23.942274 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:03:23.942274 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:03:23.942274 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:03:23.942274 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:03:23.942274 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:03:23.942274 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:03:23.942274 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:03:23.942274 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:03:23.944445 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 01:03:23.944445 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 01:03:23.944445 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 01:03:23.944445 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 01:03:23.944445 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 01:03:23.944445 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 01:03:23.944445 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 01:03:23.944445 dv-cinder-819667-6-smb devstack@keystone.service[81998]: ERROR keystone.server.flask.application Aug 30 01:03:23.944445 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 634/1285] 10.222.0.79 () {56 vars in 1111 bytes} [Tue Aug 30 01:03:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 01:03:23.945470 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f127fdc6-27dc-4521-92f9-2ad19f843ad2 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:24.001486 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:03:24.061039 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f127fdc6-27dc-4521-92f9-2ad19f843ad2 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:24.096627 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176c2ffc-ead1-4b63-8a00-8065200627cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:24.097235 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176c2ffc-ead1-4b63-8a00-8065200627cb None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:24.097506 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176c2ffc-ead1-4b63-8a00-8065200627cb None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:24.097772 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176c2ffc-ead1-4b63-8a00-8065200627cb None admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:24.098464 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176c2ffc-ead1-4b63-8a00-8065200627cb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:03:24.098761 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176c2ffc-ead1-4b63-8a00-8065200627cb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:24.100235 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176c2ffc-ead1-4b63-8a00-8065200627cb None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:24.114145 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 652/1286] 10.222.0.79 () {56 vars in 1148 bytes} [Tue Aug 30 01:03:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:03:24.124180 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2c3b87-61c8-4fce-8790-7791ee69596e None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:24.237061 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2c3b87-61c8-4fce-8790-7791ee69596e None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:24.275111 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b9fd7e-2ff0-475d-8e8d-8670bf17303c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:24.275753 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b9fd7e-2ff0-475d-8e8d-8670bf17303c None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:24.276028 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b9fd7e-2ff0-475d-8e8d-8670bf17303c None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:24.276293 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b9fd7e-2ff0-475d-8e8d-8670bf17303c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:24.277026 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b9fd7e-2ff0-475d-8e8d-8670bf17303c None admin] RBAC: Adding query filter params (role.id=d14c3070c9184d76a7b23df69bd3db07, scope.project.id=0eec3a73673e45dc881de586b9b0fbbb, user.id=d68e91e4259e449797fb83de548aec1e) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:03:24.277328 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b9fd7e-2ff0-475d-8e8d-8670bf17303c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:24.278762 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b9fd7e-2ff0-475d-8e8d-8670bf17303c None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:24.285422 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 635/1287] 10.222.0.79 () {56 vars in 1374 bytes} [Tue Aug 30 01:03:24 2022] GET /identity/v3/role_assignments?user.id=d68e91e4259e449797fb83de548aec1e&scope.project.id=0eec3a73673e45dc881de586b9b0fbbb&role.id=d14c3070c9184d76a7b23df69bd3db07 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:03:26.348346 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6a70a8-bb34-4d9b-9844-2c549fea9e67 None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:26.349197 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6a70a8-bb34-4d9b-9844-2c549fea9e67 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:26.349197 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6a70a8-bb34-4d9b-9844-2c549fea9e67 None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:26.350267 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 653/1288] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 01:03:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 01:03:26.357223 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fffd53-a618-4eea-8ad4-fbbcd2c1ae46 None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:26.357773 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fffd53-a618-4eea-8ad4-fbbcd2c1ae46 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:26.357773 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fffd53-a618-4eea-8ad4-fbbcd2c1ae46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:26.377104 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-09fffd53-a618-4eea-8ad4-fbbcd2c1ae46 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:03:26.378853 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-09fffd53-a618-4eea-8ad4-fbbcd2c1ae46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:03:26.418946 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:03:26.462378 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 636/1289] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 01:03:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 01:03:26.745434 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6a70a8-bb34-4d9b-9844-2c549fea9e67 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:26.853243 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6a70a8-bb34-4d9b-9844-2c549fea9e67 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:26.864880 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:03:26.889963 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201ebb4c-7411-4520-a10d-e0cf5cbae0e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:26.890587 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201ebb4c-7411-4520-a10d-e0cf5cbae0e7 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:26.890862 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201ebb4c-7411-4520-a10d-e0cf5cbae0e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:26.891159 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201ebb4c-7411-4520-a10d-e0cf5cbae0e7 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:26.891732 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201ebb4c-7411-4520-a10d-e0cf5cbae0e7 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:26.893083 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201ebb4c-7411-4520-a10d-e0cf5cbae0e7 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:26.902750 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-201ebb4c-7411-4520-a10d-e0cf5cbae0e7 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 30 01:03:26.902750 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:03:26.902750 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 01:03:26.902750 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 01:03:26.902750 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 01:03:26.902750 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 01:03:26.902750 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 01:03:26.902750 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 01:03:26.902750 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 30 01:03:26.902750 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Aug 30 01:03:26.902750 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 01:03:26.902750 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Aug 30 01:03:26.902750 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:03:26.902750 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:03:26.902750 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:03:26.902750 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:03:26.902750 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:03:26.904090 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:03:26.904090 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:03:26.904090 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:03:26.904090 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:03:26.904090 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:03:26.904090 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:03:26.904090 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 01:03:26.904090 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 01:03:26.904090 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 01:03:26.904090 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 01:03:26.904090 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:03:26.904090 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:03:26.904090 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:03:26.904090 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:03:26.904090 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:03:26.904090 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:03:26.905170 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:03:26.905170 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Aug 30 01:03:26.905170 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:03:26.905170 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:03:26.905170 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:03:26.905170 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:03:26.905170 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:03:26.905170 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:03:26.905170 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:03:26.905170 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:03:26.905170 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 01:03:26.905170 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 01:03:26.905170 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 30 01:03:26.905170 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Aug 30 01:03:26.905170 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 654/1290] 10.222.0.79 () {56 vars in 1117 bytes} [Tue Aug 30 01:03:26 2022] GET /identity/v3/services/placement => generated 90 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:03:26.911433 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fffd53-a618-4eea-8ad4-fbbcd2c1ae46 None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:27.023969 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fffd53-a618-4eea-8ad4-fbbcd2c1ae46 None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:27.061465 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd27ae60-639e-416c-a432-bf197b35ae96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:27.062099 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd27ae60-639e-416c-a432-bf197b35ae96 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:27.062373 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd27ae60-639e-416c-a432-bf197b35ae96 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:27.062639 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd27ae60-639e-416c-a432-bf197b35ae96 None admin] PATH_INFO: `/v3/services` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:27.063303 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd27ae60-639e-416c-a432-bf197b35ae96 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:03:27.063597 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd27ae60-639e-416c-a432-bf197b35ae96 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:27.064961 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd27ae60-639e-416c-a432-bf197b35ae96 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:27.071242 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 637/1291] 10.222.0.79 () {56 vars in 1116 bytes} [Tue Aug 30 01:03:26 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:03:27.080597 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201ebb4c-7411-4520-a10d-e0cf5cbae0e7 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:27.188653 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201ebb4c-7411-4520-a10d-e0cf5cbae0e7 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:27.224949 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f52d6ff-b070-4fa6-a4c6-3ba1c95f88ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:27.225562 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f52d6ff-b070-4fa6-a4c6-3ba1c95f88ef None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:27.225838 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f52d6ff-b070-4fa6-a4c6-3ba1c95f88ef None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:27.226231 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f52d6ff-b070-4fa6-a4c6-3ba1c95f88ef None admin] PATH_INFO: `/v3/services` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:27.226868 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f52d6ff-b070-4fa6-a4c6-3ba1c95f88ef None admin] RBAC: Adding query filter params (type=placement) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:03:27.227194 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f52d6ff-b070-4fa6-a4c6-3ba1c95f88ef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:27.228571 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f52d6ff-b070-4fa6-a4c6-3ba1c95f88ef None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:27.233861 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 655/1292] 10.222.0.79 () {56 vars in 1116 bytes} [Tue Aug 30 01:03:27 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:03:29.230170 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac0b2b4-6ceb-47cb-a4f3-92d7177bfaeb None None] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:29.230744 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac0b2b4-6ceb-47cb-a4f3-92d7177bfaeb None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:29.230913 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac0b2b4-6ceb-47cb-a4f3-92d7177bfaeb None None] PATH_INFO: `/` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:29.232853 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 638/1293] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 01:03:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:03:29.240030 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f4bf24-411d-4971-af8b-6f8bfaf99235 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:29.240514 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f4bf24-411d-4971-af8b-6f8bfaf99235 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:29.240825 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f4bf24-411d-4971-af8b-6f8bfaf99235 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:29.260111 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-23f4bf24-411d-4971-af8b-6f8bfaf99235 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:03:29.261340 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-23f4bf24-411d-4971-af8b-6f8bfaf99235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:03:29.296065 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:03:29.342898 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 656/1294] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 01:03:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 01:03:29.624189 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac0b2b4-6ceb-47cb-a4f3-92d7177bfaeb None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:29.661785 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:03:29.741990 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac0b2b4-6ceb-47cb-a4f3-92d7177bfaeb None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:29.778500 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b8aa41-6b93-4017-9e90-6754f0ca0be8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:29.779167 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b8aa41-6b93-4017-9e90-6754f0ca0be8 None admin] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:29.779442 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b8aa41-6b93-4017-9e90-6754f0ca0be8 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:29.779708 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b8aa41-6b93-4017-9e90-6754f0ca0be8 None admin] PATH_INFO: `/v3/services` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:29.780359 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b8aa41-6b93-4017-9e90-6754f0ca0be8 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:29.781712 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b8aa41-6b93-4017-9e90-6754f0ca0be8 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:29.797852 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 639/1295] 10.222.0.79 () {60 vars in 1141 bytes} [Tue Aug 30 01:03:29 2022] POST /identity/v3/services => generated 246 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:03:31.925523 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8156e44e-9f20-4862-aa3f-5081a97d03d4 None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:31.926187 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8156e44e-9f20-4862-aa3f-5081a97d03d4 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:31.926187 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8156e44e-9f20-4862-aa3f-5081a97d03d4 None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:31.927891 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 657/1296] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 01:03:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:03:31.934668 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b3abc8-d3dc-44f5-9070-4d2a7b0812d6 None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:31.935399 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b3abc8-d3dc-44f5-9070-4d2a7b0812d6 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:31.935639 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b3abc8-d3dc-44f5-9070-4d2a7b0812d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:31.966417 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-c0b3abc8-d3dc-44f5-9070-4d2a7b0812d6 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:03:31.968492 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-c0b3abc8-d3dc-44f5-9070-4d2a7b0812d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:03:32.079708 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 640/1297] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 01:03:31 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 01:03:32.603236 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8156e44e-9f20-4862-aa3f-5081a97d03d4 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:32.725174 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8156e44e-9f20-4862-aa3f-5081a97d03d4 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:32.764883 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbd27b8-37ef-4f50-8eda-a6d23fc9a05a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:32.765521 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbd27b8-37ef-4f50-8eda-a6d23fc9a05a None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:32.765807 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbd27b8-37ef-4f50-8eda-a6d23fc9a05a None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:32.766078 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbd27b8-37ef-4f50-8eda-a6d23fc9a05a None admin] PATH_INFO: `/v3/services/placement` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:32.766667 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbd27b8-37ef-4f50-8eda-a6d23fc9a05a None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:32.768059 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbd27b8-37ef-4f50-8eda-a6d23fc9a05a None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:32.777609 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-abbd27b8-37ef-4f50-8eda-a6d23fc9a05a None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 30 01:03:32.777609 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:03:32.777609 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 01:03:32.777609 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 01:03:32.777609 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 01:03:32.777609 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 01:03:32.777609 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 01:03:32.777609 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 01:03:32.777609 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 30 01:03:32.777609 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Aug 30 01:03:32.777609 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 01:03:32.777609 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Aug 30 01:03:32.777609 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:03:32.777609 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:03:32.777609 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:03:32.777609 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:03:32.777609 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:03:32.779699 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:03:32.779699 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:03:32.779699 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:03:32.779699 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:03:32.779699 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:03:32.779699 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:03:32.779699 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 01:03:32.779699 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 01:03:32.779699 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 01:03:32.779699 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 01:03:32.779699 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:03:32.779699 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:03:32.779699 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:03:32.779699 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:03:32.779699 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:03:32.779699 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:03:32.781654 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:03:32.781654 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Aug 30 01:03:32.781654 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:03:32.781654 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:03:32.781654 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:03:32.781654 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:03:32.781654 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:03:32.781654 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:03:32.781654 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:03:32.781654 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:03:32.781654 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 01:03:32.781654 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 01:03:32.781654 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 30 01:03:32.781654 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Aug 30 01:03:32.781654 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 658/1298] 10.222.0.79 () {56 vars in 1117 bytes} [Tue Aug 30 01:03:32 2022] GET /identity/v3/services/placement => generated 90 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:03:32.788308 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b3abc8-d3dc-44f5-9070-4d2a7b0812d6 None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:32.809079 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:03:32.953818 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b3abc8-d3dc-44f5-9070-4d2a7b0812d6 None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:33.014155 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9186cc68-d8d3-4519-8f6e-b116fb2f95a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:33.015219 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9186cc68-d8d3-4519-8f6e-b116fb2f95a6 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:33.015723 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9186cc68-d8d3-4519-8f6e-b116fb2f95a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:33.016223 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9186cc68-d8d3-4519-8f6e-b116fb2f95a6 None admin] PATH_INFO: `/v3/services` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:33.017405 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9186cc68-d8d3-4519-8f6e-b116fb2f95a6 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:03:33.017936 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9186cc68-d8d3-4519-8f6e-b116fb2f95a6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:33.020506 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9186cc68-d8d3-4519-8f6e-b116fb2f95a6 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:33.030609 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 641/1299] 10.222.0.79 () {56 vars in 1116 bytes} [Tue Aug 30 01:03:32 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:03:33.036757 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbd27b8-37ef-4f50-8eda-a6d23fc9a05a None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:33.072995 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:03:33.152319 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbd27b8-37ef-4f50-8eda-a6d23fc9a05a None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:33.191958 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab68d45c-4a5e-4bc7-b6e2-d2b7329b1412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:33.192569 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab68d45c-4a5e-4bc7-b6e2-d2b7329b1412 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:33.192847 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab68d45c-4a5e-4bc7-b6e2-d2b7329b1412 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:33.193118 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab68d45c-4a5e-4bc7-b6e2-d2b7329b1412 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:33.194081 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab68d45c-4a5e-4bc7-b6e2-d2b7329b1412 None admin] RBAC: Adding query filter params (interface=public, service_id=1caa61a03dc944ff951698dbb171b2cb, region_id=RegionOne) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:03:33.194427 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab68d45c-4a5e-4bc7-b6e2-d2b7329b1412 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:33.196366 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab68d45c-4a5e-4bc7-b6e2-d2b7329b1412 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:33.202376 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 659/1300] 10.222.0.79 () {56 vars in 1251 bytes} [Tue Aug 30 01:03:33 2022] GET /identity/v3/endpoints?service_id=1caa61a03dc944ff951698dbb171b2cb&interface=public®ion_id=RegionOne => generated 194 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:03:33.208557 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9186cc68-d8d3-4519-8f6e-b116fb2f95a6 None admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:33.306580 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:03:33.329453 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9186cc68-d8d3-4519-8f6e-b116fb2f95a6 None admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:33.371383 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a401e036-5138-47a4-8183-409cce4bea9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:33.372047 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a401e036-5138-47a4-8183-409cce4bea9c None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:33.372359 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a401e036-5138-47a4-8183-409cce4bea9c None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:33.372667 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a401e036-5138-47a4-8183-409cce4bea9c None admin] PATH_INFO: `/v3/services` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:33.373313 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a401e036-5138-47a4-8183-409cce4bea9c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:33.374736 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a401e036-5138-47a4-8183-409cce4bea9c None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:33.383336 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 642/1301] 10.222.0.79 () {56 vars in 1087 bytes} [Tue Aug 30 01:03:33 2022] GET /identity/v3/services => generated 2191 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 01:03:35.409651 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2731634c-986a-47d6-9922-ea94176d1430 None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:35.410240 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2731634c-986a-47d6-9922-ea94176d1430 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:35.410240 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2731634c-986a-47d6-9922-ea94176d1430 None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:35.411669 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 660/1302] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 01:03:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:03:35.418053 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b810f36d-1b6e-4f83-bd5b-b85faea195e5 None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:35.418635 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b810f36d-1b6e-4f83-bd5b-b85faea195e5 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:35.418635 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b810f36d-1b6e-4f83-bd5b-b85faea195e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:35.438465 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-b810f36d-1b6e-4f83-bd5b-b85faea195e5 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:03:35.439748 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-b810f36d-1b6e-4f83-bd5b-b85faea195e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:03:35.510192 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 643/1303] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 01:03:35 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 01:03:35.777438 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2731634c-986a-47d6-9922-ea94176d1430 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:35.881863 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:03:35.889941 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2731634c-986a-47d6-9922-ea94176d1430 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:35.927003 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b4f26d-5bc7-460e-b57e-06f718f94442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:35.927669 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b4f26d-5bc7-460e-b57e-06f718f94442 None admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:35.927947 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b4f26d-5bc7-460e-b57e-06f718f94442 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:35.928216 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b4f26d-5bc7-460e-b57e-06f718f94442 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:35.928799 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b4f26d-5bc7-460e-b57e-06f718f94442 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:35.930535 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b4f26d-5bc7-460e-b57e-06f718f94442 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:35.939689 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application [None req-b7b4f26d-5bc7-460e-b57e-06f718f94442 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 30 01:03:35.939689 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:03:35.939689 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 01:03:35.939689 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 01:03:35.939689 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 01:03:35.939689 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 01:03:35.939689 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 01:03:35.939689 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 01:03:35.939689 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 30 01:03:35.939689 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Aug 30 01:03:35.939689 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 01:03:35.939689 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Aug 30 01:03:35.939689 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:03:35.939689 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:03:35.939689 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:03:35.939689 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:03:35.939689 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:03:35.941631 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:03:35.941631 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:03:35.941631 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:03:35.941631 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:03:35.941631 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:03:35.941631 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:03:35.941631 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 01:03:35.941631 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 01:03:35.941631 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 01:03:35.941631 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 01:03:35.941631 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:03:35.941631 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:03:35.941631 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:03:35.941631 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:03:35.941631 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:03:35.941631 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:03:35.943912 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:03:35.943912 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application with Lock( Aug 30 01:03:35.943912 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:03:35.943912 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:03:35.943912 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:03:35.943912 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:03:35.943912 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:03:35.943912 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:03:35.943912 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:03:35.943912 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:03:35.943912 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 01:03:35.943912 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 01:03:35.943912 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 30 01:03:35.943912 dv-cinder-819667-6-smb devstack@keystone.service[81999]: ERROR keystone.server.flask.application Aug 30 01:03:35.943912 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 661/1304] 10.222.0.79 () {56 vars in 1117 bytes} [Tue Aug 30 01:03:35 2022] GET /identity/v3/services/placement => generated 90 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:03:35.950329 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b810f36d-1b6e-4f83-bd5b-b85faea195e5 None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:36.032099 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:03:36.057724 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b810f36d-1b6e-4f83-bd5b-b85faea195e5 None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:36.094915 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9db45f-cce1-4729-a2a9-127cec790365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:36.095691 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9db45f-cce1-4729-a2a9-127cec790365 None admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:36.095972 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9db45f-cce1-4729-a2a9-127cec790365 None admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:36.096242 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9db45f-cce1-4729-a2a9-127cec790365 None admin] PATH_INFO: `/v3/services` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:36.096877 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9db45f-cce1-4729-a2a9-127cec790365 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:03:36.097177 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9db45f-cce1-4729-a2a9-127cec790365 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:36.098541 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9db45f-cce1-4729-a2a9-127cec790365 None admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:36.104949 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 644/1305] 10.222.0.79 () {56 vars in 1116 bytes} [Tue Aug 30 01:03:35 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:03:36.113691 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b4f26d-5bc7-460e-b57e-06f718f94442 None admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:36.220144 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b4f26d-5bc7-460e-b57e-06f718f94442 None admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:36.256321 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ebcc6e-73ce-45eb-b9c8-36820bcaeac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:36.256928 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ebcc6e-73ce-45eb-b9c8-36820bcaeac0 None admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:36.257206 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ebcc6e-73ce-45eb-b9c8-36820bcaeac0 None admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:36.257543 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ebcc6e-73ce-45eb-b9c8-36820bcaeac0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:36.258294 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ebcc6e-73ce-45eb-b9c8-36820bcaeac0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:36.259696 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ebcc6e-73ce-45eb-b9c8-36820bcaeac0 None admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:36.280774 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 662/1306] 10.222.0.79 () {60 vars in 1144 bytes} [Tue Aug 30 01:03:36 2022] POST /identity/v3/endpoints => generated 331 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:03:46.101908 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=30 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:03:46.275957 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:04:46.801600 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6f8a6c-65b1-41e0-9197-6bd1f441be15 None None] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:04:46.802422 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6f8a6c-65b1-41e0-9197-6bd1f441be15 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:04:46.802422 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6f8a6c-65b1-41e0-9197-6bd1f441be15 None None] PATH_INFO: `/` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:04:46.809485 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716de3c3-bfc6-4c6e-a8ea-0829f0b71e6c None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:04:46.810002 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716de3c3-bfc6-4c6e-a8ea-0829f0b71e6c None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:04:46.810086 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716de3c3-bfc6-4c6e-a8ea-0829f0b71e6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:04:46.814765 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 645/1307] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 01:04:46 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:04:46.902078 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-716de3c3-bfc6-4c6e-a8ea-0829f0b71e6c None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:04:46.903319 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-716de3c3-bfc6-4c6e-a8ea-0829f0b71e6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:04:47.022925 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 663/1308] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 01:04:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:04:47.325976 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecf943e-277c-40d3-9047-204dba7b6778 None None] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:04:47.326263 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecf943e-277c-40d3-9047-204dba7b6778 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:04:47.326532 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecf943e-277c-40d3-9047-204dba7b6778 None None] PATH_INFO: `/` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:04:47.328113 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 646/1309] 10.222.0.79 () {54 vars in 965 bytes} [Tue Aug 30 01:04:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:04:47.339662 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fe35c4-d0b8-4767-9fbf-1bbe7985378f None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:04:47.339967 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fe35c4-d0b8-4767-9fbf-1bbe7985378f None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:04:47.340200 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fe35c4-d0b8-4767-9fbf-1bbe7985378f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:04:47.454492 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-63fe35c4-d0b8-4767-9fbf-1bbe7985378f None None] MFA Rules not processed for user `16e6a0ca26fc4ef892c188ad89a1e132`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:04:47.455791 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-63fe35c4-d0b8-4767-9fbf-1bbe7985378f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:04:47.481414 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:04:47.554897 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 664/1310] 10.222.0.79 () {58 vars in 1062 bytes} [Tue Aug 30 01:04:47 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:04:47.563668 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecf943e-277c-40d3-9047-204dba7b6778 None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:04:47.565614 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-4ecf943e-277c-40d3-9047-204dba7b6778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:04:47.682791 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecf943e-277c-40d3-9047-204dba7b6778 None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:04:47.768223 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede2f4f3-97b8-42c8-ade0-7cd8bbc6c337 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16e6a0ca26fc4ef892c188ad89a1e132', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:04:47.769029 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede2f4f3-97b8-42c8-ade0-7cd8bbc6c337 service neutron] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:04:47.769410 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede2f4f3-97b8-42c8-ade0-7cd8bbc6c337 service neutron] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:04:47.769788 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede2f4f3-97b8-42c8-ade0-7cd8bbc6c337 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:04:47.772270 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-ede2f4f3-97b8-42c8-ade0-7cd8bbc6c337 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:04:47.833811 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:04:47.897794 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede2f4f3-97b8-42c8-ade0-7cd8bbc6c337 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:04:47.899451 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede2f4f3-97b8-42c8-ade0-7cd8bbc6c337 service neutron] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:04:47.922173 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 647/1311] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:04:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 01:04:50.236994 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7102507a-c913-42b4-bea6-6bdb55ecc86e None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:04:50.237507 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7102507a-c913-42b4-bea6-6bdb55ecc86e None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:04:50.237507 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7102507a-c913-42b4-bea6-6bdb55ecc86e None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:04:50.241848 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 665/1312] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 01:04:50 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:04:50.244510 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e784b8-0b70-4b98-91ac-5fd39b478ffd None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:04:50.245255 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e784b8-0b70-4b98-91ac-5fd39b478ffd None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:04:50.245680 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e784b8-0b70-4b98-91ac-5fd39b478ffd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:04:50.330233 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-c6e784b8-0b70-4b98-91ac-5fd39b478ffd None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:04:50.331502 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-c6e784b8-0b70-4b98-91ac-5fd39b478ffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:04:50.439036 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 648/1313] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 01:04:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:04:50.720737 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7102507a-c913-42b4-bea6-6bdb55ecc86e None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:04:50.722292 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-7102507a-c913-42b4-bea6-6bdb55ecc86e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:04:50.828711 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7102507a-c913-42b4-bea6-6bdb55ecc86e None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:04:50.901081 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:04:50.903768 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43417a91-225b-4e76-bd9b-1e4b48bdb1cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16e6a0ca26fc4ef892c188ad89a1e132', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:04:50.904559 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43417a91-225b-4e76-bd9b-1e4b48bdb1cb service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:04:50.904944 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43417a91-225b-4e76-bd9b-1e4b48bdb1cb service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:04:50.905410 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43417a91-225b-4e76-bd9b-1e4b48bdb1cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:04:50.907207 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-43417a91-225b-4e76-bd9b-1e4b48bdb1cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:04:51.018905 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43417a91-225b-4e76-bd9b-1e4b48bdb1cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:04:51.020950 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43417a91-225b-4e76-bd9b-1e4b48bdb1cb service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:04:51.039596 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 666/1314] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:04:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 01:04:53.357103 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e65192-7186-4827-9b45-178cbc03a730 None None] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:04:53.357654 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e65192-7186-4827-9b45-178cbc03a730 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:04:53.357654 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e65192-7186-4827-9b45-178cbc03a730 None None] PATH_INFO: `/` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:04:53.359039 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 649/1315] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 01:04:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:04:53.364142 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f65d8a-8b50-4080-8f08-ee6dac2ce4ca None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:04:53.364578 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f65d8a-8b50-4080-8f08-ee6dac2ce4ca None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:04:53.364768 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f65d8a-8b50-4080-8f08-ee6dac2ce4ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:04:53.432623 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-34f65d8a-8b50-4080-8f08-ee6dac2ce4ca None None] MFA Rules not processed for user `14554d790d74410f850ec973e736e600`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:04:53.433823 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-34f65d8a-8b50-4080-8f08-ee6dac2ce4ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:04:53.485400 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:04:53.530052 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 667/1316] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 01:04:53 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:04:53.812674 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e65192-7186-4827-9b45-178cbc03a730 None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:04:53.814219 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-43e65192-7186-4827-9b45-178cbc03a730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:04:53.824394 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:04:53.920367 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e65192-7186-4827-9b45-178cbc03a730 None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:04:53.993708 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9500f3d9-f7dd-4007-9b9a-ab02f15b5c87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16e6a0ca26fc4ef892c188ad89a1e132', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:04:53.994307 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9500f3d9-f7dd-4007-9b9a-ab02f15b5c87 service neutron] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:04:53.994584 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9500f3d9-f7dd-4007-9b9a-ab02f15b5c87 service neutron] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:04:53.994854 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9500f3d9-f7dd-4007-9b9a-ab02f15b5c87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:04:53.996478 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-9500f3d9-f7dd-4007-9b9a-ab02f15b5c87 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:04:54.059440 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:04:54.107184 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9500f3d9-f7dd-4007-9b9a-ab02f15b5c87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:04:54.108630 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9500f3d9-f7dd-4007-9b9a-ab02f15b5c87 service neutron] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:04:54.128885 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 650/1317] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:04:53 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:04:56.637330 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7086bc-923f-4afa-a89a-a0bfa30e90c4 None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:04:56.637846 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7086bc-923f-4afa-a89a-a0bfa30e90c4 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:04:56.637846 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7086bc-923f-4afa-a89a-a0bfa30e90c4 None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:04:56.639148 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 668/1318] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 01:04:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:04:56.644432 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476d9c65-9f9f-4f8c-a169-e0134fc0118f None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:04:56.644869 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476d9c65-9f9f-4f8c-a169-e0134fc0118f None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:04:56.644965 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476d9c65-9f9f-4f8c-a169-e0134fc0118f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:04:56.711251 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-476d9c65-9f9f-4f8c-a169-e0134fc0118f None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:04:56.712477 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-476d9c65-9f9f-4f8c-a169-e0134fc0118f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:04:56.809836 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 651/1319] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 01:04:56 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:04:57.115401 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ef80e5-bef6-4367-b0ef-9dfe68f8af5e None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:04:57.115679 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ef80e5-bef6-4367-b0ef-9dfe68f8af5e None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:04:57.115948 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ef80e5-bef6-4367-b0ef-9dfe68f8af5e None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:04:57.117314 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 669/1320] 10.222.0.79 () {54 vars in 965 bytes} [Tue Aug 30 01:04:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:04:57.123773 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f88449-285c-4abc-9190-d465fc215a1c None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:04:57.124054 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f88449-285c-4abc-9190-d465fc215a1c None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:04:57.124318 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f88449-285c-4abc-9190-d465fc215a1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:04:57.145646 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:04:57.199671 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-16f88449-285c-4abc-9190-d465fc215a1c None None] MFA Rules not processed for user `16e6a0ca26fc4ef892c188ad89a1e132`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:04:57.200863 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-16f88449-285c-4abc-9190-d465fc215a1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:04:57.277037 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 652/1321] 10.222.0.79 () {58 vars in 1062 bytes} [Tue Aug 30 01:04:57 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:04:57.286336 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ef80e5-bef6-4367-b0ef-9dfe68f8af5e None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:04:57.287877 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-d7ef80e5-bef6-4367-b0ef-9dfe68f8af5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:04:57.403171 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ef80e5-bef6-4367-b0ef-9dfe68f8af5e None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:04:57.477366 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afb8aa3-221d-47c7-b030-6a27aecbf5ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16e6a0ca26fc4ef892c188ad89a1e132', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:04:57.477965 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afb8aa3-221d-47c7-b030-6a27aecbf5ae service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:04:57.478242 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afb8aa3-221d-47c7-b030-6a27aecbf5ae service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:04:57.478512 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afb8aa3-221d-47c7-b030-6a27aecbf5ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:04:57.480134 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-6afb8aa3-221d-47c7-b030-6a27aecbf5ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:04:57.487582 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:04:57.594022 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afb8aa3-221d-47c7-b030-6a27aecbf5ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:04:57.595486 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afb8aa3-221d-47c7-b030-6a27aecbf5ae service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:04:57.616019 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 670/1322] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:04:57 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:05:00.731018 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65579949-93a6-40b8-b213-fe313623748e None None] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:05:00.731567 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65579949-93a6-40b8-b213-fe313623748e None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:05:00.731567 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65579949-93a6-40b8-b213-fe313623748e None None] PATH_INFO: `/` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:05:00.732952 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 653/1323] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 01:05:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:05:00.738889 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b3cf88-5416-44b6-baf1-f63db4b412dd None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:05:00.739463 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b3cf88-5416-44b6-baf1-f63db4b412dd None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:05:00.739680 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b3cf88-5416-44b6-baf1-f63db4b412dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:05:00.812609 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-29b3cf88-5416-44b6-baf1-f63db4b412dd None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:05:00.813958 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-29b3cf88-5416-44b6-baf1-f63db4b412dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:05:00.882074 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:05:00.925844 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 671/1324] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 01:05:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:05:01.228410 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65579949-93a6-40b8-b213-fe313623748e None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:05:01.229957 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-65579949-93a6-40b8-b213-fe313623748e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:05:01.334917 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65579949-93a6-40b8-b213-fe313623748e None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:05:01.346950 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:05:01.409397 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31769234-4add-4854-8cf7-c156bf03cb28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16e6a0ca26fc4ef892c188ad89a1e132', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:05:01.409888 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31769234-4add-4854-8cf7-c156bf03cb28 service neutron] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:05:01.410160 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31769234-4add-4854-8cf7-c156bf03cb28 service neutron] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:05:01.410425 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31769234-4add-4854-8cf7-c156bf03cb28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:05:01.412969 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-31769234-4add-4854-8cf7-c156bf03cb28 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:05:01.532743 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31769234-4add-4854-8cf7-c156bf03cb28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:05:01.534311 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31769234-4add-4854-8cf7-c156bf03cb28 service neutron] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:05:01.554792 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 654/1325] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:05:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:05:03.616167 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebacaa99-14e4-44f6-a543-8010eb8be2a7 None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:05:03.616707 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebacaa99-14e4-44f6-a543-8010eb8be2a7 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:05:03.616707 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebacaa99-14e4-44f6-a543-8010eb8be2a7 None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:05:03.617965 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 672/1326] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 01:05:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:05:03.623355 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dfdb5f-2656-485e-982f-0417e144d494 None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:05:03.623799 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dfdb5f-2656-485e-982f-0417e144d494 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:05:03.623923 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dfdb5f-2656-485e-982f-0417e144d494 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:05:03.674294 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:05:03.695985 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-b6dfdb5f-2656-485e-982f-0417e144d494 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:05:03.697202 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-b6dfdb5f-2656-485e-982f-0417e144d494 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:05:03.802677 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 655/1327] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 01:05:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:05:04.098552 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebacaa99-14e4-44f6-a543-8010eb8be2a7 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:05:04.100828 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-ebacaa99-14e4-44f6-a543-8010eb8be2a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:05:04.212816 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebacaa99-14e4-44f6-a543-8010eb8be2a7 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:05:04.289772 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045cdffc-0b82-41a0-ba1f-a62debf22290 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16e6a0ca26fc4ef892c188ad89a1e132', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:05:04.290376 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045cdffc-0b82-41a0-ba1f-a62debf22290 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:05:04.290654 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045cdffc-0b82-41a0-ba1f-a62debf22290 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:05:04.290950 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045cdffc-0b82-41a0-ba1f-a62debf22290 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:05:04.292636 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-045cdffc-0b82-41a0-ba1f-a62debf22290 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:05:04.310111 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:05:04.404526 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045cdffc-0b82-41a0-ba1f-a62debf22290 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:05:04.405948 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045cdffc-0b82-41a0-ba1f-a62debf22290 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:05:04.425693 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 673/1328] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:05:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:05:06.448057 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e972ad-5613-412f-a03d-7eac3c2b644a None None] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:05:06.448647 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e972ad-5613-412f-a03d-7eac3c2b644a None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:05:06.448647 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e972ad-5613-412f-a03d-7eac3c2b644a None None] PATH_INFO: `/` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:05:06.449964 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 656/1329] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 01:05:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:05:06.455838 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f48723b-84ea-423e-a76c-79aea7694565 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:05:06.456433 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f48723b-84ea-423e-a76c-79aea7694565 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:05:06.456433 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f48723b-84ea-423e-a76c-79aea7694565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:05:06.526086 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-8f48723b-84ea-423e-a76c-79aea7694565 None None] MFA Rules not processed for user `14554d790d74410f850ec973e736e600`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:05:06.527340 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-8f48723b-84ea-423e-a76c-79aea7694565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:05:06.594821 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:05:06.645546 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 674/1330] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 01:05:06 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:05:06.935224 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e972ad-5613-412f-a03d-7eac3c2b644a None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:05:06.936852 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-b0e972ad-5613-412f-a03d-7eac3c2b644a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:05:07.048196 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e972ad-5613-412f-a03d-7eac3c2b644a None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:05:07.070086 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:05:07.126251 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50359d7-caf6-4259-881a-2df49917044d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16e6a0ca26fc4ef892c188ad89a1e132', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:05:07.126779 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50359d7-caf6-4259-881a-2df49917044d service neutron] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:05:07.127155 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50359d7-caf6-4259-881a-2df49917044d service neutron] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:05:07.127454 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50359d7-caf6-4259-881a-2df49917044d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:05:07.129181 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-f50359d7-caf6-4259-881a-2df49917044d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:05:07.252252 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50359d7-caf6-4259-881a-2df49917044d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:05:07.253678 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50359d7-caf6-4259-881a-2df49917044d service neutron] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:05:07.273813 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 657/1331] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:05:06 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:05:09.492584 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240b30e3-affa-4166-8e8d-3db2827a53ec None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:05:09.493153 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240b30e3-affa-4166-8e8d-3db2827a53ec None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:05:09.493153 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240b30e3-affa-4166-8e8d-3db2827a53ec None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:05:09.494391 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 675/1332] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 01:05:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:05:09.499548 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd666349-8d44-47bf-8e76-be4e82fee832 None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:05:09.500003 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd666349-8d44-47bf-8e76-be4e82fee832 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:05:09.500193 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd666349-8d44-47bf-8e76-be4e82fee832 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:05:09.564577 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:05:09.568599 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-dd666349-8d44-47bf-8e76-be4e82fee832 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:05:09.570258 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-dd666349-8d44-47bf-8e76-be4e82fee832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:05:09.664751 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 658/1333] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 01:05:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:05:09.952959 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240b30e3-affa-4166-8e8d-3db2827a53ec None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:05:09.954494 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-240b30e3-affa-4166-8e8d-3db2827a53ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:05:10.064458 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240b30e3-affa-4166-8e8d-3db2827a53ec None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:05:10.147470 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56b10a7-c8da-48a9-a035-de5215412401 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16e6a0ca26fc4ef892c188ad89a1e132', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:05:10.148081 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56b10a7-c8da-48a9-a035-de5215412401 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:05:10.148357 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56b10a7-c8da-48a9-a035-de5215412401 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:05:10.148628 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56b10a7-c8da-48a9-a035-de5215412401 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:05:10.150255 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-b56b10a7-c8da-48a9-a035-de5215412401 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:05:10.180154 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:05:10.277381 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56b10a7-c8da-48a9-a035-de5215412401 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:05:10.278804 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56b10a7-c8da-48a9-a035-de5215412401 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:05:10.296781 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 676/1334] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:05:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:05:12.264374 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbbd903-88a9-41f2-8a6b-9ed2e5e6c62c None None] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:05:12.264881 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbbd903-88a9-41f2-8a6b-9ed2e5e6c62c None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:05:12.264988 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbbd903-88a9-41f2-8a6b-9ed2e5e6c62c None None] PATH_INFO: `/` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:05:12.266246 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 659/1335] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 01:05:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:05:12.271658 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87ca4b0-971e-4310-ac29-64d607589dcf None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:05:12.272116 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87ca4b0-971e-4310-ac29-64d607589dcf None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:05:12.272222 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87ca4b0-971e-4310-ac29-64d607589dcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:05:12.340138 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-f87ca4b0-971e-4310-ac29-64d607589dcf None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:05:12.341374 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-f87ca4b0-971e-4310-ac29-64d607589dcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:05:12.420275 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:05:12.446260 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 677/1336] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 01:05:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:05:12.792358 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbbd903-88a9-41f2-8a6b-9ed2e5e6c62c None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:05:12.793941 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-2dbbd903-88a9-41f2-8a6b-9ed2e5e6c62c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:05:12.924134 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbbd903-88a9-41f2-8a6b-9ed2e5e6c62c None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:05:12.954620 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:05:13.002851 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc44993-76ba-4a3d-af4f-aac6957e3e1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16e6a0ca26fc4ef892c188ad89a1e132', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:05:13.003481 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc44993-76ba-4a3d-af4f-aac6957e3e1d service neutron] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:05:13.003753 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc44993-76ba-4a3d-af4f-aac6957e3e1d service neutron] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:05:13.004059 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc44993-76ba-4a3d-af4f-aac6957e3e1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:05:13.005647 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-4fc44993-76ba-4a3d-af4f-aac6957e3e1d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:05:13.115752 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc44993-76ba-4a3d-af4f-aac6957e3e1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:05:13.117079 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc44993-76ba-4a3d-af4f-aac6957e3e1d service neutron] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:05:13.135264 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 660/1337] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:05:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:05:15.544647 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1386dd73-e7e9-4cf2-a555-ba64bf691fad None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:05:15.545202 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1386dd73-e7e9-4cf2-a555-ba64bf691fad None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:05:15.545202 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1386dd73-e7e9-4cf2-a555-ba64bf691fad None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:05:15.546458 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 678/1338] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 01:05:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:05:15.553080 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaa3b3a-efc8-4cbb-8e37-d4bba9854571 None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:05:15.553604 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaa3b3a-efc8-4cbb-8e37-d4bba9854571 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:05:15.553718 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaa3b3a-efc8-4cbb-8e37-d4bba9854571 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:05:15.621715 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-fcaa3b3a-efc8-4cbb-8e37-d4bba9854571 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:05:15.622960 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-fcaa3b3a-efc8-4cbb-8e37-d4bba9854571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:05:15.632671 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:05:15.720805 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 661/1339] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 01:05:15 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:05:16.001854 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1386dd73-e7e9-4cf2-a555-ba64bf691fad None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:05:16.003430 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-1386dd73-e7e9-4cf2-a555-ba64bf691fad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:05:16.113305 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1386dd73-e7e9-4cf2-a555-ba64bf691fad None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:05:16.187241 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb9a68b-bdc8-4287-88c5-bca40cf08a6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16e6a0ca26fc4ef892c188ad89a1e132', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:05:16.187854 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb9a68b-bdc8-4287-88c5-bca40cf08a6a service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:05:16.188123 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb9a68b-bdc8-4287-88c5-bca40cf08a6a service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:05:16.188395 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb9a68b-bdc8-4287-88c5-bca40cf08a6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:05:16.189957 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-0fb9a68b-bdc8-4287-88c5-bca40cf08a6a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:05:16.231335 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:05:16.311017 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb9a68b-bdc8-4287-88c5-bca40cf08a6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:05:16.312378 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb9a68b-bdc8-4287-88c5-bca40cf08a6a service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:05:16.331385 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 679/1340] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:05:16 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:05:20.331147 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7377d55-c738-4b7f-945c-15fa870dbb94 None None] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:05:20.331735 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7377d55-c738-4b7f-945c-15fa870dbb94 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:05:20.331735 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7377d55-c738-4b7f-945c-15fa870dbb94 None None] PATH_INFO: `/` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:05:20.333778 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 662/1341] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 01:05:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:05:20.339798 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdece03-d839-4949-a64c-d0bf3df3da52 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:05:20.340290 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdece03-d839-4949-a64c-d0bf3df3da52 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:05:20.340290 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdece03-d839-4949-a64c-d0bf3df3da52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:05:20.417384 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-9bdece03-d839-4949-a64c-d0bf3df3da52 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:05:20.418609 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-9bdece03-d839-4949-a64c-d0bf3df3da52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:05:20.521436 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:05:20.534612 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 680/1342] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 01:05:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:05:20.831572 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7377d55-c738-4b7f-945c-15fa870dbb94 None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:05:20.833632 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-e7377d55-c738-4b7f-945c-15fa870dbb94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:05:20.952233 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7377d55-c738-4b7f-945c-15fa870dbb94 None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:05:20.994947 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:05:21.035629 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327d8a5a-c52d-410f-b954-a8c4724cadb4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16e6a0ca26fc4ef892c188ad89a1e132', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:05:21.036253 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327d8a5a-c52d-410f-b954-a8c4724cadb4 service neutron] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:05:21.036536 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327d8a5a-c52d-410f-b954-a8c4724cadb4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:05:21.036806 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327d8a5a-c52d-410f-b954-a8c4724cadb4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:05:21.038483 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-327d8a5a-c52d-410f-b954-a8c4724cadb4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:05:21.156461 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327d8a5a-c52d-410f-b954-a8c4724cadb4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:05:21.157819 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327d8a5a-c52d-410f-b954-a8c4724cadb4 service neutron] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:05:21.178218 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 663/1343] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:05:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:05:23.830839 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0091ec1b-1d96-453c-89ba-d93da4829850 None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:05:23.831997 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0091ec1b-1d96-453c-89ba-d93da4829850 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:05:23.832130 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0091ec1b-1d96-453c-89ba-d93da4829850 None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:05:23.833901 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 681/1344] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 01:05:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:05:23.840443 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0d7f27-fa27-49b0-9154-9049fecba863 None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:05:23.841163 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0d7f27-fa27-49b0-9154-9049fecba863 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:05:23.841163 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0d7f27-fa27-49b0-9154-9049fecba863 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:05:23.927978 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-5b0d7f27-fa27-49b0-9154-9049fecba863 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:05:23.929201 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-5b0d7f27-fa27-49b0-9154-9049fecba863 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:05:23.954942 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:05:24.065435 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 664/1345] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 01:05:23 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:05:24.366882 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0091ec1b-1d96-453c-89ba-d93da4829850 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:05:24.368485 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-0091ec1b-1d96-453c-89ba-d93da4829850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:05:24.512708 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0091ec1b-1d96-453c-89ba-d93da4829850 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:05:24.615202 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92327774-3112-4921-9ecf-e5426abec3a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16e6a0ca26fc4ef892c188ad89a1e132', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:05:24.615938 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92327774-3112-4921-9ecf-e5426abec3a2 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:05:24.616311 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92327774-3112-4921-9ecf-e5426abec3a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:05:24.616590 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92327774-3112-4921-9ecf-e5426abec3a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:05:24.618690 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-92327774-3112-4921-9ecf-e5426abec3a2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:05:24.678450 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:05:24.753229 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92327774-3112-4921-9ecf-e5426abec3a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:05:24.755528 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92327774-3112-4921-9ecf-e5426abec3a2 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:05:24.776782 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 682/1346] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:05:24 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:05:29.022807 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad661be-8a7c-45a6-8c6f-aa9ae658f0c1 None None] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:05:29.025805 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad661be-8a7c-45a6-8c6f-aa9ae658f0c1 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:05:29.025805 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad661be-8a7c-45a6-8c6f-aa9ae658f0c1 None None] PATH_INFO: `/` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:05:29.026832 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 665/1347] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 01:05:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:05:29.034568 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49738649-cba8-4dc4-b9cd-c8eddc8daf85 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:05:29.035800 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49738649-cba8-4dc4-b9cd-c8eddc8daf85 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:05:29.035940 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49738649-cba8-4dc4-b9cd-c8eddc8daf85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:05:29.127829 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-49738649-cba8-4dc4-b9cd-c8eddc8daf85 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:05:29.130345 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-49738649-cba8-4dc4-b9cd-c8eddc8daf85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:05:29.281825 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:05:29.287363 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 683/1348] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 01:05:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:05:29.586845 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad661be-8a7c-45a6-8c6f-aa9ae658f0c1 None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:05:29.588501 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-3ad661be-8a7c-45a6-8c6f-aa9ae658f0c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:05:29.717785 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad661be-8a7c-45a6-8c6f-aa9ae658f0c1 None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:05:29.771367 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:05:29.815121 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55ea5e4-ad3b-402d-a450-950964b27b1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16e6a0ca26fc4ef892c188ad89a1e132', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:05:29.815820 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55ea5e4-ad3b-402d-a450-950964b27b1a service neutron] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:05:29.816104 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55ea5e4-ad3b-402d-a450-950964b27b1a service neutron] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:05:29.816374 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55ea5e4-ad3b-402d-a450-950964b27b1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:05:29.818439 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-e55ea5e4-ad3b-402d-a450-950964b27b1a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:05:29.957276 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55ea5e4-ad3b-402d-a450-950964b27b1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:05:29.958827 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55ea5e4-ad3b-402d-a450-950964b27b1a service neutron] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:05:29.978727 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 666/1349] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:05:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:05:35.269890 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0004297e-979e-411b-960f-bd45170dc9a6 None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:05:35.270924 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0004297e-979e-411b-960f-bd45170dc9a6 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:05:35.271483 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0004297e-979e-411b-960f-bd45170dc9a6 None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:05:35.278912 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 684/1350] 10.222.0.79 () {54 vars in 921 bytes} [Tue Aug 30 01:05:35 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:05:35.280733 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d229f1-50cd-447b-8826-2bccb27310bf None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:05:35.281124 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d229f1-50cd-447b-8826-2bccb27310bf None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:05:35.281124 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d229f1-50cd-447b-8826-2bccb27310bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:05:35.385076 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-b0d229f1-50cd-447b-8826-2bccb27310bf None None] MFA Rules not processed for user `d68e91e4259e449797fb83de548aec1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:05:35.386757 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-b0d229f1-50cd-447b-8826-2bccb27310bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:05:35.419420 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:05:35.576316 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 667/1351] 10.222.0.79 () {58 vars in 1018 bytes} [Tue Aug 30 01:05:35 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:05:39.883061 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55baea48-e028-4a04-b365-62f03f6e81ea None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:05:39.883894 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55baea48-e028-4a04-b365-62f03f6e81ea None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:05:39.884231 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55baea48-e028-4a04-b365-62f03f6e81ea None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:05:39.885961 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 685/1352] 10.222.0.79 () {54 vars in 921 bytes} [Tue Aug 30 01:05:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:05:39.890861 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be08d34-53b4-4b56-9283-ec1d36e0ed42 None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:05:39.891739 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be08d34-53b4-4b56-9283-ec1d36e0ed42 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:05:39.892076 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be08d34-53b4-4b56-9283-ec1d36e0ed42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:05:39.977478 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-4be08d34-53b4-4b56-9283-ec1d36e0ed42 None None] MFA Rules not processed for user `d68e91e4259e449797fb83de548aec1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:05:39.978708 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-4be08d34-53b4-4b56-9283-ec1d36e0ed42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:05:40.061248 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:05:40.100862 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 668/1353] 10.222.0.79 () {58 vars in 1018 bytes} [Tue Aug 30 01:05:39 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:05:41.581344 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88058d1-d903-427d-aa2f-4cefca5fe807 None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:05:41.581883 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88058d1-d903-427d-aa2f-4cefca5fe807 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:05:41.581883 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88058d1-d903-427d-aa2f-4cefca5fe807 None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:05:41.583120 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 686/1354] 10.222.0.79 () {54 vars in 921 bytes} [Tue Aug 30 01:05:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:05:41.588457 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549161c5-a113-4b83-a620-34a6fe15b6b0 None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:05:41.588901 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549161c5-a113-4b83-a620-34a6fe15b6b0 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:05:41.588994 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549161c5-a113-4b83-a620-34a6fe15b6b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:05:41.670129 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-549161c5-a113-4b83-a620-34a6fe15b6b0 None None] MFA Rules not processed for user `d68e91e4259e449797fb83de548aec1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:05:41.671362 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-549161c5-a113-4b83-a620-34a6fe15b6b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:05:41.783050 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 669/1355] 10.222.0.79 () {58 vars in 1018 bytes} [Tue Aug 30 01:05:41 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:05:45.106149 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea513781-ae23-42ed-8b0a-f1bb88bc7c50 None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:05:45.106699 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea513781-ae23-42ed-8b0a-f1bb88bc7c50 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:05:45.106699 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea513781-ae23-42ed-8b0a-f1bb88bc7c50 None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:05:45.108067 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 687/1356] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 01:05:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:05:45.113763 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ba9053-93e5-4277-a85c-a959248d01e8 None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:05:45.114196 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ba9053-93e5-4277-a85c-a959248d01e8 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:05:45.114306 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ba9053-93e5-4277-a85c-a959248d01e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:05:45.150490 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:05:45.191549 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-99ba9053-93e5-4277-a85c-a959248d01e8 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:05:45.192776 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-99ba9053-93e5-4277-a85c-a959248d01e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:05:45.325019 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 670/1357] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 01:05:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:05:45.658075 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a28463-96af-49ae-a39b-2bdb9d8d98ab None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:05:45.660128 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a28463-96af-49ae-a39b-2bdb9d8d98ab None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:05:45.660709 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a28463-96af-49ae-a39b-2bdb9d8d98ab None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:05:45.662264 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 688/1358] 10.222.0.79 () {54 vars in 962 bytes} [Tue Aug 30 01:05:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:05:45.670499 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d90dc2-001e-4cba-8ca9-00185cf811e4 None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:05:45.670715 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d90dc2-001e-4cba-8ca9-00185cf811e4 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:05:45.671038 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d90dc2-001e-4cba-8ca9-00185cf811e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:05:45.765246 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-e3d90dc2-001e-4cba-8ca9-00185cf811e4 None None] MFA Rules not processed for user `6480b2f14c37474c89df9fba48f7cd91`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:05:45.766503 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-e3d90dc2-001e-4cba-8ca9-00185cf811e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:05:45.824034 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:05:45.900323 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 671/1359] 10.222.0.79 () {58 vars in 1059 bytes} [Tue Aug 30 01:05:45 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:05:45.908318 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a28463-96af-49ae-a39b-2bdb9d8d98ab None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:05:45.910457 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-c3a28463-96af-49ae-a39b-2bdb9d8d98ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:05:46.066702 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a28463-96af-49ae-a39b-2bdb9d8d98ab None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:05:46.147696 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:05:46.192074 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3835a4d-3485-4361-80aa-96af419cdf0d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6480b2f14c37474c89df9fba48f7cd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:05:46.192832 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3835a4d-3485-4361-80aa-96af419cdf0d service nova] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:05:46.193483 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3835a4d-3485-4361-80aa-96af419cdf0d service nova] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:05:46.193828 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3835a4d-3485-4361-80aa-96af419cdf0d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:05:46.195537 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-f3835a4d-3485-4361-80aa-96af419cdf0d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:05:46.297660 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3835a4d-3485-4361-80aa-96af419cdf0d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:05:46.299289 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3835a4d-3485-4361-80aa-96af419cdf0d service nova] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:05:46.318800 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 689/1360] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:05:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:05:48.530742 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322214a3-6b47-421f-98f5-a5d5706c41fd None None] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:05:48.531305 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322214a3-6b47-421f-98f5-a5d5706c41fd None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:05:48.531305 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322214a3-6b47-421f-98f5-a5d5706c41fd None None] PATH_INFO: `/` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:05:48.532842 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 672/1361] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 01:05:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:05:48.544140 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b26f0f-860c-46f4-98b9-596be24b407d None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:05:48.544638 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b26f0f-860c-46f4-98b9-596be24b407d None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:05:48.544638 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b26f0f-860c-46f4-98b9-596be24b407d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:05:48.636920 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-e4b26f0f-860c-46f4-98b9-596be24b407d None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:05:48.638159 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-e4b26f0f-860c-46f4-98b9-596be24b407d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:05:48.683151 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:05:48.767339 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 690/1362] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 01:05:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:05:49.076875 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322214a3-6b47-421f-98f5-a5d5706c41fd None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:05:49.078579 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-322214a3-6b47-421f-98f5-a5d5706c41fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:05:49.271595 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322214a3-6b47-421f-98f5-a5d5706c41fd None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:05:49.281329 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:05:49.408787 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ea6365-eb42-4070-a5ec-f333c2c4b6e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6480b2f14c37474c89df9fba48f7cd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:05:49.409364 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ea6365-eb42-4070-a5ec-f333c2c4b6e9 service nova] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:05:49.409884 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ea6365-eb42-4070-a5ec-f333c2c4b6e9 service nova] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:05:49.410168 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ea6365-eb42-4070-a5ec-f333c2c4b6e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:05:49.411883 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-a8ea6365-eb42-4070-a5ec-f333c2c4b6e9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:05:49.536508 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ea6365-eb42-4070-a5ec-f333c2c4b6e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:05:49.538522 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ea6365-eb42-4070-a5ec-f333c2c4b6e9 service nova] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:05:49.559155 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 673/1363] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:05:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 483 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:05:51.837610 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391eaf49-a82a-4086-a5eb-db82999c1206 None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:05:51.838643 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391eaf49-a82a-4086-a5eb-db82999c1206 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:05:51.838923 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391eaf49-a82a-4086-a5eb-db82999c1206 None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:05:51.840513 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 691/1364] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 01:05:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:05:51.847113 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a58bad1-63d9-4f35-963d-744ee41d55e1 None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:05:51.847831 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a58bad1-63d9-4f35-963d-744ee41d55e1 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:05:51.847831 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a58bad1-63d9-4f35-963d-744ee41d55e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:05:51.869003 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:05:51.940354 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-8a58bad1-63d9-4f35-963d-744ee41d55e1 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:05:51.942094 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-8a58bad1-63d9-4f35-963d-744ee41d55e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:05:52.071529 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 674/1365] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 01:05:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:05:52.356235 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cff9a8-83b3-4de8-95c2-fd811d86fd33 None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:05:52.356513 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cff9a8-83b3-4de8-95c2-fd811d86fd33 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:05:52.357040 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cff9a8-83b3-4de8-95c2-fd811d86fd33 None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:05:52.358633 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 692/1366] 10.222.0.79 () {54 vars in 962 bytes} [Tue Aug 30 01:05:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:05:52.364695 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2ac73d-ef2b-49ec-9590-dd0c84ee2126 None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:05:52.364974 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2ac73d-ef2b-49ec-9590-dd0c84ee2126 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:05:52.365240 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2ac73d-ef2b-49ec-9590-dd0c84ee2126 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:05:52.447744 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-fe2ac73d-ef2b-49ec-9590-dd0c84ee2126 None None] MFA Rules not processed for user `6480b2f14c37474c89df9fba48f7cd91`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:05:52.448945 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-fe2ac73d-ef2b-49ec-9590-dd0c84ee2126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:05:52.486546 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:05:52.577215 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 675/1367] 10.222.0.79 () {58 vars in 1059 bytes} [Tue Aug 30 01:05:52 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:05:52.585635 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cff9a8-83b3-4de8-95c2-fd811d86fd33 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:05:52.587142 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-e5cff9a8-83b3-4de8-95c2-fd811d86fd33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:05:52.751051 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cff9a8-83b3-4de8-95c2-fd811d86fd33 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:05:52.774847 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:05:52.878438 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d0dadb-a85d-4bdd-9053-ab43fc948bf9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6480b2f14c37474c89df9fba48f7cd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:05:52.879321 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d0dadb-a85d-4bdd-9053-ab43fc948bf9 service nova] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:05:52.879597 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d0dadb-a85d-4bdd-9053-ab43fc948bf9 service nova] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:05:52.879867 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d0dadb-a85d-4bdd-9053-ab43fc948bf9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:05:52.881476 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-f9d0dadb-a85d-4bdd-9053-ab43fc948bf9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:05:52.976466 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d0dadb-a85d-4bdd-9053-ab43fc948bf9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:05:52.978062 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d0dadb-a85d-4bdd-9053-ab43fc948bf9 service nova] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:05:52.999203 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 693/1368] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:05:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:05:53.666996 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d3b1ed-e17f-4bf0-ac18-c764400da995 None None] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:05:53.667554 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d3b1ed-e17f-4bf0-ac18-c764400da995 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:05:53.667554 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d3b1ed-e17f-4bf0-ac18-c764400da995 None None] PATH_INFO: `/` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:05:53.669043 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 676/1369] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 01:05:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:05:53.674223 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09431e91-e79d-4303-a7c5-c9d5b72fed9f None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:05:53.675057 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09431e91-e79d-4303-a7c5-c9d5b72fed9f None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:05:53.675398 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09431e91-e79d-4303-a7c5-c9d5b72fed9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:05:53.710509 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:05:53.750682 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-09431e91-e79d-4303-a7c5-c9d5b72fed9f None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:05:53.751914 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-09431e91-e79d-4303-a7c5-c9d5b72fed9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:05:53.867874 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 694/1370] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 01:05:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:05:54.463870 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1346a425-1a61-4fcf-9423-66810bd4ee84 None None] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:05:54.463870 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1346a425-1a61-4fcf-9423-66810bd4ee84 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:05:54.463870 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1346a425-1a61-4fcf-9423-66810bd4ee84 None None] PATH_INFO: `/` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:05:54.464319 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 677/1371] 10.222.0.79 () {54 vars in 964 bytes} [Tue Aug 30 01:05:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:05:54.469312 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adec753-7f6f-4e47-b919-be2abdc466e6 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:05:54.469820 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adec753-7f6f-4e47-b919-be2abdc466e6 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:05:54.469921 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adec753-7f6f-4e47-b919-be2abdc466e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:05:54.554417 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-2adec753-7f6f-4e47-b919-be2abdc466e6 None None] MFA Rules not processed for user `7f827c7670b74d938ffe066ced88d1c2`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:05:54.556342 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-2adec753-7f6f-4e47-b919-be2abdc466e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:05:54.609385 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:05:54.642788 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 695/1372] 10.222.0.79 () {58 vars in 1061 bytes} [Tue Aug 30 01:05:54 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:05:54.651750 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1346a425-1a61-4fcf-9423-66810bd4ee84 None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:05:54.653296 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-1346a425-1a61-4fcf-9423-66810bd4ee84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:05:54.780256 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1346a425-1a61-4fcf-9423-66810bd4ee84 None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:05:54.828269 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:05:54.874353 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2453f5ec-11ea-4429-865c-39ffe1cc5e2a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f827c7670b74d938ffe066ced88d1c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:05:54.875038 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2453f5ec-11ea-4429-865c-39ffe1cc5e2a service cinder] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:05:54.875381 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2453f5ec-11ea-4429-865c-39ffe1cc5e2a service cinder] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:05:54.875573 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2453f5ec-11ea-4429-865c-39ffe1cc5e2a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:05:54.877269 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-2453f5ec-11ea-4429-865c-39ffe1cc5e2a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:05:55.011325 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2453f5ec-11ea-4429-865c-39ffe1cc5e2a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:05:55.012803 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2453f5ec-11ea-4429-865c-39ffe1cc5e2a service cinder] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:05:55.034853 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 678/1373] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:05:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 01:05:55.070586 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982319a1-ecc2-4698-8999-7c3af4d3bd79 None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:05:55.070586 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982319a1-ecc2-4698-8999-7c3af4d3bd79 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:05:55.070992 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982319a1-ecc2-4698-8999-7c3af4d3bd79 None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:05:55.075791 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 696/1374] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 01:05:55 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:05:55.079650 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8048fe5d-bf8c-44ef-8ee1-1b0ff0ab5396 None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:05:55.079650 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8048fe5d-bf8c-44ef-8ee1-1b0ff0ab5396 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:05:55.079650 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8048fe5d-bf8c-44ef-8ee1-1b0ff0ab5396 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:05:55.155096 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-8048fe5d-bf8c-44ef-8ee1-1b0ff0ab5396 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:05:55.156171 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-8048fe5d-bf8c-44ef-8ee1-1b0ff0ab5396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:05:55.179352 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:05:55.277096 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 679/1375] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 01:05:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:05:55.564103 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982319a1-ecc2-4698-8999-7c3af4d3bd79 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:05:55.566145 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-982319a1-ecc2-4698-8999-7c3af4d3bd79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:05:55.720793 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982319a1-ecc2-4698-8999-7c3af4d3bd79 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:05:55.783557 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:05:55.847073 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd9d399-5d45-4fa2-a978-29fb118efddd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6480b2f14c37474c89df9fba48f7cd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:05:55.849007 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd9d399-5d45-4fa2-a978-29fb118efddd service nova] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:05:55.849284 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd9d399-5d45-4fa2-a978-29fb118efddd service nova] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:05:55.849552 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd9d399-5d45-4fa2-a978-29fb118efddd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:05:55.851529 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-dfd9d399-5d45-4fa2-a978-29fb118efddd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:05:55.943965 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd9d399-5d45-4fa2-a978-29fb118efddd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:05:55.945546 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd9d399-5d45-4fa2-a978-29fb118efddd service nova] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:05:55.963990 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 697/1376] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:05:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:05:57.963847 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2494b78-8b35-4321-b7dd-3d10147e0dd7 None None] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:05:57.964350 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2494b78-8b35-4321-b7dd-3d10147e0dd7 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:05:57.964431 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2494b78-8b35-4321-b7dd-3d10147e0dd7 None None] PATH_INFO: `/` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:05:57.965931 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 680/1377] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 01:05:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:05:57.972687 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc547e1-5c69-4985-b20a-15fee8588fd1 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:05:57.973212 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc547e1-5c69-4985-b20a-15fee8588fd1 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:05:57.973571 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc547e1-5c69-4985-b20a-15fee8588fd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:05:58.050222 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-3cc547e1-5c69-4985-b20a-15fee8588fd1 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:05:58.051488 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-3cc547e1-5c69-4985-b20a-15fee8588fd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:05:58.058342 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:05:58.163972 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 698/1378] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 01:05:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:05:58.473143 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2494b78-8b35-4321-b7dd-3d10147e0dd7 None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:05:58.474667 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-b2494b78-8b35-4321-b7dd-3d10147e0dd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:05:58.698240 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2494b78-8b35-4321-b7dd-3d10147e0dd7 None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:05:58.710752 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:05:58.869541 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935cec13-6058-4712-bc2e-4791b0d32636 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6480b2f14c37474c89df9fba48f7cd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:05:58.870216 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935cec13-6058-4712-bc2e-4791b0d32636 service nova] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:05:58.870625 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935cec13-6058-4712-bc2e-4791b0d32636 service nova] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:05:58.870994 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935cec13-6058-4712-bc2e-4791b0d32636 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:05:58.872752 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-935cec13-6058-4712-bc2e-4791b0d32636 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:05:58.997807 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935cec13-6058-4712-bc2e-4791b0d32636 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:05:58.999428 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935cec13-6058-4712-bc2e-4791b0d32636 service nova] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:05:59.019503 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 681/1379] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:05:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 547 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:06:01.027885 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a0929e-ea26-4a18-987c-9c4e76b4cd3a None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:06:01.028436 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a0929e-ea26-4a18-987c-9c4e76b4cd3a None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:06:01.028436 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a0929e-ea26-4a18-987c-9c4e76b4cd3a None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:06:01.029925 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 699/1380] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 01:06:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:06:01.035167 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60322a35-5186-4179-89c2-24ec4fc12cec None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:06:01.035637 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60322a35-5186-4179-89c2-24ec4fc12cec None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:06:01.035722 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60322a35-5186-4179-89c2-24ec4fc12cec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:06:01.052835 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:06:01.120315 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-60322a35-5186-4179-89c2-24ec4fc12cec None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:06:01.121721 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-60322a35-5186-4179-89c2-24ec4fc12cec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:06:01.234169 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 682/1381] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 01:06:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:06:01.541076 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a0929e-ea26-4a18-987c-9c4e76b4cd3a None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:06:01.542894 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-31a0929e-ea26-4a18-987c-9c4e76b4cd3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:06:01.708732 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:06:01.724070 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a0929e-ea26-4a18-987c-9c4e76b4cd3a None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:06:01.860889 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113c4d72-d012-49f1-993c-98a1848f183c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6480b2f14c37474c89df9fba48f7cd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:06:01.861393 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113c4d72-d012-49f1-993c-98a1848f183c service nova] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:06:01.862187 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113c4d72-d012-49f1-993c-98a1848f183c service nova] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:06:01.862474 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113c4d72-d012-49f1-993c-98a1848f183c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:06:01.864085 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-113c4d72-d012-49f1-993c-98a1848f183c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:06:01.962731 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113c4d72-d012-49f1-993c-98a1848f183c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:06:01.964430 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113c4d72-d012-49f1-993c-98a1848f183c service nova] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:06:01.976343 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:06:01.986226 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 700/1382] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:06:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:06:04.123001 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1fcd0e-8822-4039-a6f3-0e632f19c9b9 None None] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:06:04.123598 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1fcd0e-8822-4039-a6f3-0e632f19c9b9 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:06:04.123800 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1fcd0e-8822-4039-a6f3-0e632f19c9b9 None None] PATH_INFO: `/` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:06:04.125669 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 683/1383] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 01:06:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:06:04.131046 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa510f0-6573-456e-9497-4a8244d47147 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:06:04.131519 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa510f0-6573-456e-9497-4a8244d47147 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:06:04.131624 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa510f0-6573-456e-9497-4a8244d47147 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:06:04.202597 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-8aa510f0-6573-456e-9497-4a8244d47147 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:06:04.204061 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-8aa510f0-6573-456e-9497-4a8244d47147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:06:04.343516 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 701/1384] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 01:06:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:06:04.636706 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1fcd0e-8822-4039-a6f3-0e632f19c9b9 None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:06:04.638275 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-4e1fcd0e-8822-4039-a6f3-0e632f19c9b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:06:04.730435 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:06:04.794979 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1fcd0e-8822-4039-a6f3-0e632f19c9b9 None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:06:04.931831 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7664bbd6-43ca-4979-802a-c96ebd9f74c7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6480b2f14c37474c89df9fba48f7cd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:06:04.932385 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7664bbd6-43ca-4979-802a-c96ebd9f74c7 service nova] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:06:04.932657 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7664bbd6-43ca-4979-802a-c96ebd9f74c7 service nova] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:06:04.932922 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7664bbd6-43ca-4979-802a-c96ebd9f74c7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:06:04.934534 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-7664bbd6-43ca-4979-802a-c96ebd9f74c7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:06:04.990878 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:06:05.053301 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7664bbd6-43ca-4979-802a-c96ebd9f74c7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:06:05.056254 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7664bbd6-43ca-4979-802a-c96ebd9f74c7 service nova] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:06:05.091807 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 684/1385] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:06:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:06:07.267857 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac79e92-e46a-404d-a94f-236184969d81 None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:06:07.268776 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac79e92-e46a-404d-a94f-236184969d81 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:06:07.269064 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac79e92-e46a-404d-a94f-236184969d81 None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:06:07.270439 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 702/1386] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 01:06:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:06:07.275946 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb5d070-35eb-4bae-a102-d21b1486f13a None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:06:07.276571 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb5d070-35eb-4bae-a102-d21b1486f13a None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:06:07.276571 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb5d070-35eb-4bae-a102-d21b1486f13a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:06:07.350081 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-dbb5d070-35eb-4bae-a102-d21b1486f13a None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:06:07.351336 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-dbb5d070-35eb-4bae-a102-d21b1486f13a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:06:07.464218 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 685/1387] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 01:06:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:06:07.768812 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac79e92-e46a-404d-a94f-236184969d81 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:06:07.770876 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-cac79e92-e46a-404d-a94f-236184969d81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:06:07.859496 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:06:07.932727 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac79e92-e46a-404d-a94f-236184969d81 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:06:08.064884 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4cac72-2aff-475c-bd7d-7186220a0c25 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6480b2f14c37474c89df9fba48f7cd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:06:08.065818 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4cac72-2aff-475c-bd7d-7186220a0c25 service nova] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:06:08.066182 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4cac72-2aff-475c-bd7d-7186220a0c25 service nova] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:06:08.066549 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4cac72-2aff-475c-bd7d-7186220a0c25 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:06:08.069067 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-cd4cac72-2aff-475c-bd7d-7186220a0c25 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:06:08.116848 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:06:08.175696 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4cac72-2aff-475c-bd7d-7186220a0c25 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:06:08.177288 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4cac72-2aff-475c-bd7d-7186220a0c25 service nova] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:06:08.196361 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 703/1388] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:06:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:06:10.214210 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b49ecf2-1c6f-4dff-916a-f11f25717f75 None None] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:06:10.214781 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b49ecf2-1c6f-4dff-916a-f11f25717f75 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:06:10.214781 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b49ecf2-1c6f-4dff-916a-f11f25717f75 None None] PATH_INFO: `/` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:06:10.216118 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 686/1389] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 01:06:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:06:10.221710 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c242a7d-5f43-4c4a-9721-5c22dca70d80 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:06:10.222170 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c242a7d-5f43-4c4a-9721-5c22dca70d80 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:06:10.222361 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c242a7d-5f43-4c4a-9721-5c22dca70d80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:06:10.228377 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be180851-0dae-45aa-9908-d6b930719f06 None None] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:06:10.228665 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be180851-0dae-45aa-9908-d6b930719f06 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:06:10.229221 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be180851-0dae-45aa-9908-d6b930719f06 None None] PATH_INFO: `/` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:06:10.230481 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 687/1390] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 01:06:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 01:06:10.235508 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eec8ab-793d-4908-a05d-483ef5b62446 None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:06:10.235787 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eec8ab-793d-4908-a05d-483ef5b62446 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:06:10.236057 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eec8ab-793d-4908-a05d-483ef5b62446 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:06:10.272569 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:06:10.295792 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-9c242a7d-5f43-4c4a-9721-5c22dca70d80 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:06:10.296984 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-9c242a7d-5f43-4c4a-9721-5c22dca70d80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:06:10.305821 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-a5eec8ab-793d-4908-a05d-483ef5b62446 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:06:10.306987 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-a5eec8ab-793d-4908-a05d-483ef5b62446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:06:10.395553 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 704/1391] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 01:06:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:06:10.407737 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 688/1392] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 01:06:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:06:10.697760 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a3916c-de98-4869-b9f1-2f3993dd343b None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:06:10.698047 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a3916c-de98-4869-b9f1-2f3993dd343b None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:06:10.698323 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a3916c-de98-4869-b9f1-2f3993dd343b None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:06:10.699683 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 705/1393] 10.222.0.79 () {54 vars in 967 bytes} [Tue Aug 30 01:06:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:06:10.699800 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5eec8ab-793d-4908-a05d-483ef5b62446 None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:06:10.701083 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-a5eec8ab-793d-4908-a05d-483ef5b62446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:06:10.704127 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98517f2-11b2-4e0f-be66-20bb96da0021 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:06:10.704397 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98517f2-11b2-4e0f-be66-20bb96da0021 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:06:10.704660 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98517f2-11b2-4e0f-be66-20bb96da0021 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:06:10.720478 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:06:10.783010 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-f98517f2-11b2-4e0f-be66-20bb96da0021 None None] MFA Rules not processed for user `5e37a5c33c064c488fd4667170f7703a`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:06:10.784846 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-f98517f2-11b2-4e0f-be66-20bb96da0021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:06:10.810109 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:06:10.818821 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5eec8ab-793d-4908-a05d-483ef5b62446 None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:06:10.862298 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 706/1394] 10.222.0.79 () {58 vars in 1064 bytes} [Tue Aug 30 01:06:10 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:06:10.869658 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98517f2-11b2-4e0f-be66-20bb96da0021 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:06:10.877950 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98517f2-11b2-4e0f-be66-20bb96da0021 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:06:10.934038 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9646344a-3176-4296-847f-285d67c5f8c6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6480b2f14c37474c89df9fba48f7cd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:06:10.934553 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9646344a-3176-4296-847f-285d67c5f8c6 service nova] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:06:10.934823 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9646344a-3176-4296-847f-285d67c5f8c6 service nova] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:06:10.935086 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9646344a-3176-4296-847f-285d67c5f8c6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:06:10.936701 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-9646344a-3176-4296-847f-285d67c5f8c6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:06:10.956211 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7fe77c-198d-4d28-9da2-5172e04c4d00 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e37a5c33c064c488fd4667170f7703a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:06:10.956847 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7fe77c-198d-4d28-9da2-5172e04c4d00 service glance] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:06:10.957125 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7fe77c-198d-4d28-9da2-5172e04c4d00 service glance] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:06:10.957393 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7fe77c-198d-4d28-9da2-5172e04c4d00 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:06:10.958970 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-ac7fe77c-198d-4d28-9da2-5172e04c4d00 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:06:10.989608 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:06:11.029357 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9646344a-3176-4296-847f-285d67c5f8c6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:06:11.030994 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9646344a-3176-4296-847f-285d67c5f8c6 service nova] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:06:11.046544 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:06:11.053073 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 689/1395] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:06:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 01:06:11.085807 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7fe77c-198d-4d28-9da2-5172e04c4d00 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:06:11.085807 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7fe77c-198d-4d28-9da2-5172e04c4d00 service glance] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:06:11.100708 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 707/1396] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:06:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 01:06:11.866257 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e9b581-197b-46c5-a003-bc8e26d39b16 None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:06:11.866810 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e9b581-197b-46c5-a003-bc8e26d39b16 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:06:11.867089 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e9b581-197b-46c5-a003-bc8e26d39b16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:06:11.949609 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-80e9b581-197b-46c5-a003-bc8e26d39b16 None None] MFA Rules not processed for user `5cacaed93420436e8f423f96a8041401`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:06:11.950943 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-80e9b581-197b-46c5-a003-bc8e26d39b16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:06:12.058405 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 690/1397] 10.222.0.79 () {58 vars in 1009 bytes} [Tue Aug 30 01:06:11 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:06:12.105992 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7828dba-1d10-4117-86e3-361420304bdb None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:06:12.106566 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7828dba-1d10-4117-86e3-361420304bdb None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:06:12.106566 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7828dba-1d10-4117-86e3-361420304bdb None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:06:12.108099 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 708/1398] 10.222.0.79 () {54 vars in 943 bytes} [Tue Aug 30 01:06:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:06:12.117031 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aea43c5-2eea-4abb-8ef7-d4c69b34a0fa None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:06:12.117516 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aea43c5-2eea-4abb-8ef7-d4c69b34a0fa None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:06:12.117937 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aea43c5-2eea-4abb-8ef7-d4c69b34a0fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:06:12.209420 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-2aea43c5-2eea-4abb-8ef7-d4c69b34a0fa None None] MFA Rules not processed for user `dd556fa6ba464928b1e067325792a523`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:06:12.210640 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-2aea43c5-2eea-4abb-8ef7-d4c69b34a0fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:06:12.250155 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:06:12.337792 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 691/1399] 10.222.0.79 () {58 vars in 1040 bytes} [Tue Aug 30 01:06:12 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:06:12.349493 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7828dba-1d10-4117-86e3-361420304bdb None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:06:12.351067 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-a7828dba-1d10-4117-86e3-361420304bdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:06:12.506625 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:06:12.509576 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7828dba-1d10-4117-86e3-361420304bdb None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:06:12.652205 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1307948-b910-4c69-b987-02ea7f164bee service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd556fa6ba464928b1e067325792a523', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:06:12.653138 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1307948-b910-4c69-b987-02ea7f164bee service swift] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:06:12.653636 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1307948-b910-4c69-b987-02ea7f164bee service swift] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:06:12.654102 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1307948-b910-4c69-b987-02ea7f164bee service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:06:12.656984 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-b1307948-b910-4c69-b987-02ea7f164bee service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:06:12.800975 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1307948-b910-4c69-b987-02ea7f164bee service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:06:12.802803 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1307948-b910-4c69-b987-02ea7f164bee service swift] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:06:12.811967 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 709/1400] 10.222.0.79 () {60 vars in 1384 bytes} [Tue Aug 30 01:06:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 01:06:13.158797 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a12fb59-f44f-4d82-9088-65aec486c1d8 None None] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:06:13.160738 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a12fb59-f44f-4d82-9088-65aec486c1d8 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:06:13.161566 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a12fb59-f44f-4d82-9088-65aec486c1d8 None None] PATH_INFO: `/` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:06:13.167178 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 692/1401] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 01:06:13 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:06:13.170233 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0387419a-cc30-4eda-89d3-c1048ac19828 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:06:13.170787 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0387419a-cc30-4eda-89d3-c1048ac19828 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:06:13.170787 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0387419a-cc30-4eda-89d3-c1048ac19828 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:06:13.234563 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:06:13.284763 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-0387419a-cc30-4eda-89d3-c1048ac19828 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:06:13.286026 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-0387419a-cc30-4eda-89d3-c1048ac19828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:06:13.425408 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 710/1402] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 01:06:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:06:13.761718 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a12fb59-f44f-4d82-9088-65aec486c1d8 None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:06:13.763598 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-8a12fb59-f44f-4d82-9088-65aec486c1d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:06:13.994161 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a12fb59-f44f-4d82-9088-65aec486c1d8 None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:06:13.998668 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:06:14.181938 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20a8939-b25a-4a55-9b52-8439d44d0d59 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6480b2f14c37474c89df9fba48f7cd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:06:14.182932 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20a8939-b25a-4a55-9b52-8439d44d0d59 service nova] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:06:14.182932 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20a8939-b25a-4a55-9b52-8439d44d0d59 service nova] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:06:14.183280 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20a8939-b25a-4a55-9b52-8439d44d0d59 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:06:14.189134 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-f20a8939-b25a-4a55-9b52-8439d44d0d59 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:06:14.305141 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20a8939-b25a-4a55-9b52-8439d44d0d59 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:06:14.306653 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20a8939-b25a-4a55-9b52-8439d44d0d59 service nova] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:06:14.332186 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 693/1403] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:06:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 571 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:06:17.440664 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82798bb5-59c8-4b56-85ad-1d8501437d4d None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:06:17.441629 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82798bb5-59c8-4b56-85ad-1d8501437d4d None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:06:17.442154 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82798bb5-59c8-4b56-85ad-1d8501437d4d None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:06:17.444099 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 711/1404] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 01:06:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 01:06:17.451386 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152a9d33-f653-41a5-9076-56a1fb07b06e None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:06:17.451886 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152a9d33-f653-41a5-9076-56a1fb07b06e None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:06:17.452361 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152a9d33-f653-41a5-9076-56a1fb07b06e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:06:17.474017 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:06:17.598527 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-152a9d33-f653-41a5-9076-56a1fb07b06e None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:06:17.601017 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-152a9d33-f653-41a5-9076-56a1fb07b06e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:06:17.825361 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 694/1405] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 01:06:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:06:18.159041 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82798bb5-59c8-4b56-85ad-1d8501437d4d None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:06:18.160848 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-82798bb5-59c8-4b56-85ad-1d8501437d4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:06:18.336488 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:06:18.428864 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82798bb5-59c8-4b56-85ad-1d8501437d4d None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:06:18.641443 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0438b3-fded-4b05-a06a-5649f1ccb872 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6480b2f14c37474c89df9fba48f7cd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:06:18.643180 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0438b3-fded-4b05-a06a-5649f1ccb872 service nova] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:06:18.643180 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0438b3-fded-4b05-a06a-5649f1ccb872 service nova] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:06:18.643180 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0438b3-fded-4b05-a06a-5649f1ccb872 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:06:18.645554 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-3c0438b3-fded-4b05-a06a-5649f1ccb872 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:06:18.781203 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:06:18.839391 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0438b3-fded-4b05-a06a-5649f1ccb872 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:06:18.841598 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0438b3-fded-4b05-a06a-5649f1ccb872 service nova] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:06:18.899855 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 712/1406] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:06:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 742 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:06:21.155514 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9886af2-917b-4ee1-9bd9-75668e7ec60b None None] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:06:21.156126 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9886af2-917b-4ee1-9bd9-75668e7ec60b None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:06:21.156126 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9886af2-917b-4ee1-9bd9-75668e7ec60b None None] PATH_INFO: `/` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:06:21.157444 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 695/1407] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 01:06:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:06:21.163601 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c7e1f4-ec43-4388-a4c9-047120ddc470 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:06:21.164163 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c7e1f4-ec43-4388-a4c9-047120ddc470 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:06:21.164163 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c7e1f4-ec43-4388-a4c9-047120ddc470 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:06:21.383730 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-c6c7e1f4-ec43-4388-a4c9-047120ddc470 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:06:21.385123 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-c6c7e1f4-ec43-4388-a4c9-047120ddc470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:06:21.522676 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 713/1408] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 01:06:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 360 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:06:21.880074 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9886af2-917b-4ee1-9bd9-75668e7ec60b None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:06:21.881993 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-d9886af2-917b-4ee1-9bd9-75668e7ec60b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:06:22.034243 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:06:22.118378 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9886af2-917b-4ee1-9bd9-75668e7ec60b None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:06:22.275439 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce96b18e-6b21-4ed4-bbef-bd93f42e949e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6480b2f14c37474c89df9fba48f7cd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:06:22.276517 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce96b18e-6b21-4ed4-bbef-bd93f42e949e service nova] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:06:22.276880 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce96b18e-6b21-4ed4-bbef-bd93f42e949e service nova] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:06:22.277589 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce96b18e-6b21-4ed4-bbef-bd93f42e949e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:06:22.280110 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-ce96b18e-6b21-4ed4-bbef-bd93f42e949e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:06:22.381029 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:06:22.438745 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce96b18e-6b21-4ed4-bbef-bd93f42e949e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:06:22.441454 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce96b18e-6b21-4ed4-bbef-bd93f42e949e service nova] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:06:22.470176 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 696/1409] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:06:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 591 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:06:31.519049 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=79 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:06:32.466609 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=23 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:06:38.008221 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e33c256-9faa-4ec1-a37c-2c5f72761913 None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:06:38.008860 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e33c256-9faa-4ec1-a37c-2c5f72761913 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:06:38.008860 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e33c256-9faa-4ec1-a37c-2c5f72761913 None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:06:38.010050 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 714/1410] 10.222.0.79 () {54 vars in 918 bytes} [Tue Aug 30 01:06:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:06:38.018381 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5733bd2-5584-4c73-8808-ab596dac2a24 None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:06:38.019080 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5733bd2-5584-4c73-8808-ab596dac2a24 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:06:38.019080 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5733bd2-5584-4c73-8808-ab596dac2a24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:06:38.107675 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-b5733bd2-5584-4c73-8808-ab596dac2a24 None None] MFA Rules not processed for user `d68e91e4259e449797fb83de548aec1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:06:38.108962 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-b5733bd2-5584-4c73-8808-ab596dac2a24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:06:38.235421 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 697/1411] 10.222.0.79 () {58 vars in 1015 bytes} [Tue Aug 30 01:06:38 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:06:38.252729 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27332c12-99e7-4bf1-933a-7edfc5ad0e28 None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:06:38.253059 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27332c12-99e7-4bf1-933a-7edfc5ad0e28 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:06:38.253402 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27332c12-99e7-4bf1-933a-7edfc5ad0e28 None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:06:38.254963 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 715/1412] 10.222.0.79 () {54 vars in 918 bytes} [Tue Aug 30 01:06:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:06:38.262465 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81aed0a-2a04-4be0-971d-b12f55e948c2 None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:06:38.262719 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81aed0a-2a04-4be0-971d-b12f55e948c2 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:06:38.262992 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81aed0a-2a04-4be0-971d-b12f55e948c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:06:38.345434 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:06:38.349669 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-d81aed0a-2a04-4be0-971d-b12f55e948c2 None None] MFA Rules not processed for user `6480b2f14c37474c89df9fba48f7cd91`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:06:38.355610 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-d81aed0a-2a04-4be0-971d-b12f55e948c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:06:38.513765 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 698/1413] 10.222.0.79 () {58 vars in 1015 bytes} [Tue Aug 30 01:06:38 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:06:41.150022 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00893578-749e-4898-80f1-bdb5878805f7 None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:06:41.150614 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00893578-749e-4898-80f1-bdb5878805f7 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:06:41.150614 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00893578-749e-4898-80f1-bdb5878805f7 None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:06:41.152410 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 716/1414] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 01:06:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:06:41.159614 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bb2eeb-850e-4bab-9a1b-85d4b06ad596 None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:06:41.160174 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bb2eeb-850e-4bab-9a1b-85d4b06ad596 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:06:41.160429 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bb2eeb-850e-4bab-9a1b-85d4b06ad596 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:06:41.254434 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-c7bb2eeb-850e-4bab-9a1b-85d4b06ad596 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:06:41.256053 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-c7bb2eeb-850e-4bab-9a1b-85d4b06ad596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:06:41.321364 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:06:41.374791 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 699/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 01:06:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:06:41.697981 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00893578-749e-4898-80f1-bdb5878805f7 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:06:41.699573 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-00893578-749e-4898-80f1-bdb5878805f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:06:41.884122 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00893578-749e-4898-80f1-bdb5878805f7 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:06:41.979995 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:06:42.046421 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e40501e-bd0f-4525-9f11-e7132e38276d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6480b2f14c37474c89df9fba48f7cd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:06:42.047848 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e40501e-bd0f-4525-9f11-e7132e38276d service nova] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:06:42.049178 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e40501e-bd0f-4525-9f11-e7132e38276d service nova] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:06:42.049669 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e40501e-bd0f-4525-9f11-e7132e38276d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:06:42.051486 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-5e40501e-bd0f-4525-9f11-e7132e38276d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:06:42.163376 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e40501e-bd0f-4525-9f11-e7132e38276d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:06:42.165143 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e40501e-bd0f-4525-9f11-e7132e38276d service nova] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:06:42.185460 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 717/1416] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:06:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 488 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:06:43.107097 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb59606b-fa96-42aa-b614-73dbafe1beb3 None None] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:06:43.107694 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb59606b-fa96-42aa-b614-73dbafe1beb3 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:06:43.107694 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb59606b-fa96-42aa-b614-73dbafe1beb3 None None] PATH_INFO: `/` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:06:43.109076 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 700/1417] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 01:06:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:06:43.114959 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1475d7-851f-460d-b144-a200c050eea6 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:06:43.115269 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1475d7-851f-460d-b144-a200c050eea6 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:06:43.115540 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1475d7-851f-460d-b144-a200c050eea6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:06:43.190541 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-ee1475d7-851f-460d-b144-a200c050eea6 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:06:43.191759 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-ee1475d7-851f-460d-b144-a200c050eea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:06:43.218609 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:06:43.290325 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 718/1418] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 01:06:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:06:43.440750 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb59606b-fa96-42aa-b614-73dbafe1beb3 None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:06:43.442359 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-fb59606b-fa96-42aa-b614-73dbafe1beb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:06:43.591119 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb59606b-fa96-42aa-b614-73dbafe1beb3 None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:06:43.633085 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:06:43.707443 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4b4662-a446-47db-a028-52ed12b40e37 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6480b2f14c37474c89df9fba48f7cd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:06:43.708057 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4b4662-a446-47db-a028-52ed12b40e37 service nova] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:06:43.708333 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4b4662-a446-47db-a028-52ed12b40e37 service nova] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:06:43.708602 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4b4662-a446-47db-a028-52ed12b40e37 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:06:43.710229 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-da4b4662-a446-47db-a028-52ed12b40e37 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:06:43.804502 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4b4662-a446-47db-a028-52ed12b40e37 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:06:43.806146 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4b4662-a446-47db-a028-52ed12b40e37 service nova] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:06:43.824243 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 701/1419] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:06:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:06:44.722343 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee658b9-b516-4dd9-b369-c3a2ccb56a3a None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:06:44.722971 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee658b9-b516-4dd9-b369-c3a2ccb56a3a None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:06:44.722971 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee658b9-b516-4dd9-b369-c3a2ccb56a3a None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:06:44.724208 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 719/1420] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 01:06:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:06:44.729403 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60046c58-2c36-427f-b60c-d44efcd41597 None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:06:44.729909 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60046c58-2c36-427f-b60c-d44efcd41597 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:06:44.730017 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60046c58-2c36-427f-b60c-d44efcd41597 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:06:44.787291 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:06:44.810559 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-60046c58-2c36-427f-b60c-d44efcd41597 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:06:44.811777 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-60046c58-2c36-427f-b60c-d44efcd41597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:06:44.909821 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 702/1421] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 01:06:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:06:45.067580 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee658b9-b516-4dd9-b369-c3a2ccb56a3a None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:06:45.069417 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-5ee658b9-b516-4dd9-b369-c3a2ccb56a3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:06:45.267265 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee658b9-b516-4dd9-b369-c3a2ccb56a3a None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:06:45.290103 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:06:45.402913 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447bee44-b35a-418c-8ab5-9c0dd875b4a9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6480b2f14c37474c89df9fba48f7cd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:06:45.403461 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447bee44-b35a-418c-8ab5-9c0dd875b4a9 service nova] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:06:45.403734 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447bee44-b35a-418c-8ab5-9c0dd875b4a9 service nova] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:06:45.404024 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447bee44-b35a-418c-8ab5-9c0dd875b4a9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:06:45.405605 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-447bee44-b35a-418c-8ab5-9c0dd875b4a9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:06:45.496660 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447bee44-b35a-418c-8ab5-9c0dd875b4a9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:06:45.498235 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447bee44-b35a-418c-8ab5-9c0dd875b4a9 service nova] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:06:45.518268 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 720/1422] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:06:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:06:46.412684 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5025269-84ff-45be-9548-2ab7b607d0cf None None] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:06:46.413234 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5025269-84ff-45be-9548-2ab7b607d0cf None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:06:46.413341 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5025269-84ff-45be-9548-2ab7b607d0cf None None] PATH_INFO: `/` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:06:46.414605 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 703/1423] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 01:06:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:06:46.419653 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c2c63b-6a5d-42e6-8453-d1eb25ed1a2a None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:06:46.420067 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c2c63b-6a5d-42e6-8453-d1eb25ed1a2a None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:06:46.420199 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c2c63b-6a5d-42e6-8453-d1eb25ed1a2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:06:46.440040 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:06:46.496823 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-06c2c63b-6a5d-42e6-8453-d1eb25ed1a2a None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:06:46.498039 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-06c2c63b-6a5d-42e6-8453-d1eb25ed1a2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:06:46.597247 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 721/1424] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 01:06:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:06:46.746896 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5025269-84ff-45be-9548-2ab7b607d0cf None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:06:46.748452 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-c5025269-84ff-45be-9548-2ab7b607d0cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:06:46.859676 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:06:46.896792 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5025269-84ff-45be-9548-2ab7b607d0cf None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:06:47.019662 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ded8b9f-656b-47ed-b4f8-176fbe5352c5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6480b2f14c37474c89df9fba48f7cd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:06:47.020185 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ded8b9f-656b-47ed-b4f8-176fbe5352c5 service nova] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:06:47.020463 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ded8b9f-656b-47ed-b4f8-176fbe5352c5 service nova] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:06:47.020729 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ded8b9f-656b-47ed-b4f8-176fbe5352c5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:06:47.022337 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-2ded8b9f-656b-47ed-b4f8-176fbe5352c5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:06:47.103779 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:06:47.118275 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ded8b9f-656b-47ed-b4f8-176fbe5352c5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:06:47.119910 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ded8b9f-656b-47ed-b4f8-176fbe5352c5 service nova] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:06:47.137713 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 704/1425] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:06:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:06:48.012111 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e771d4a-0d39-4996-b45b-27ad3941d827 None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:06:48.012821 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e771d4a-0d39-4996-b45b-27ad3941d827 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:06:48.012821 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e771d4a-0d39-4996-b45b-27ad3941d827 None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:06:48.014346 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 722/1426] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 01:06:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:06:48.021415 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3ec5a7-2516-4115-becf-58802c18ae50 None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:06:48.022012 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3ec5a7-2516-4115-becf-58802c18ae50 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:06:48.022165 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3ec5a7-2516-4115-becf-58802c18ae50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:06:48.107380 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-bd3ec5a7-2516-4115-becf-58802c18ae50 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:06:48.108581 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-bd3ec5a7-2516-4115-becf-58802c18ae50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:06:48.205613 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 705/1427] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 01:06:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:06:48.355797 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e771d4a-0d39-4996-b45b-27ad3941d827 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:06:48.357211 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-6e771d4a-0d39-4996-b45b-27ad3941d827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:06:48.444528 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:06:48.515390 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e771d4a-0d39-4996-b45b-27ad3941d827 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:06:48.633941 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39ebab0-4ba8-4aa3-8adf-d7a19fa63f2f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6480b2f14c37474c89df9fba48f7cd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:06:48.634453 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39ebab0-4ba8-4aa3-8adf-d7a19fa63f2f service nova] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:06:48.634721 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39ebab0-4ba8-4aa3-8adf-d7a19fa63f2f service nova] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:06:48.634978 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39ebab0-4ba8-4aa3-8adf-d7a19fa63f2f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:06:48.636585 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-d39ebab0-4ba8-4aa3-8adf-d7a19fa63f2f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:06:48.684913 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:06:48.728283 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39ebab0-4ba8-4aa3-8adf-d7a19fa63f2f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:06:48.729883 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39ebab0-4ba8-4aa3-8adf-d7a19fa63f2f service nova] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:06:48.749237 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 723/1428] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:06:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:06:49.585044 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac69fd0-a9e1-429c-b156-aa26c02a1cd8 None None] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:06:49.585639 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac69fd0-a9e1-429c-b156-aa26c02a1cd8 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:06:49.585639 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac69fd0-a9e1-429c-b156-aa26c02a1cd8 None None] PATH_INFO: `/` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:06:49.586924 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 706/1429] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 01:06:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:06:49.592134 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a31672-fa7e-4f5b-afdc-da84503e8cb4 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:06:49.592555 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a31672-fa7e-4f5b-afdc-da84503e8cb4 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:06:49.592699 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a31672-fa7e-4f5b-afdc-da84503e8cb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:06:49.681101 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-d3a31672-fa7e-4f5b-afdc-da84503e8cb4 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:06:49.682300 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-d3a31672-fa7e-4f5b-afdc-da84503e8cb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:06:49.789951 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 724/1430] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 01:06:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:06:49.958223 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac69fd0-a9e1-429c-b156-aa26c02a1cd8 None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:06:49.959822 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-2ac69fd0-a9e1-429c-b156-aa26c02a1cd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:06:50.017653 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:06:50.129503 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac69fd0-a9e1-429c-b156-aa26c02a1cd8 None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:06:50.254014 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d28f2c-9c88-44e3-a0ff-f69198a3e4c5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6480b2f14c37474c89df9fba48f7cd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:06:50.254624 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d28f2c-9c88-44e3-a0ff-f69198a3e4c5 service nova] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:06:50.254899 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d28f2c-9c88-44e3-a0ff-f69198a3e4c5 service nova] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:06:50.255192 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d28f2c-9c88-44e3-a0ff-f69198a3e4c5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:06:50.256857 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-c7d28f2c-9c88-44e3-a0ff-f69198a3e4c5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:06:50.265317 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:06:50.356240 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d28f2c-9c88-44e3-a0ff-f69198a3e4c5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:06:50.357860 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d28f2c-9c88-44e3-a0ff-f69198a3e4c5 service nova] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:06:50.376898 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 707/1431] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:06:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:06:51.205729 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c3240b-927d-46a4-8f5b-ebd11aabce73 None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:06:51.206332 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c3240b-927d-46a4-8f5b-ebd11aabce73 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:06:51.206332 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c3240b-927d-46a4-8f5b-ebd11aabce73 None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:06:51.207632 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 725/1432] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 01:06:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:06:51.212521 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0cd0b4-9e6a-4d50-a5f7-e7d55fbe9fdb None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:06:51.212983 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0cd0b4-9e6a-4d50-a5f7-e7d55fbe9fdb None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:06:51.213089 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0cd0b4-9e6a-4d50-a5f7-e7d55fbe9fdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:06:51.292509 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-af0cd0b4-9e6a-4d50-a5f7-e7d55fbe9fdb None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:06:51.293706 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-af0cd0b4-9e6a-4d50-a5f7-e7d55fbe9fdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:06:51.360204 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:06:51.389322 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 708/1433] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 01:06:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:06:51.538045 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c3240b-927d-46a4-8f5b-ebd11aabce73 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:06:51.539562 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-94c3240b-927d-46a4-8f5b-ebd11aabce73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:06:51.557330 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:06:51.688857 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c3240b-927d-46a4-8f5b-ebd11aabce73 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:06:51.778475 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:06:51.806676 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d2e7be-9c6f-413d-9300-c885c041c454 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6480b2f14c37474c89df9fba48f7cd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:06:51.807401 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d2e7be-9c6f-413d-9300-c885c041c454 service nova] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:06:51.807679 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d2e7be-9c6f-413d-9300-c885c041c454 service nova] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:06:51.807971 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d2e7be-9c6f-413d-9300-c885c041c454 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:06:51.809545 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-39d2e7be-9c6f-413d-9300-c885c041c454 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:06:51.898320 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d2e7be-9c6f-413d-9300-c885c041c454 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:06:51.899936 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d2e7be-9c6f-413d-9300-c885c041c454 service nova] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:06:51.918478 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 726/1434] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:06:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:06:52.765379 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dace027-aa7c-4d3a-bd75-df36b836a69b None None] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:06:52.765954 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dace027-aa7c-4d3a-bd75-df36b836a69b None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:06:52.765954 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dace027-aa7c-4d3a-bd75-df36b836a69b None None] PATH_INFO: `/` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:06:52.767491 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 709/1435] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 01:06:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:06:52.772440 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2329df-772a-45ba-9a3a-68fb974ed3ad None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:06:52.772893 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2329df-772a-45ba-9a3a-68fb974ed3ad None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:06:52.773015 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2329df-772a-45ba-9a3a-68fb974ed3ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:06:52.846920 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-af2329df-772a-45ba-9a3a-68fb974ed3ad None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:06:52.848143 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-af2329df-772a-45ba-9a3a-68fb974ed3ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:06:52.889997 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:06:52.946841 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 727/1436] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 01:06:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:06:53.111821 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dace027-aa7c-4d3a-bd75-df36b836a69b None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:06:53.113277 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-6dace027-aa7c-4d3a-bd75-df36b836a69b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:06:53.261260 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dace027-aa7c-4d3a-bd75-df36b836a69b None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:06:53.319772 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:06:53.380797 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fe3b86-f788-4737-b92f-7d1e489a4b9a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6480b2f14c37474c89df9fba48f7cd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:06:53.381310 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fe3b86-f788-4737-b92f-7d1e489a4b9a service nova] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:06:53.381591 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fe3b86-f788-4737-b92f-7d1e489a4b9a service nova] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:06:53.381863 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fe3b86-f788-4737-b92f-7d1e489a4b9a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:06:53.383499 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-f4fe3b86-f788-4737-b92f-7d1e489a4b9a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:06:53.481588 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fe3b86-f788-4737-b92f-7d1e489a4b9a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:06:53.483329 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fe3b86-f788-4737-b92f-7d1e489a4b9a service nova] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:06:53.503641 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 710/1437] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:06:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:06:54.323022 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca94c19-c0a6-456c-8398-74b3728c9e93 None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:06:54.323633 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca94c19-c0a6-456c-8398-74b3728c9e93 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:06:54.323633 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca94c19-c0a6-456c-8398-74b3728c9e93 None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:06:54.324986 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 728/1438] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 01:06:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:06:54.330056 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f5d4ea-a243-4d8c-8ada-f060ce35d34f None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:06:54.330515 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f5d4ea-a243-4d8c-8ada-f060ce35d34f None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:06:54.330622 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f5d4ea-a243-4d8c-8ada-f060ce35d34f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:06:54.409843 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-16f5d4ea-a243-4d8c-8ada-f060ce35d34f None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:06:54.411056 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-16f5d4ea-a243-4d8c-8ada-f060ce35d34f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:06:54.413162 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:06:54.512569 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 711/1439] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 01:06:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:06:54.667226 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca94c19-c0a6-456c-8398-74b3728c9e93 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:06:54.668752 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-7ca94c19-c0a6-456c-8398-74b3728c9e93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:06:54.813173 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca94c19-c0a6-456c-8398-74b3728c9e93 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:06:54.841253 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:06:54.928773 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bf577e-cfcc-4ee6-a094-4bf2f399f67f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6480b2f14c37474c89df9fba48f7cd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:06:54.929379 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bf577e-cfcc-4ee6-a094-4bf2f399f67f service nova] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:06:54.929655 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bf577e-cfcc-4ee6-a094-4bf2f399f67f service nova] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:06:54.929928 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bf577e-cfcc-4ee6-a094-4bf2f399f67f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:06:54.931543 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-52bf577e-cfcc-4ee6-a094-4bf2f399f67f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:06:55.022931 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bf577e-cfcc-4ee6-a094-4bf2f399f67f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:06:55.024537 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bf577e-cfcc-4ee6-a094-4bf2f399f67f service nova] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:06:55.043259 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 729/1440] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:06:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:06:56.902208 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7748c533-7a5e-4020-a216-ffd6477b1958 None None] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:06:56.902809 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7748c533-7a5e-4020-a216-ffd6477b1958 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:06:56.902809 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7748c533-7a5e-4020-a216-ffd6477b1958 None None] PATH_INFO: `/` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:06:56.904125 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 712/1441] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 01:06:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:06:56.909459 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0e1ccf-d6af-4655-af6f-f45f18fbf7b0 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:06:56.909925 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0e1ccf-d6af-4655-af6f-f45f18fbf7b0 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:06:56.910029 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0e1ccf-d6af-4655-af6f-f45f18fbf7b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:06:56.953316 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:06:56.978712 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-ea0e1ccf-d6af-4655-af6f-f45f18fbf7b0 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:06:56.979957 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-ea0e1ccf-d6af-4655-af6f-f45f18fbf7b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:06:57.077783 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 730/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 01:06:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:06:57.376860 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7748c533-7a5e-4020-a216-ffd6477b1958 None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:06:57.378414 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-7748c533-7a5e-4020-a216-ffd6477b1958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:06:57.486730 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7748c533-7a5e-4020-a216-ffd6477b1958 None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:06:57.519004 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:06:57.562284 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5465cb7d-af6c-4028-b45f-669a8b6bb973 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16e6a0ca26fc4ef892c188ad89a1e132', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:06:57.562942 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5465cb7d-af6c-4028-b45f-669a8b6bb973 service neutron] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:06:57.563295 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5465cb7d-af6c-4028-b45f-669a8b6bb973 service neutron] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:06:57.563698 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5465cb7d-af6c-4028-b45f-669a8b6bb973 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:06:57.565696 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-5465cb7d-af6c-4028-b45f-669a8b6bb973 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:06:57.677820 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5465cb7d-af6c-4028-b45f-669a8b6bb973 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:06:57.679270 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5465cb7d-af6c-4028-b45f-669a8b6bb973 service neutron] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:06:57.697195 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 713/1443] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:06:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:06:59.792552 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968846b7-12fe-49fb-8f4e-09a92abd2674 None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:06:59.793096 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968846b7-12fe-49fb-8f4e-09a92abd2674 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:06:59.793096 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968846b7-12fe-49fb-8f4e-09a92abd2674 None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:06:59.794442 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 731/1444] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 01:06:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 01:06:59.800389 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7135de9e-f2fa-4b18-a974-c786f38b41eb None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:06:59.800869 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7135de9e-f2fa-4b18-a974-c786f38b41eb None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:06:59.800989 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7135de9e-f2fa-4b18-a974-c786f38b41eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:06:59.871825 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-7135de9e-f2fa-4b18-a974-c786f38b41eb None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:06:59.873038 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-7135de9e-f2fa-4b18-a974-c786f38b41eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:06:59.887035 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:06:59.974128 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 714/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 01:06:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:07:00.257689 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968846b7-12fe-49fb-8f4e-09a92abd2674 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:07:00.259365 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-968846b7-12fe-49fb-8f4e-09a92abd2674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:07:00.365490 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968846b7-12fe-49fb-8f4e-09a92abd2674 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:07:00.377600 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:07:00.440320 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a492c9-e046-4a1a-adf5-de8f4286004e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16e6a0ca26fc4ef892c188ad89a1e132', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:07:00.440917 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a492c9-e046-4a1a-adf5-de8f4286004e service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:07:00.441193 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a492c9-e046-4a1a-adf5-de8f4286004e service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:07:00.441457 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a492c9-e046-4a1a-adf5-de8f4286004e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:07:00.443094 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-91a492c9-e046-4a1a-adf5-de8f4286004e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:07:00.551804 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a492c9-e046-4a1a-adf5-de8f4286004e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:07:00.553162 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a492c9-e046-4a1a-adf5-de8f4286004e service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:07:00.572434 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 732/1446] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:07:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:07:02.808808 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bacb60-7f39-405e-871c-85f4e4251fb9 None None] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:07:02.809378 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bacb60-7f39-405e-871c-85f4e4251fb9 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:07:02.809378 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bacb60-7f39-405e-871c-85f4e4251fb9 None None] PATH_INFO: `/` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:07:02.810690 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 715/1447] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 01:07:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:07:02.816843 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37d53cb-7d26-4fec-9d9b-894a1b4d0905 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:07:02.817336 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37d53cb-7d26-4fec-9d9b-894a1b4d0905 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:07:02.817440 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37d53cb-7d26-4fec-9d9b-894a1b4d0905 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:07:02.868650 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:07:02.889558 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-f37d53cb-7d26-4fec-9d9b-894a1b4d0905 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:07:02.890786 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-f37d53cb-7d26-4fec-9d9b-894a1b4d0905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:07:02.994302 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 733/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 01:07:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:07:03.281629 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bacb60-7f39-405e-871c-85f4e4251fb9 None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:07:03.283247 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-48bacb60-7f39-405e-871c-85f4e4251fb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:07:03.389196 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bacb60-7f39-405e-871c-85f4e4251fb9 None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:07:03.430792 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:07:03.469985 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8542abde-baa2-49f3-b70d-310e66af6442 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16e6a0ca26fc4ef892c188ad89a1e132', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:07:03.470742 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8542abde-baa2-49f3-b70d-310e66af6442 service neutron] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:07:03.471016 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8542abde-baa2-49f3-b70d-310e66af6442 service neutron] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:07:03.471306 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8542abde-baa2-49f3-b70d-310e66af6442 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:07:03.472915 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-8542abde-baa2-49f3-b70d-310e66af6442 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:07:03.596289 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8542abde-baa2-49f3-b70d-310e66af6442 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:07:03.597690 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8542abde-baa2-49f3-b70d-310e66af6442 service neutron] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:07:03.619954 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 716/1449] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:07:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:07:05.748809 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeea33e-a2a8-425a-a1b8-d00e97d2d17e None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:07:05.749434 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeea33e-a2a8-425a-a1b8-d00e97d2d17e None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:07:05.749434 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeea33e-a2a8-425a-a1b8-d00e97d2d17e None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:07:05.751274 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 734/1450] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 01:07:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 01:07:05.757409 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8759cd72-28b1-49a2-bdff-5b179fa1f73b None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:07:05.757977 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8759cd72-28b1-49a2-bdff-5b179fa1f73b None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:07:05.757977 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8759cd72-28b1-49a2-bdff-5b179fa1f73b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:07:05.843216 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-8759cd72-28b1-49a2-bdff-5b179fa1f73b None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:07:05.844655 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-8759cd72-28b1-49a2-bdff-5b179fa1f73b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:07:05.867577 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:07:05.955403 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 717/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 01:07:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:07:06.242269 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeea33e-a2a8-425a-a1b8-d00e97d2d17e None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:07:06.244084 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-afeea33e-a2a8-425a-a1b8-d00e97d2d17e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:07:06.363824 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeea33e-a2a8-425a-a1b8-d00e97d2d17e None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:07:06.388661 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:07:06.462424 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad27c01-a75e-4edb-acf3-aa0ef180db8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16e6a0ca26fc4ef892c188ad89a1e132', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:07:06.463052 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad27c01-a75e-4edb-acf3-aa0ef180db8f service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:07:06.463366 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad27c01-a75e-4edb-acf3-aa0ef180db8f service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:07:06.463640 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad27c01-a75e-4edb-acf3-aa0ef180db8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:07:06.465477 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-dad27c01-a75e-4edb-acf3-aa0ef180db8f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:07:06.590801 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad27c01-a75e-4edb-acf3-aa0ef180db8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:07:06.592445 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad27c01-a75e-4edb-acf3-aa0ef180db8f service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:07:06.612826 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 735/1452] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:07:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:07:08.663630 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2be8eb-8bbd-44d1-b313-20396698b61c None None] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:07:08.664169 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2be8eb-8bbd-44d1-b313-20396698b61c None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:07:08.664169 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2be8eb-8bbd-44d1-b313-20396698b61c None None] PATH_INFO: `/` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:07:08.665717 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 718/1453] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 01:07:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:07:08.671423 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f5ea6c-29ff-49d0-99a9-7c2dc6180695 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:07:08.671912 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f5ea6c-29ff-49d0-99a9-7c2dc6180695 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:07:08.672028 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f5ea6c-29ff-49d0-99a9-7c2dc6180695 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:07:08.747573 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:07:08.752530 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-80f5ea6c-29ff-49d0-99a9-7c2dc6180695 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:07:08.760566 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-80f5ea6c-29ff-49d0-99a9-7c2dc6180695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:07:08.876656 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 736/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 01:07:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:07:09.209244 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2be8eb-8bbd-44d1-b313-20396698b61c None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:07:09.210865 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-1c2be8eb-8bbd-44d1-b313-20396698b61c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:07:09.356151 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2be8eb-8bbd-44d1-b313-20396698b61c None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:07:09.412969 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:07:09.442144 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b501557-0575-41d1-ac6b-fc280c35bee5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16e6a0ca26fc4ef892c188ad89a1e132', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:07:09.442766 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b501557-0575-41d1-ac6b-fc280c35bee5 service neutron] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:07:09.443061 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b501557-0575-41d1-ac6b-fc280c35bee5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:07:09.443357 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b501557-0575-41d1-ac6b-fc280c35bee5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:07:09.445251 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-4b501557-0575-41d1-ac6b-fc280c35bee5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:07:09.591602 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b501557-0575-41d1-ac6b-fc280c35bee5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:07:09.593369 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b501557-0575-41d1-ac6b-fc280c35bee5 service neutron] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:07:09.617204 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 719/1455] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:07:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:07:11.968081 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5e8d33-cb3d-4dac-baf2-837269089ede None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:07:11.968822 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5e8d33-cb3d-4dac-baf2-837269089ede None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:07:11.968822 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5e8d33-cb3d-4dac-baf2-837269089ede None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:07:11.970836 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 737/1456] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 01:07:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:07:11.976825 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979cca3e-1037-4ae2-b31c-9d4ce1dd20c9 None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:07:11.977408 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979cca3e-1037-4ae2-b31c-9d4ce1dd20c9 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:07:11.977408 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979cca3e-1037-4ae2-b31c-9d4ce1dd20c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:07:12.060166 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-979cca3e-1037-4ae2-b31c-9d4ce1dd20c9 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:07:12.062271 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-979cca3e-1037-4ae2-b31c-9d4ce1dd20c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:07:12.104324 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:07:12.187953 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 720/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 01:07:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:07:12.486218 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5e8d33-cb3d-4dac-baf2-837269089ede None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:07:12.487780 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-7a5e8d33-cb3d-4dac-baf2-837269089ede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:07:12.627532 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5e8d33-cb3d-4dac-baf2-837269089ede None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:07:12.662401 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:07:12.717041 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dab766-2c27-4abe-8a2a-6f7fbac8023b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16e6a0ca26fc4ef892c188ad89a1e132', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:07:12.717720 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dab766-2c27-4abe-8a2a-6f7fbac8023b service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:07:12.718018 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dab766-2c27-4abe-8a2a-6f7fbac8023b service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:07:12.718310 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dab766-2c27-4abe-8a2a-6f7fbac8023b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:07:12.720837 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-f1dab766-2c27-4abe-8a2a-6f7fbac8023b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:07:12.858649 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dab766-2c27-4abe-8a2a-6f7fbac8023b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:07:12.860178 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dab766-2c27-4abe-8a2a-6f7fbac8023b service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:07:12.879950 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 738/1458] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:07:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 01:07:15.234311 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b26327a-136d-4c7f-810e-6f1bb02cca5b None None] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:07:15.235494 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b26327a-136d-4c7f-810e-6f1bb02cca5b None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:07:15.235679 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b26327a-136d-4c7f-810e-6f1bb02cca5b None None] PATH_INFO: `/` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:07:15.237069 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 721/1459] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 01:07:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:07:15.243910 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37b8251-7318-4d97-b41b-fa872428437e None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:07:15.244496 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37b8251-7318-4d97-b41b-fa872428437e None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:07:15.244731 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37b8251-7318-4d97-b41b-fa872428437e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:07:15.329816 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-b37b8251-7318-4d97-b41b-fa872428437e None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:07:15.331502 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-b37b8251-7318-4d97-b41b-fa872428437e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:07:15.352938 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:07:15.469905 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 739/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 01:07:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:07:15.786835 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b26327a-136d-4c7f-810e-6f1bb02cca5b None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:07:15.788490 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-8b26327a-136d-4c7f-810e-6f1bb02cca5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:07:15.915087 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b26327a-136d-4c7f-810e-6f1bb02cca5b None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:07:15.984102 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:07:16.011991 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7fefa1-b0ea-424e-9cb4-2cd92eaf5177 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16e6a0ca26fc4ef892c188ad89a1e132', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:07:16.012847 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7fefa1-b0ea-424e-9cb4-2cd92eaf5177 service neutron] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:07:16.013207 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7fefa1-b0ea-424e-9cb4-2cd92eaf5177 service neutron] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:07:16.013617 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7fefa1-b0ea-424e-9cb4-2cd92eaf5177 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:07:16.016615 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-cc7fefa1-b0ea-424e-9cb4-2cd92eaf5177 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:07:16.147683 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7fefa1-b0ea-424e-9cb4-2cd92eaf5177 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:07:16.149181 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7fefa1-b0ea-424e-9cb4-2cd92eaf5177 service neutron] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:07:16.168141 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 722/1461] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:07:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:07:18.176509 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0531a3-901a-4091-8170-e2c9d6cf4713 None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:07:18.177078 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0531a3-901a-4091-8170-e2c9d6cf4713 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:07:18.177078 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0531a3-901a-4091-8170-e2c9d6cf4713 None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:07:18.178426 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 740/1462] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 01:07:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:07:18.184585 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9dae7e-1dda-4df7-9aaf-69b5d1bb7f92 None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:07:18.185178 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9dae7e-1dda-4df7-9aaf-69b5d1bb7f92 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:07:18.185178 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9dae7e-1dda-4df7-9aaf-69b5d1bb7f92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:07:18.259773 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-3c9dae7e-1dda-4df7-9aaf-69b5d1bb7f92 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:07:18.261012 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-3c9dae7e-1dda-4df7-9aaf-69b5d1bb7f92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:07:18.301347 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:07:18.361170 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 723/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 01:07:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:07:18.670979 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0531a3-901a-4091-8170-e2c9d6cf4713 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:07:18.673024 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-8c0531a3-901a-4091-8170-e2c9d6cf4713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:07:18.781177 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0531a3-901a-4091-8170-e2c9d6cf4713 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:07:18.821782 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:07:18.858082 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842a9797-aa76-4443-a1b0-9b095b9b5329 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16e6a0ca26fc4ef892c188ad89a1e132', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:07:18.858689 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842a9797-aa76-4443-a1b0-9b095b9b5329 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:07:18.858960 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842a9797-aa76-4443-a1b0-9b095b9b5329 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:07:18.859258 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842a9797-aa76-4443-a1b0-9b095b9b5329 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:07:18.861364 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-842a9797-aa76-4443-a1b0-9b095b9b5329 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:07:18.995671 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842a9797-aa76-4443-a1b0-9b095b9b5329 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:07:18.997110 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842a9797-aa76-4443-a1b0-9b095b9b5329 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:07:19.021038 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 741/1464] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:07:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:07:21.080859 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2dc59c-ead0-445a-8836-3a377c15aef7 None None] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:07:21.081444 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2dc59c-ead0-445a-8836-3a377c15aef7 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:07:21.081444 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2dc59c-ead0-445a-8836-3a377c15aef7 None None] PATH_INFO: `/` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:07:21.082747 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 724/1465] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 01:07:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:07:21.088326 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec9a840-b891-49a0-ac8e-18a9a67df468 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:07:21.088838 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec9a840-b891-49a0-ac8e-18a9a67df468 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:07:21.088967 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec9a840-b891-49a0-ac8e-18a9a67df468 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:07:21.157033 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-bec9a840-b891-49a0-ac8e-18a9a67df468 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:07:21.158490 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-bec9a840-b891-49a0-ac8e-18a9a67df468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:07:21.177213 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:07:21.259639 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 742/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 01:07:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:07:21.540857 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2dc59c-ead0-445a-8836-3a377c15aef7 None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:07:21.542397 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-5f2dc59c-ead0-445a-8836-3a377c15aef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:07:21.651782 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2dc59c-ead0-445a-8836-3a377c15aef7 None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:07:21.721421 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:07:21.729460 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b079675-8c5a-4da3-b930-2a905e60c66b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16e6a0ca26fc4ef892c188ad89a1e132', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:07:21.730070 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b079675-8c5a-4da3-b930-2a905e60c66b service neutron] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:07:21.730342 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b079675-8c5a-4da3-b930-2a905e60c66b service neutron] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:07:21.730604 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b079675-8c5a-4da3-b930-2a905e60c66b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:07:21.732331 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-3b079675-8c5a-4da3-b930-2a905e60c66b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:07:21.844781 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b079675-8c5a-4da3-b930-2a905e60c66b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:07:21.846365 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b079675-8c5a-4da3-b930-2a905e60c66b service neutron] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:07:21.864260 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 725/1467] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:07:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:07:23.821049 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e48dd79-7fb2-4111-b082-17178a3f308b None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:07:23.821641 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e48dd79-7fb2-4111-b082-17178a3f308b None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:07:23.821641 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e48dd79-7fb2-4111-b082-17178a3f308b None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:07:23.822997 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 743/1468] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 01:07:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:07:23.829478 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de7f9a6-0e71-442c-bb44-a4c296308778 None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:07:23.830047 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de7f9a6-0e71-442c-bb44-a4c296308778 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:07:23.830047 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de7f9a6-0e71-442c-bb44-a4c296308778 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:07:23.897962 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-3de7f9a6-0e71-442c-bb44-a4c296308778 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:07:23.899200 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-3de7f9a6-0e71-442c-bb44-a4c296308778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:07:23.948678 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:07:24.002876 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 726/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 01:07:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:07:24.303523 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e48dd79-7fb2-4111-b082-17178a3f308b None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:07:24.305137 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-1e48dd79-7fb2-4111-b082-17178a3f308b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:07:24.421025 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e48dd79-7fb2-4111-b082-17178a3f308b None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:07:24.474010 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:07:24.512417 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3251f801-9433-4387-adca-18641c42bd72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16e6a0ca26fc4ef892c188ad89a1e132', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:07:24.512935 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3251f801-9433-4387-adca-18641c42bd72 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:07:24.513208 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3251f801-9433-4387-adca-18641c42bd72 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:07:24.513470 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3251f801-9433-4387-adca-18641c42bd72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:07:24.515105 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-3251f801-9433-4387-adca-18641c42bd72 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:07:24.633974 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3251f801-9433-4387-adca-18641c42bd72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:07:24.637527 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3251f801-9433-4387-adca-18641c42bd72 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:07:24.655643 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 744/1470] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:07:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:07:34.000752 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=22 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:07:34.653326 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=66 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:07:44.787392 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31963cba-4861-43ff-af3f-41304b5ce5e6 None None] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:07:44.787940 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31963cba-4861-43ff-af3f-41304b5ce5e6 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:07:44.787940 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31963cba-4861-43ff-af3f-41304b5ce5e6 None None] PATH_INFO: `/` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:07:44.789279 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 727/1471] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 01:07:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:07:44.794923 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd20919-667e-44b4-8969-921a8f08d784 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:07:44.795378 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd20919-667e-44b4-8969-921a8f08d784 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:07:44.795584 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd20919-667e-44b4-8969-921a8f08d784 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:07:44.865173 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-9dd20919-667e-44b4-8969-921a8f08d784 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:07:44.866385 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-9dd20919-667e-44b4-8969-921a8f08d784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:07:44.964118 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 745/1472] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 01:07:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:07:45.276894 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f16836-3dd9-4c68-8695-8e71243a54d1 None None] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:07:45.277178 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f16836-3dd9-4c68-8695-8e71243a54d1 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:07:45.277446 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f16836-3dd9-4c68-8695-8e71243a54d1 None None] PATH_INFO: `/` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:07:45.278833 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 728/1473] 10.222.0.79 () {54 vars in 967 bytes} [Tue Aug 30 01:07:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:07:45.284225 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d9824c-e065-45c1-bda9-2301e458dfa7 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:07:45.284225 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d9824c-e065-45c1-bda9-2301e458dfa7 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:07:45.284588 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d9824c-e065-45c1-bda9-2301e458dfa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:07:45.364203 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-c9d9824c-e065-45c1-bda9-2301e458dfa7 None None] MFA Rules not processed for user `5e37a5c33c064c488fd4667170f7703a`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:07:45.365408 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-c9d9824c-e065-45c1-bda9-2301e458dfa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:07:45.386268 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:07:45.453602 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 746/1474] 10.222.0.79 () {58 vars in 1064 bytes} [Tue Aug 30 01:07:45 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:07:45.461043 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f16836-3dd9-4c68-8695-8e71243a54d1 None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:07:45.462539 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-a8f16836-3dd9-4c68-8695-8e71243a54d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:07:45.569895 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f16836-3dd9-4c68-8695-8e71243a54d1 None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:07:45.648364 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48d8515-2f4e-4a0a-bda5-94567de7c310 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e37a5c33c064c488fd4667170f7703a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:07:45.648965 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48d8515-2f4e-4a0a-bda5-94567de7c310 service glance] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:07:45.649239 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48d8515-2f4e-4a0a-bda5-94567de7c310 service glance] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:07:45.649505 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48d8515-2f4e-4a0a-bda5-94567de7c310 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:07:45.651098 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-e48d8515-2f4e-4a0a-bda5-94567de7c310 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:07:45.708775 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:07:45.766752 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48d8515-2f4e-4a0a-bda5-94567de7c310 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:07:45.768214 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48d8515-2f4e-4a0a-bda5-94567de7c310 service glance] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:07:45.787642 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 729/1475] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:07:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:07:47.827522 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2611fc-7419-4d67-85ea-e43036c200e2 None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:07:47.828354 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2611fc-7419-4d67-85ea-e43036c200e2 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:07:47.828354 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2611fc-7419-4d67-85ea-e43036c200e2 None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:07:47.829556 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 747/1476] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 01:07:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:07:47.835097 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9428e6b-405f-478d-9580-f670d22ebdb6 None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:07:47.835619 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9428e6b-405f-478d-9580-f670d22ebdb6 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:07:47.835730 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9428e6b-405f-478d-9580-f670d22ebdb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:07:47.904612 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-e9428e6b-405f-478d-9580-f670d22ebdb6 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:07:47.906357 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-e9428e6b-405f-478d-9580-f670d22ebdb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:07:48.003993 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 730/1477] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 01:07:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:07:48.277815 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2611fc-7419-4d67-85ea-e43036c200e2 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:07:48.279430 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-7d2611fc-7419-4d67-85ea-e43036c200e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:07:48.404633 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2611fc-7419-4d67-85ea-e43036c200e2 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:07:48.455360 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:07:48.504363 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cb31c7-f619-446e-bd4d-e6013161b5df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:07:48.504879 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cb31c7-f619-446e-bd4d-e6013161b5df admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:07:48.505152 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cb31c7-f619-446e-bd4d-e6013161b5df admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:07:48.505417 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cb31c7-f619-446e-bd4d-e6013161b5df admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:07:48.506044 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cb31c7-f619-446e-bd4d-e6013161b5df admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:07:48.507792 dv-cinder-819667-6-smb devstack@keystone.service[81999]: WARNING py.warnings [None req-f5cb31c7-f619-446e-bd4d-e6013161b5df admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 01:07:48.507792 dv-cinder-819667-6-smb devstack@keystone.service[81999]: warnings.warn(msg) Aug 30 01:07:48.507792 dv-cinder-819667-6-smb devstack@keystone.service[81999]: Aug 30 01:07:48.508922 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cb31c7-f619-446e-bd4d-e6013161b5df admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:07:48.528486 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 748/1478] 10.222.0.79 () {56 vars in 1108 bytes} [Tue Aug 30 01:07:48 2022] GET /identity/v3/projects => generated 2553 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:07:50.484567 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a1f519-49a8-48ca-bcd1-60424144d2a4 None None] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:07:50.485132 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a1f519-49a8-48ca-bcd1-60424144d2a4 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:07:50.485132 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a1f519-49a8-48ca-bcd1-60424144d2a4 None None] PATH_INFO: `/` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:07:50.486439 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 731/1479] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 01:07:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:07:50.491877 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731caf1d-9f19-459e-b80e-1fd2413701cf None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:07:50.492336 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731caf1d-9f19-459e-b80e-1fd2413701cf None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:07:50.492336 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731caf1d-9f19-459e-b80e-1fd2413701cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:07:50.560053 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-731caf1d-9f19-459e-b80e-1fd2413701cf None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:07:50.561512 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-731caf1d-9f19-459e-b80e-1fd2413701cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:07:50.682271 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 749/1480] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 01:07:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:07:51.009749 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a1f519-49a8-48ca-bcd1-60424144d2a4 None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:07:51.011454 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-a7a1f519-49a8-48ca-bcd1-60424144d2a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:07:51.024812 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:07:51.188660 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a1f519-49a8-48ca-bcd1-60424144d2a4 None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:07:51.278919 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:07:51.317357 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573786eb-312e-47a7-8c49-576bca535eed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6480b2f14c37474c89df9fba48f7cd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:07:51.318326 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573786eb-312e-47a7-8c49-576bca535eed service nova] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:07:51.319049 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573786eb-312e-47a7-8c49-576bca535eed service nova] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:07:51.319537 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573786eb-312e-47a7-8c49-576bca535eed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:07:51.322363 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-573786eb-312e-47a7-8c49-576bca535eed service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:07:51.419095 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573786eb-312e-47a7-8c49-576bca535eed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:07:51.420722 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573786eb-312e-47a7-8c49-576bca535eed service nova] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:07:51.449299 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 732/1481] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:07:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:07:53.627333 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f55d408-4819-4636-9dd8-40baf366cadf None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:07:53.627874 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f55d408-4819-4636-9dd8-40baf366cadf None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:07:53.628095 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f55d408-4819-4636-9dd8-40baf366cadf None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:07:53.630127 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 750/1482] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 01:07:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:07:53.635938 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee49588-4ca7-4b79-90a2-7c68476fd079 None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:07:53.636479 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee49588-4ca7-4b79-90a2-7c68476fd079 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:07:53.636479 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee49588-4ca7-4b79-90a2-7c68476fd079 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:07:53.725722 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-eee49588-4ca7-4b79-90a2-7c68476fd079 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:07:53.726914 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-eee49588-4ca7-4b79-90a2-7c68476fd079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:07:53.773750 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:07:53.824994 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 733/1483] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 01:07:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:07:54.116410 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f55d408-4819-4636-9dd8-40baf366cadf None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:07:54.117923 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-2f55d408-4819-4636-9dd8-40baf366cadf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:07:54.142576 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:07:54.222559 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f55d408-4819-4636-9dd8-40baf366cadf None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:07:54.295883 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575d44b9-014d-492d-a5e9-d4437190638a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16e6a0ca26fc4ef892c188ad89a1e132', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:07:54.297010 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575d44b9-014d-492d-a5e9-d4437190638a service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:07:54.297267 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575d44b9-014d-492d-a5e9-d4437190638a service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:07:54.297528 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575d44b9-014d-492d-a5e9-d4437190638a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:07:54.299109 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-575d44b9-014d-492d-a5e9-d4437190638a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:07:54.378780 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:07:54.415784 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575d44b9-014d-492d-a5e9-d4437190638a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:07:54.417208 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575d44b9-014d-492d-a5e9-d4437190638a service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:07:54.438211 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 751/1484] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:07:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:07:56.424686 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d094d0-a88b-405a-9dd2-2062bb1e6b60 None None] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:07:56.425252 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d094d0-a88b-405a-9dd2-2062bb1e6b60 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:07:56.425252 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d094d0-a88b-405a-9dd2-2062bb1e6b60 None None] PATH_INFO: `/` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:07:56.426552 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 734/1485] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 01:07:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:07:56.431940 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef1efa4-eaea-4f83-b39d-252b4f9a4cd3 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:07:56.432355 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef1efa4-eaea-4f83-b39d-252b4f9a4cd3 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:07:56.432577 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef1efa4-eaea-4f83-b39d-252b4f9a4cd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:07:56.503063 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-cef1efa4-eaea-4f83-b39d-252b4f9a4cd3 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:07:56.504289 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-cef1efa4-eaea-4f83-b39d-252b4f9a4cd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:07:56.612359 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 752/1486] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 01:07:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:07:56.907817 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d094d0-a88b-405a-9dd2-2062bb1e6b60 None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:07:56.909379 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-36d094d0-a88b-405a-9dd2-2062bb1e6b60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:07:57.149368 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d094d0-a88b-405a-9dd2-2062bb1e6b60 None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:07:57.242936 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:07:57.244884 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413aeac3-1714-4e49-91d6-71cbc516892a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16e6a0ca26fc4ef892c188ad89a1e132', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:07:57.245507 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413aeac3-1714-4e49-91d6-71cbc516892a service neutron] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:07:57.246265 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413aeac3-1714-4e49-91d6-71cbc516892a service neutron] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:07:57.246731 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413aeac3-1714-4e49-91d6-71cbc516892a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:07:57.248561 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-413aeac3-1714-4e49-91d6-71cbc516892a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:07:57.363753 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413aeac3-1714-4e49-91d6-71cbc516892a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:07:57.365176 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413aeac3-1714-4e49-91d6-71cbc516892a service neutron] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:07:57.383694 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 735/1487] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:07:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:07:59.512455 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d91659b-29b7-48ab-bcc3-4f3ca1c6ac02 None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:07:59.513012 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d91659b-29b7-48ab-bcc3-4f3ca1c6ac02 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:07:59.513012 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d91659b-29b7-48ab-bcc3-4f3ca1c6ac02 None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:07:59.514267 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 753/1488] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 01:07:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:07:59.520267 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348a0639-a22f-4561-b45a-aa834506e692 None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:07:59.520727 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348a0639-a22f-4561-b45a-aa834506e692 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:07:59.520823 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348a0639-a22f-4561-b45a-aa834506e692 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:07:59.588348 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-348a0639-a22f-4561-b45a-aa834506e692 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:07:59.589576 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-348a0639-a22f-4561-b45a-aa834506e692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:07:59.645943 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:07:59.691289 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 736/1489] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 01:07:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:07:59.986330 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d91659b-29b7-48ab-bcc3-4f3ca1c6ac02 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:07:59.987910 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-1d91659b-29b7-48ab-bcc3-4f3ca1c6ac02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:08:00.024694 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:08:00.099909 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d91659b-29b7-48ab-bcc3-4f3ca1c6ac02 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:08:00.181105 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362d7b59-b47f-4a1c-9385-d3ec17a67b70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16e6a0ca26fc4ef892c188ad89a1e132', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:08:00.181712 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362d7b59-b47f-4a1c-9385-d3ec17a67b70 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:08:00.181995 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362d7b59-b47f-4a1c-9385-d3ec17a67b70 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:08:00.182267 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362d7b59-b47f-4a1c-9385-d3ec17a67b70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:08:00.183918 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-362d7b59-b47f-4a1c-9385-d3ec17a67b70 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:08:00.277878 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:08:00.312186 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362d7b59-b47f-4a1c-9385-d3ec17a67b70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:08:00.313849 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362d7b59-b47f-4a1c-9385-d3ec17a67b70 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:08:00.335321 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 754/1490] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:07:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:08:02.549730 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc06acae-1bca-4f5c-a034-396b1e2e8979 None None] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:08:02.550314 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc06acae-1bca-4f5c-a034-396b1e2e8979 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:08:02.550314 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc06acae-1bca-4f5c-a034-396b1e2e8979 None None] PATH_INFO: `/` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:08:02.551985 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 737/1491] 10.222.0.79 () {54 vars in 927 bytes} [Tue Aug 30 01:08:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:08:02.558664 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fe174e-ef93-47a4-b4c6-da2ed3197848 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:08:02.559294 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fe174e-ef93-47a4-b4c6-da2ed3197848 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:08:02.559294 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fe174e-ef93-47a4-b4c6-da2ed3197848 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:08:02.644720 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-04fe174e-ef93-47a4-b4c6-da2ed3197848 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:08:02.645993 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-04fe174e-ef93-47a4-b4c6-da2ed3197848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:08:02.754071 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 755/1492] 10.222.0.79 () {58 vars in 1024 bytes} [Tue Aug 30 01:08:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:08:03.090408 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc06acae-1bca-4f5c-a034-396b1e2e8979 None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:08:03.092183 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-fc06acae-1bca-4f5c-a034-396b1e2e8979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:08:03.216754 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc06acae-1bca-4f5c-a034-396b1e2e8979 None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:08:03.298370 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d422eedd-cae0-4c09-ab5a-ee9c50fa9db7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16e6a0ca26fc4ef892c188ad89a1e132', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:08:03.299029 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d422eedd-cae0-4c09-ab5a-ee9c50fa9db7 service neutron] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:08:03.299370 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d422eedd-cae0-4c09-ab5a-ee9c50fa9db7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:08:03.299676 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d422eedd-cae0-4c09-ab5a-ee9c50fa9db7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:08:03.301375 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-d422eedd-cae0-4c09-ab5a-ee9c50fa9db7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:08:03.312750 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:08:03.426775 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d422eedd-cae0-4c09-ab5a-ee9c50fa9db7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:08:03.428456 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d422eedd-cae0-4c09-ab5a-ee9c50fa9db7 service neutron] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:08:03.447924 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 738/1493] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:08:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:08:12.752043 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=82 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:08:13.445585 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=50 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:09:20.039922 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17ee4d0-6ec8-4da1-9f5a-966d0ec54bd0 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:09:20.040528 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17ee4d0-6ec8-4da1-9f5a-966d0ec54bd0 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:09:20.040528 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17ee4d0-6ec8-4da1-9f5a-966d0ec54bd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:09:20.122570 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-a17ee4d0-6ec8-4da1-9f5a-966d0ec54bd0 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:09:20.123747 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-a17ee4d0-6ec8-4da1-9f5a-966d0ec54bd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:09:20.231496 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 756/1494] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:09:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:09:20.240066 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c43357-2f1f-43a3-b756-59fea23b0b92 None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:09:20.240563 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c43357-2f1f-43a3-b756-59fea23b0b92 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:09:20.240676 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c43357-2f1f-43a3-b756-59fea23b0b92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:09:20.323878 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-f3c43357-2f1f-43a3-b756-59fea23b0b92 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:09:20.325107 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-f3c43357-2f1f-43a3-b756-59fea23b0b92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:09:20.424517 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 739/1495] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:09:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:09:20.429200 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17ee4d0-6ec8-4da1-9f5a-966d0ec54bd0 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:09:20.430421 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-a17ee4d0-6ec8-4da1-9f5a-966d0ec54bd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:09:20.442270 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17ee4d0-6ec8-4da1-9f5a-966d0ec54bd0 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:09:20.506867 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:09:20.542143 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6468dbf2-2ba7-45e6-bbf5-55fa44ad6e0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:09:20.542740 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6468dbf2-2ba7-45e6-bbf5-55fa44ad6e0f admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:09:20.543016 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6468dbf2-2ba7-45e6-bbf5-55fa44ad6e0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:09:20.544077 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6468dbf2-2ba7-45e6-bbf5-55fa44ad6e0f admin admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:09:20.544737 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6468dbf2-2ba7-45e6-bbf5-55fa44ad6e0f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:09:20.545033 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6468dbf2-2ba7-45e6-bbf5-55fa44ad6e0f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:09:20.546053 dv-cinder-819667-6-smb devstack@keystone.service[81999]: WARNING py.warnings [None req-6468dbf2-2ba7-45e6-bbf5-55fa44ad6e0f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 01:09:20.546053 dv-cinder-819667-6-smb devstack@keystone.service[81999]: warnings.warn(msg) Aug 30 01:09:20.546053 dv-cinder-819667-6-smb devstack@keystone.service[81999]: Aug 30 01:09:20.546937 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6468dbf2-2ba7-45e6-bbf5-55fa44ad6e0f admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:09:20.559224 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 757/1496] 10.222.0.79 () {58 vars in 1153 bytes} [Tue Aug 30 01:09:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:09:20.568244 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c43357-2f1f-43a3-b756-59fea23b0b92 None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:09:20.579593 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c43357-2f1f-43a3-b756-59fea23b0b92 None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:09:20.648700 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:09:20.685606 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42c2507-44a7-46a4-a370-f956b0385024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:09:20.686127 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42c2507-44a7-46a4-a370-f956b0385024 admin admin] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:09:20.686402 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42c2507-44a7-46a4-a370-f956b0385024 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:09:20.686671 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42c2507-44a7-46a4-a370-f956b0385024 admin admin] PATH_INFO: `/v3/projects` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:09:20.687335 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42c2507-44a7-46a4-a370-f956b0385024 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:09:20.689094 dv-cinder-819667-6-smb devstack@keystone.service[81998]: WARNING py.warnings [None req-d42c2507-44a7-46a4-a370-f956b0385024 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 01:09:20.689094 dv-cinder-819667-6-smb devstack@keystone.service[81998]: warnings.warn(msg) Aug 30 01:09:20.689094 dv-cinder-819667-6-smb devstack@keystone.service[81998]: Aug 30 01:09:20.690284 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42c2507-44a7-46a4-a370-f956b0385024 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:09:20.752611 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 740/1497] 10.222.0.79 () {60 vars in 1153 bytes} [Tue Aug 30 01:09:20 2022] POST /identity/v3/projects => generated 377 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:09:20.757199 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6468dbf2-2ba7-45e6-bbf5-55fa44ad6e0f admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:09:20.758725 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-6468dbf2-2ba7-45e6-bbf5-55fa44ad6e0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:09:20.811019 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6468dbf2-2ba7-45e6-bbf5-55fa44ad6e0f admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:09:20.914214 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf4143b-7134-4215-a2d9-cf72a6f3e668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:09:20.914972 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf4143b-7134-4215-a2d9-cf72a6f3e668 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:09:20.915389 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf4143b-7134-4215-a2d9-cf72a6f3e668 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:09:20.915744 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf4143b-7134-4215-a2d9-cf72a6f3e668 admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:09:20.916463 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf4143b-7134-4215-a2d9-cf72a6f3e668 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:09:20.917811 dv-cinder-819667-6-smb devstack@keystone.service[81999]: WARNING py.warnings [None req-bdf4143b-7134-4215-a2d9-cf72a6f3e668 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 01:09:20.917811 dv-cinder-819667-6-smb devstack@keystone.service[81999]: warnings.warn(msg) Aug 30 01:09:20.917811 dv-cinder-819667-6-smb devstack@keystone.service[81999]: Aug 30 01:09:20.919861 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf4143b-7134-4215-a2d9-cf72a6f3e668 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:09:20.964090 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 758/1498] 10.222.0.79 () {60 vars in 1144 bytes} [Tue Aug 30 01:09:20 2022] POST /identity/v3/users => generated 289 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:09:20.968665 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42c2507-44a7-46a4-a370-f956b0385024 admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:09:20.970173 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-d42c2507-44a7-46a4-a370-f956b0385024 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:09:21.036807 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42c2507-44a7-46a4-a370-f956b0385024 admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:09:21.127458 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:09:21.140449 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b198ed-7208-408a-a762-bd2afe813d74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:09:21.141204 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b198ed-7208-408a-a762-bd2afe813d74 admin admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:09:21.141579 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b198ed-7208-408a-a762-bd2afe813d74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:09:21.141945 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b198ed-7208-408a-a762-bd2afe813d74 admin admin] PATH_INFO: `/v3/roles` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:09:21.142695 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b198ed-7208-408a-a762-bd2afe813d74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:09:21.143863 dv-cinder-819667-6-smb devstack@keystone.service[81998]: WARNING py.warnings [None req-50b198ed-7208-408a-a762-bd2afe813d74 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 01:09:21.143863 dv-cinder-819667-6-smb devstack@keystone.service[81998]: warnings.warn(msg) Aug 30 01:09:21.143863 dv-cinder-819667-6-smb devstack@keystone.service[81998]: Aug 30 01:09:21.144997 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b198ed-7208-408a-a762-bd2afe813d74 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:09:21.166687 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 741/1499] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:09:20 2022] GET /identity/v3/roles => generated 1420 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 01:09:21.172283 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf4143b-7134-4215-a2d9-cf72a6f3e668 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:09:21.174367 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-bdf4143b-7134-4215-a2d9-cf72a6f3e668 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:09:21.186314 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf4143b-7134-4215-a2d9-cf72a6f3e668 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:09:21.214547 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:09:21.292682 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500af6b7-31e8-4000-820a-559cee967896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:09:21.294123 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500af6b7-31e8-4000-820a-559cee967896 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:09:21.294274 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500af6b7-31e8-4000-820a-559cee967896 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:09:21.294446 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500af6b7-31e8-4000-820a-559cee967896 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:09:21.295096 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500af6b7-31e8-4000-820a-559cee967896 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:09:21.296143 dv-cinder-819667-6-smb devstack@keystone.service[81999]: WARNING py.warnings [None req-500af6b7-31e8-4000-820a-559cee967896 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 01:09:21.296143 dv-cinder-819667-6-smb devstack@keystone.service[81999]: warnings.warn(msg) Aug 30 01:09:21.296143 dv-cinder-819667-6-smb devstack@keystone.service[81999]: Aug 30 01:09:21.297129 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500af6b7-31e8-4000-820a-559cee967896 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:09:21.309953 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 759/1500] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:09:21 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:09:21.314581 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b198ed-7208-408a-a762-bd2afe813d74 admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:09:21.316177 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-50b198ed-7208-408a-a762-bd2afe813d74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:09:21.351826 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b198ed-7208-408a-a762-bd2afe813d74 admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:09:21.451931 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e38cc7-dc86-44d2-a083-3975ad1d71c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:09:21.452596 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e38cc7-dc86-44d2-a083-3975ad1d71c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:09:21.452867 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e38cc7-dc86-44d2-a083-3975ad1d71c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:09:21.453156 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e38cc7-dc86-44d2-a083-3975ad1d71c3 admin admin] PATH_INFO: `/v3/projects/9e4a2b609ac349e8aad4e0a26cf862e1/users/ddff90e36ef042e4962a79434224b900/roles/c37945a17623465f899d4f217e7af593` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:09:21.477052 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e38cc7-dc86-44d2-a083-3975ad1d71c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e4a2b609ac349e8aad4e0a26cf862e1, user_id=ddff90e36ef042e4962a79434224b900, role_id=c37945a17623465f899d4f217e7af593)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:09:21.478008 dv-cinder-819667-6-smb devstack@keystone.service[81998]: WARNING py.warnings [None req-79e38cc7-dc86-44d2-a083-3975ad1d71c3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 01:09:21.478008 dv-cinder-819667-6-smb devstack@keystone.service[81998]: warnings.warn(msg) Aug 30 01:09:21.478008 dv-cinder-819667-6-smb devstack@keystone.service[81998]: Aug 30 01:09:21.480002 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e38cc7-dc86-44d2-a083-3975ad1d71c3 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:09:21.507924 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 742/1501] 10.222.0.79 () {60 vars in 1483 bytes} [Tue Aug 30 01:09:21 2022] PUT /identity/v3/projects/9e4a2b609ac349e8aad4e0a26cf862e1/users/ddff90e36ef042e4962a79434224b900/roles/c37945a17623465f899d4f217e7af593 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:09:21.521308 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5df15a-9fff-421e-a255-c8f7e77d5e97 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:09:21.521797 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5df15a-9fff-421e-a255-c8f7e77d5e97 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:09:21.522218 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5df15a-9fff-421e-a255-c8f7e77d5e97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:09:21.593590 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-9d5df15a-9fff-421e-a255-c8f7e77d5e97 None None] MFA Rules not processed for user `ddff90e36ef042e4962a79434224b900`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:09:21.594858 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-9d5df15a-9fff-421e-a255-c8f7e77d5e97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:09:21.679559 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 760/1502] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:09:21 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:09:21.695156 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29c7503-1b57-4bec-96e4-eeae0024d83b None None] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:09:21.695500 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29c7503-1b57-4bec-96e4-eeae0024d83b None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:09:21.695807 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29c7503-1b57-4bec-96e4-eeae0024d83b None None] PATH_INFO: `/` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:09:21.697212 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 743/1503] 10.222.0.79 () {54 vars in 964 bytes} [Tue Aug 30 01:09:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:09:21.704059 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fa98b9-9c0f-4e15-99bf-a9e114deb47e None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:09:21.704348 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fa98b9-9c0f-4e15-99bf-a9e114deb47e None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:09:21.704627 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fa98b9-9c0f-4e15-99bf-a9e114deb47e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:09:21.740412 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:09:21.813559 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-20fa98b9-9c0f-4e15-99bf-a9e114deb47e None None] MFA Rules not processed for user `7f827c7670b74d938ffe066ced88d1c2`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:09:21.815750 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-20fa98b9-9c0f-4e15-99bf-a9e114deb47e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:09:21.908313 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 761/1504] 10.222.0.79 () {58 vars in 1061 bytes} [Tue Aug 30 01:09:21 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:09:21.916484 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29c7503-1b57-4bec-96e4-eeae0024d83b None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:09:21.918024 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-a29c7503-1b57-4bec-96e4-eeae0024d83b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:09:21.973838 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:09:22.034714 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29c7503-1b57-4bec-96e4-eeae0024d83b None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:09:22.121756 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8e32ac-7151-48e6-8af8-a34ae8632c8a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f827c7670b74d938ffe066ced88d1c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:09:22.122893 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8e32ac-7151-48e6-8af8-a34ae8632c8a service cinder] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:09:22.123193 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8e32ac-7151-48e6-8af8-a34ae8632c8a service cinder] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:09:22.123463 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8e32ac-7151-48e6-8af8-a34ae8632c8a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:09:22.125065 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-be8e32ac-7151-48e6-8af8-a34ae8632c8a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:09:22.233006 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8e32ac-7151-48e6-8af8-a34ae8632c8a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:09:22.234433 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8e32ac-7151-48e6-8af8-a34ae8632c8a service cinder] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:09:22.238506 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:09:22.258429 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 744/1505] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:09:21 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 01:09:22.311294 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03999814-9e4f-4918-bb98-9e953018e5a6 None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:09:22.311816 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03999814-9e4f-4918-bb98-9e953018e5a6 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:09:22.311988 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03999814-9e4f-4918-bb98-9e953018e5a6 None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:09:22.313372 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 762/1506] 10.222.0.79 () {52 vars in 830 bytes} [Tue Aug 30 01:09:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 01:09:22.317555 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8e32ac-7151-48e6-8af8-a34ae8632c8a service cinder] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:09:22.319088 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-be8e32ac-7151-48e6-8af8-a34ae8632c8a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:09:22.436468 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8e32ac-7151-48e6-8af8-a34ae8632c8a service cinder] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:09:22.544809 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff67dcd1-554d-4072-8ce9-2dc964b7a148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:09:22.545359 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff67dcd1-554d-4072-8ce9-2dc964b7a148 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:09:22.545634 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff67dcd1-554d-4072-8ce9-2dc964b7a148 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:09:22.545905 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff67dcd1-554d-4072-8ce9-2dc964b7a148 admin admin] PATH_INFO: `/v3/users/ddff90e36ef042e4962a79434224b900` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:09:22.566478 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff67dcd1-554d-4072-8ce9-2dc964b7a148 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ddff90e36ef042e4962a79434224b900)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:09:22.567574 dv-cinder-819667-6-smb devstack@keystone.service[81998]: WARNING py.warnings [None req-ff67dcd1-554d-4072-8ce9-2dc964b7a148 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 01:09:22.567574 dv-cinder-819667-6-smb devstack@keystone.service[81998]: warnings.warn(msg) Aug 30 01:09:22.567574 dv-cinder-819667-6-smb devstack@keystone.service[81998]: Aug 30 01:09:22.569062 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff67dcd1-554d-4072-8ce9-2dc964b7a148 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:09:22.582066 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:09:22.648834 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-ff67dcd1-554d-4072-8ce9-2dc964b7a148 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ddff90e36ef042e4962a79434224b900'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:09:22.664901 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-ff67dcd1-554d-4072-8ce9-2dc964b7a148 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ddff90e36ef042e4962a79434224b900'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:09:22.693347 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-ff67dcd1-554d-4072-8ce9-2dc964b7a148 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ddff90e36ef042e4962a79434224b900'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:09:22.694180 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-ff67dcd1-554d-4072-8ce9-2dc964b7a148 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ddff90e36ef042e4962a79434224b900'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:09:22.708753 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-ff67dcd1-554d-4072-8ce9-2dc964b7a148 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ddff90e36ef042e4962a79434224b900'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:09:22.715855 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 745/1507] 10.222.0.79 () {58 vars in 1224 bytes} [Tue Aug 30 01:09:22 2022] DELETE /identity/v3/users/ddff90e36ef042e4962a79434224b900 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:09:22.721384 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47a66b6-a91a-4cf4-b14a-02ac3b66e6e5 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:09:22.721861 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47a66b6-a91a-4cf4-b14a-02ac3b66e6e5 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:09:22.722317 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47a66b6-a91a-4cf4-b14a-02ac3b66e6e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:09:22.785522 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-f47a66b6-a91a-4cf4-b14a-02ac3b66e6e5 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:09:22.786756 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-f47a66b6-a91a-4cf4-b14a-02ac3b66e6e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:09:22.879713 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:09:22.895626 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 763/1508] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:09:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:09:22.907025 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff67dcd1-554d-4072-8ce9-2dc964b7a148 admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:09:22.908452 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-ff67dcd1-554d-4072-8ce9-2dc964b7a148 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:09:23.019094 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff67dcd1-554d-4072-8ce9-2dc964b7a148 admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:09:23.080579 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:09:23.103190 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0c8eb2-2409-4df2-a6d6-bcbffe7fbb79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16e6a0ca26fc4ef892c188ad89a1e132', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:09:23.103815 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0c8eb2-2409-4df2-a6d6-bcbffe7fbb79 service neutron] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:09:23.104091 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0c8eb2-2409-4df2-a6d6-bcbffe7fbb79 service neutron] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:09:23.104361 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0c8eb2-2409-4df2-a6d6-bcbffe7fbb79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:09:23.106554 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-bf0c8eb2-2409-4df2-a6d6-bcbffe7fbb79 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:09:23.220151 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0c8eb2-2409-4df2-a6d6-bcbffe7fbb79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:09:23.221536 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0c8eb2-2409-4df2-a6d6-bcbffe7fbb79 service neutron] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:09:23.243720 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 746/1509] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:09:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 01:09:23.604049 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47a66b6-a91a-4cf4-b14a-02ac3b66e6e5 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:09:23.605278 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-f47a66b6-a91a-4cf4-b14a-02ac3b66e6e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:09:23.618715 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47a66b6-a91a-4cf4-b14a-02ac3b66e6e5 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:09:23.722467 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce7de11-d351-4c51-9c62-c95b1b9b5fb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:09:23.723012 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce7de11-d351-4c51-9c62-c95b1b9b5fb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:09:23.723326 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce7de11-d351-4c51-9c62-c95b1b9b5fb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:09:23.723598 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce7de11-d351-4c51-9c62-c95b1b9b5fb9 admin admin] PATH_INFO: `/v3/projects/9e4a2b609ac349e8aad4e0a26cf862e1` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:09:23.737151 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce7de11-d351-4c51-9c62-c95b1b9b5fb9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e4a2b609ac349e8aad4e0a26cf862e1)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:09:23.738655 dv-cinder-819667-6-smb devstack@keystone.service[81999]: WARNING py.warnings [None req-8ce7de11-d351-4c51-9c62-c95b1b9b5fb9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 01:09:23.738655 dv-cinder-819667-6-smb devstack@keystone.service[81999]: warnings.warn(msg) Aug 30 01:09:23.738655 dv-cinder-819667-6-smb devstack@keystone.service[81999]: Aug 30 01:09:23.739932 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce7de11-d351-4c51-9c62-c95b1b9b5fb9 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:09:23.802130 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-8ce7de11-d351-4c51-9c62-c95b1b9b5fb9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e4a2b609ac349e8aad4e0a26cf862e1', 'request_id': 'req-8ce7de11-d351-4c51-9c62-c95b1b9b5fb9'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:09:23.814015 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-8ce7de11-d351-4c51-9c62-c95b1b9b5fb9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e4a2b609ac349e8aad4e0a26cf862e1', 'request_id': 'req-8ce7de11-d351-4c51-9c62-c95b1b9b5fb9'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:09:23.821038 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-8ce7de11-d351-4c51-9c62-c95b1b9b5fb9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e4a2b609ac349e8aad4e0a26cf862e1', 'request_id': 'req-8ce7de11-d351-4c51-9c62-c95b1b9b5fb9'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:09:23.852480 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-8ce7de11-d351-4c51-9c62-c95b1b9b5fb9 admin admin] The token cache is being invalidate because project 9e4a2b609ac349e8aad4e0a26cf862e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:09:23.852771 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-8ce7de11-d351-4c51-9c62-c95b1b9b5fb9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:09:23.853215 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-8ce7de11-d351-4c51-9c62-c95b1b9b5fb9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:09:23.854658 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 764/1510] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 30 01:09:23 2022] DELETE /identity/v3/projects/9e4a2b609ac349e8aad4e0a26cf862e1 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:09:33.240865 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=62 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:09:33.850434 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:10:57.572663 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2540ec98-df4b-4329-99a5-bb6fe20b067e None None] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:10:57.573317 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2540ec98-df4b-4329-99a5-bb6fe20b067e None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:10:57.573317 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2540ec98-df4b-4329-99a5-bb6fe20b067e None None] PATH_INFO: `/` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:10:57.574545 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 747/1511] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 01:10:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:10:57.579623 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99628c18-bdfa-45c5-86ed-bd0984f9f94e None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:10:57.580418 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99628c18-bdfa-45c5-86ed-bd0984f9f94e None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:10:57.580685 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99628c18-bdfa-45c5-86ed-bd0984f9f94e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:10:57.675960 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-99628c18-bdfa-45c5-86ed-bd0984f9f94e None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:10:57.677207 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-99628c18-bdfa-45c5-86ed-bd0984f9f94e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:10:57.807633 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 765/1512] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 01:10:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:10:57.966170 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2540ec98-df4b-4329-99a5-bb6fe20b067e None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:10:57.968667 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-2540ec98-df4b-4329-99a5-bb6fe20b067e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:10:58.094165 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2540ec98-df4b-4329-99a5-bb6fe20b067e None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:10:58.099947 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e71d878-92ef-4fc4-9bba-f12e8317b728 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6480b2f14c37474c89df9fba48f7cd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:10:58.100577 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e71d878-92ef-4fc4-9bba-f12e8317b728 service nova] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:10:58.100851 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e71d878-92ef-4fc4-9bba-f12e8317b728 service nova] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:10:58.101121 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e71d878-92ef-4fc4-9bba-f12e8317b728 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:10:58.109797 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e71d878-92ef-4fc4-9bba-f12e8317b728 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:10:58.111407 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e71d878-92ef-4fc4-9bba-f12e8317b728 service nova] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:10:58.120915 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 748/1513] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:10:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:10:58.961419 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e357c50-78bd-4cf0-b821-81d0faa323e5 None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:10:58.962004 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e357c50-78bd-4cf0-b821-81d0faa323e5 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:10:58.962004 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e357c50-78bd-4cf0-b821-81d0faa323e5 None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:10:58.964172 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 766/1514] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 01:10:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:10:58.969845 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a76423d-b314-4675-b7d4-52de557b70bc None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:10:58.970437 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a76423d-b314-4675-b7d4-52de557b70bc None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:10:58.970724 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a76423d-b314-4675-b7d4-52de557b70bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:10:58.991634 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-7a76423d-b314-4675-b7d4-52de557b70bc None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:10:58.992868 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-7a76423d-b314-4675-b7d4-52de557b70bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:10:59.000860 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 749/1515] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 01:10:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:10:59.154501 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e357c50-78bd-4cf0-b821-81d0faa323e5 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:10:59.170102 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e357c50-78bd-4cf0-b821-81d0faa323e5 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:10:59.176323 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fefa67-a34e-4e9e-9e45-07958c21ed02 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6480b2f14c37474c89df9fba48f7cd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:10:59.176944 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fefa67-a34e-4e9e-9e45-07958c21ed02 service nova] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:10:59.177236 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fefa67-a34e-4e9e-9e45-07958c21ed02 service nova] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:10:59.177503 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fefa67-a34e-4e9e-9e45-07958c21ed02 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:10:59.187375 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fefa67-a34e-4e9e-9e45-07958c21ed02 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:10:59.188987 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fefa67-a34e-4e9e-9e45-07958c21ed02 service nova] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:10:59.199722 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 767/1516] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:10:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:10:59.261869 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21661b5-ed57-4764-9cb8-ff9e8280d9a6 None None] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:10:59.262135 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21661b5-ed57-4764-9cb8-ff9e8280d9a6 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:10:59.262405 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21661b5-ed57-4764-9cb8-ff9e8280d9a6 None None] PATH_INFO: `/v3` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:10:59.263746 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 750/1517] 10.222.0.58 () {54 vars in 925 bytes} [Tue Aug 30 01:10:59 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:10:59.270783 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430fbb3c-5876-4d70-9374-f41f93e65694 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:10:59.271138 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430fbb3c-5876-4d70-9374-f41f93e65694 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:10:59.271530 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430fbb3c-5876-4d70-9374-f41f93e65694 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:10:59.341795 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-430fbb3c-5876-4d70-9374-f41f93e65694 None None] MFA Rules not processed for user `d68e91e4259e449797fb83de548aec1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:10:59.342993 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-430fbb3c-5876-4d70-9374-f41f93e65694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:10:59.360204 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:10:59.418788 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 768/1518] 10.222.0.58 () {58 vars in 1015 bytes} [Tue Aug 30 01:10:59 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:11:03.269713 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7159809-f945-4544-97ca-71cf929ed889 None None] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:11:03.270227 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7159809-f945-4544-97ca-71cf929ed889 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:11:03.270227 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7159809-f945-4544-97ca-71cf929ed889 None None] PATH_INFO: `/` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:11:03.271612 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 751/1519] 10.222.0.79 () {54 vars in 961 bytes} [Tue Aug 30 01:11:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:11:03.277523 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a1e09e-409d-4150-bb94-4ec9ab906441 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:11:03.278107 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a1e09e-409d-4150-bb94-4ec9ab906441 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:11:03.278107 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a1e09e-409d-4150-bb94-4ec9ab906441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:11:03.300463 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-07a1e09e-409d-4150-bb94-4ec9ab906441 None None] MFA Rules not processed for user `d68e91e4259e449797fb83de548aec1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:11:03.301928 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-07a1e09e-409d-4150-bb94-4ec9ab906441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:11:03.310827 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 769/1520] 10.222.0.79 () {58 vars in 1058 bytes} [Tue Aug 30 01:11:03 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:11:03.318244 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7159809-f945-4544-97ca-71cf929ed889 None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:11:03.332662 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7159809-f945-4544-97ca-71cf929ed889 None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:11:03.338519 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb49934b-31d2-4429-8c6d-18bdf43d740f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd68e91e4259e449797fb83de548aec1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:11:03.339290 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb49934b-31d2-4429-8c6d-18bdf43d740f service placement] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:11:03.339569 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb49934b-31d2-4429-8c6d-18bdf43d740f service placement] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:11:03.339839 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb49934b-31d2-4429-8c6d-18bdf43d740f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:11:03.348050 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb49934b-31d2-4429-8c6d-18bdf43d740f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:11:03.349609 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb49934b-31d2-4429-8c6d-18bdf43d740f service placement] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:11:03.359795 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 752/1521] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:11:03 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:11:10.433414 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6ae401-d909-4735-a348-091353f8b377 None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:11:10.433984 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6ae401-d909-4735-a348-091353f8b377 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:11:10.433984 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6ae401-d909-4735-a348-091353f8b377 None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:11:10.435318 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 770/1522] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 01:11:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:11:10.440231 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e884d990-f903-47eb-9c28-505a11b10416 None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:11:10.440820 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e884d990-f903-47eb-9c28-505a11b10416 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:11:10.440820 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e884d990-f903-47eb-9c28-505a11b10416 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:11:10.460204 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-e884d990-f903-47eb-9c28-505a11b10416 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:11:10.461399 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-e884d990-f903-47eb-9c28-505a11b10416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:11:10.469683 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 753/1523] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 01:11:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:11:10.624313 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6ae401-d909-4735-a348-091353f8b377 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:11:10.638867 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6ae401-d909-4735-a348-091353f8b377 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:11:10.644292 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3300f9-f31b-4957-9948-3a079eeffd90 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6480b2f14c37474c89df9fba48f7cd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:11:10.644879 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3300f9-f31b-4957-9948-3a079eeffd90 service nova] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:11:10.645159 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3300f9-f31b-4957-9948-3a079eeffd90 service nova] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:11:10.645420 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3300f9-f31b-4957-9948-3a079eeffd90 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:11:10.654808 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3300f9-f31b-4957-9948-3a079eeffd90 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:11:10.656438 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3300f9-f31b-4957-9948-3a079eeffd90 service nova] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:11:10.667363 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 771/1524] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:11:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:11:11.499493 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad0208c-50d8-4ed7-b444-c77496044f6f None None] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:11:11.500058 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad0208c-50d8-4ed7-b444-c77496044f6f None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:11:11.500058 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad0208c-50d8-4ed7-b444-c77496044f6f None None] PATH_INFO: `/` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:11:11.501274 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 754/1525] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 01:11:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:11:11.506141 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a8b24a-6614-4159-9a6c-192b63622f04 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:11:11.506574 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a8b24a-6614-4159-9a6c-192b63622f04 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:11:11.506681 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a8b24a-6614-4159-9a6c-192b63622f04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:11:11.526383 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-93a8b24a-6614-4159-9a6c-192b63622f04 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:11:11.527888 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-93a8b24a-6614-4159-9a6c-192b63622f04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:11:11.536317 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 772/1526] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 01:11:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:11:11.692416 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad0208c-50d8-4ed7-b444-c77496044f6f None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:11:11.707071 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad0208c-50d8-4ed7-b444-c77496044f6f None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:11:11.712597 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfdc09b-8d14-40cc-9d86-e06b34884068 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6480b2f14c37474c89df9fba48f7cd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:11:11.713149 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfdc09b-8d14-40cc-9d86-e06b34884068 service nova] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:11:11.713426 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfdc09b-8d14-40cc-9d86-e06b34884068 service nova] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:11:11.713686 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfdc09b-8d14-40cc-9d86-e06b34884068 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:11:11.721921 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfdc09b-8d14-40cc-9d86-e06b34884068 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:11:11.723581 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfdc09b-8d14-40cc-9d86-e06b34884068 service nova] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:11:11.733875 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 755/1527] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:11:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:11:17.014321 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4078bdf-8a1d-4200-878b-2bf1adf40066 None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:11:17.014923 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4078bdf-8a1d-4200-878b-2bf1adf40066 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:11:17.014923 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4078bdf-8a1d-4200-878b-2bf1adf40066 None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:11:17.016377 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 773/1528] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 01:11:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:11:17.022307 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0ad70b-73a7-46b6-92db-b410dceab264 None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:11:17.022872 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0ad70b-73a7-46b6-92db-b410dceab264 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:11:17.022872 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0ad70b-73a7-46b6-92db-b410dceab264 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:11:17.044643 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-4a0ad70b-73a7-46b6-92db-b410dceab264 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:11:17.045878 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-4a0ad70b-73a7-46b6-92db-b410dceab264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:11:17.054171 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 756/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 01:11:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:11:17.351104 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4078bdf-8a1d-4200-878b-2bf1adf40066 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:11:17.353419 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-e4078bdf-8a1d-4200-878b-2bf1adf40066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:11:17.433429 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4078bdf-8a1d-4200-878b-2bf1adf40066 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:11:17.437658 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b381bb-7789-461e-b4c6-5df5ed3d6264 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16e6a0ca26fc4ef892c188ad89a1e132', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:11:17.438271 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b381bb-7789-461e-b4c6-5df5ed3d6264 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:11:17.438550 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b381bb-7789-461e-b4c6-5df5ed3d6264 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:11:17.438826 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b381bb-7789-461e-b4c6-5df5ed3d6264 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:11:17.450718 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b381bb-7789-461e-b4c6-5df5ed3d6264 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:11:17.452185 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b381bb-7789-461e-b4c6-5df5ed3d6264 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:11:17.463232 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 774/1530] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:11:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:11:19.415893 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1c9d81-c7f4-4d57-b6fe-d6c1daeae071 None None] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:11:19.416752 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1c9d81-c7f4-4d57-b6fe-d6c1daeae071 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:11:19.416752 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1c9d81-c7f4-4d57-b6fe-d6c1daeae071 None None] PATH_INFO: `/` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:11:19.417823 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 757/1531] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 01:11:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:11:19.424705 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383695de-58ee-4051-bf0c-6fe8f1383e53 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:11:19.425292 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383695de-58ee-4051-bf0c-6fe8f1383e53 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:11:19.425635 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383695de-58ee-4051-bf0c-6fe8f1383e53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:11:19.446077 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-383695de-58ee-4051-bf0c-6fe8f1383e53 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:11:19.447809 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-383695de-58ee-4051-bf0c-6fe8f1383e53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:11:19.456479 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 775/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 01:11:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:11:19.739850 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1c9d81-c7f4-4d57-b6fe-d6c1daeae071 None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:11:19.751808 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1c9d81-c7f4-4d57-b6fe-d6c1daeae071 None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:11:19.755625 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72b1257-cd25-4191-a9e9-84bd641a6497 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16e6a0ca26fc4ef892c188ad89a1e132', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:11:19.756261 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72b1257-cd25-4191-a9e9-84bd641a6497 service neutron] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:11:19.756514 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72b1257-cd25-4191-a9e9-84bd641a6497 service neutron] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:11:19.756780 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72b1257-cd25-4191-a9e9-84bd641a6497 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:11:19.768042 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72b1257-cd25-4191-a9e9-84bd641a6497 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:11:19.769510 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72b1257-cd25-4191-a9e9-84bd641a6497 service neutron] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:11:19.780747 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 758/1533] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:11:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:11:23.521127 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b51048-3b6b-4217-adba-1bd8da641183 None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:11:23.521705 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b51048-3b6b-4217-adba-1bd8da641183 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:11:23.521705 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b51048-3b6b-4217-adba-1bd8da641183 None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:11:23.522918 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 776/1534] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 01:11:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:11:23.529816 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674e96a5-35ab-48e0-b405-728e03e9a357 None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:11:23.530373 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674e96a5-35ab-48e0-b405-728e03e9a357 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:11:23.530373 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674e96a5-35ab-48e0-b405-728e03e9a357 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:11:23.538113 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=81 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:11:23.552719 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-674e96a5-35ab-48e0-b405-728e03e9a357 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:11:23.553938 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-674e96a5-35ab-48e0-b405-728e03e9a357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:11:23.562619 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 759/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 01:11:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:11:24.131953 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b51048-3b6b-4217-adba-1bd8da641183 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:11:24.134956 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-00b51048-3b6b-4217-adba-1bd8da641183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:11:24.200447 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:11:24.214582 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b51048-3b6b-4217-adba-1bd8da641183 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:11:24.218143 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bad4c61-ad54-45f7-b5e0-450908761850 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f827c7670b74d938ffe066ced88d1c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:11:24.218747 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bad4c61-ad54-45f7-b5e0-450908761850 service cinder] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:11:24.219018 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bad4c61-ad54-45f7-b5e0-450908761850 service cinder] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:11:24.219316 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bad4c61-ad54-45f7-b5e0-450908761850 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:11:24.228988 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bad4c61-ad54-45f7-b5e0-450908761850 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:11:24.230412 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bad4c61-ad54-45f7-b5e0-450908761850 service cinder] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:11:24.240193 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 777/1536] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:11:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:11:26.246100 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3cf5dd-5ebc-4dbe-b4b2-1c1121344ed2 None None] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:11:26.246578 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3cf5dd-5ebc-4dbe-b4b2-1c1121344ed2 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:11:26.246682 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3cf5dd-5ebc-4dbe-b4b2-1c1121344ed2 None None] PATH_INFO: `/` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:11:26.248008 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 760/1537] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 01:11:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:11:26.253356 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a10eee-185f-4868-ab90-3cda911f9e8e None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:11:26.253833 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a10eee-185f-4868-ab90-3cda911f9e8e None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:11:26.253927 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a10eee-185f-4868-ab90-3cda911f9e8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:11:26.274272 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-94a10eee-185f-4868-ab90-3cda911f9e8e None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:11:26.275669 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-94a10eee-185f-4868-ab90-3cda911f9e8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:11:26.283611 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 778/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 01:11:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:11:26.850953 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3cf5dd-5ebc-4dbe-b4b2-1c1121344ed2 None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:11:26.853367 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-6e3cf5dd-5ebc-4dbe-b4b2-1c1121344ed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:11:26.866480 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3cf5dd-5ebc-4dbe-b4b2-1c1121344ed2 None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:11:26.870039 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1a9045-a594-4e1a-9dba-2d550594aa6b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f827c7670b74d938ffe066ced88d1c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:11:26.870660 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1a9045-a594-4e1a-9dba-2d550594aa6b service cinder] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:11:26.870937 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1a9045-a594-4e1a-9dba-2d550594aa6b service cinder] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:11:26.871235 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1a9045-a594-4e1a-9dba-2d550594aa6b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:11:26.880667 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1a9045-a594-4e1a-9dba-2d550594aa6b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:11:26.882066 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1a9045-a594-4e1a-9dba-2d550594aa6b service cinder] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:11:26.891367 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 761/1539] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:11:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:11:36.269019 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=11 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:11:36.887231 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=8 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:12:59.226833 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2c9820-932a-4208-ba25-6736cb9d13e9 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:59.227541 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2c9820-932a-4208-ba25-6736cb9d13e9 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:59.227541 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2c9820-932a-4208-ba25-6736cb9d13e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:59.283478 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-4d2c9820-932a-4208-ba25-6736cb9d13e9 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:12:59.284803 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-4d2c9820-932a-4208-ba25-6736cb9d13e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:12:59.295680 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 779/1540] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:12:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:12:59.305586 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b63e27-93c9-423f-82ce-18255409afa7 None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:59.306202 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b63e27-93c9-423f-82ce-18255409afa7 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:59.306202 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b63e27-93c9-423f-82ce-18255409afa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:59.327632 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15da282c-51ae-4143-b5c4-40f14364884a None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:59.327902 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15da282c-51ae-4143-b5c4-40f14364884a None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:59.328237 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15da282c-51ae-4143-b5c4-40f14364884a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:59.334296 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-72b63e27-93c9-423f-82ce-18255409afa7 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:12:59.335579 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-72b63e27-93c9-423f-82ce-18255409afa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:12:59.349504 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 762/1541] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:12:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:12:59.360434 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b63e27-93c9-423f-82ce-18255409afa7 None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:59.366136 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-15da282c-51ae-4143-b5c4-40f14364884a None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:12:59.367399 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-15da282c-51ae-4143-b5c4-40f14364884a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:12:59.375277 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b63e27-93c9-423f-82ce-18255409afa7 None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:59.381003 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7320bacf-1d34-4d86-899b-893f8e2b6409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:59.381615 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7320bacf-1d34-4d86-899b-893f8e2b6409 admin admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:59.381959 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7320bacf-1d34-4d86-899b-893f8e2b6409 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:59.382228 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7320bacf-1d34-4d86-899b-893f8e2b6409 admin admin] PATH_INFO: `/v3/domains` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:59.383076 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 780/1542] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:12:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Aug 30 01:12:59.383235 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7320bacf-1d34-4d86-899b-893f8e2b6409 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:12:59.383502 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7320bacf-1d34-4d86-899b-893f8e2b6409 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:59.384365 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aaa915-1bb4-4395-bd1b-3d0b32a7d8fc None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:59.384546 dv-cinder-819667-6-smb devstack@keystone.service[81998]: WARNING py.warnings [None req-7320bacf-1d34-4d86-899b-893f8e2b6409 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 01:12:59.384546 dv-cinder-819667-6-smb devstack@keystone.service[81998]: warnings.warn(msg) Aug 30 01:12:59.384546 dv-cinder-819667-6-smb devstack@keystone.service[81998]: Aug 30 01:12:59.384788 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aaa915-1bb4-4395-bd1b-3d0b32a7d8fc None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:59.384961 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aaa915-1bb4-4395-bd1b-3d0b32a7d8fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:59.385394 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7320bacf-1d34-4d86-899b-893f8e2b6409 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:59.414940 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 763/1543] 10.222.0.79 () {58 vars in 1153 bytes} [Tue Aug 30 01:12:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:12:59.416349 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a7a175-edca-4a88-a7dd-6a3327b98806 None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:59.416639 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a7a175-edca-4a88-a7dd-6a3327b98806 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:59.416913 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a7a175-edca-4a88-a7dd-6a3327b98806 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:59.435197 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-a2aaa915-1bb4-4395-bd1b-3d0b32a7d8fc None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:12:59.436341 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-a2aaa915-1bb4-4395-bd1b-3d0b32a7d8fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:12:59.455191 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 781/1544] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:12:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:12:59.460345 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed341642-9fc2-4216-b243-0c6d1a90489e None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:59.460633 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed341642-9fc2-4216-b243-0c6d1a90489e None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:59.460914 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed341642-9fc2-4216-b243-0c6d1a90489e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:59.464085 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-75a7a175-edca-4a88-a7dd-6a3327b98806 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:12:59.465316 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-75a7a175-edca-4a88-a7dd-6a3327b98806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:12:59.494299 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 764/1545] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:12:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:12:59.494299 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a7a175-edca-4a88-a7dd-6a3327b98806 None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:59.496621 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-ed341642-9fc2-4216-b243-0c6d1a90489e None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:12:59.498221 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-ed341642-9fc2-4216-b243-0c6d1a90489e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:12:59.507587 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a7a175-edca-4a88-a7dd-6a3327b98806 None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:59.516073 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 782/1546] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:12:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:12:59.519182 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eac6276-1dbb-48cb-a628-eb4d754864bc None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:59.520075 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eac6276-1dbb-48cb-a628-eb4d754864bc None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:59.521782 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eac6276-1dbb-48cb-a628-eb4d754864bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:59.522913 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ea3de5-0262-4306-a8e5-40304a5d3056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:59.526659 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ea3de5-0262-4306-a8e5-40304a5d3056 admin admin] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:59.527372 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ea3de5-0262-4306-a8e5-40304a5d3056 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:59.527853 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ea3de5-0262-4306-a8e5-40304a5d3056 admin admin] PATH_INFO: `/v3/projects` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:59.528804 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ea3de5-0262-4306-a8e5-40304a5d3056 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:59.531785 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ea3de5-0262-4306-a8e5-40304a5d3056 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:59.559841 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-2eac6276-1dbb-48cb-a628-eb4d754864bc None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:12:59.561182 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-2eac6276-1dbb-48cb-a628-eb4d754864bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:12:59.570779 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 783/1547] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:12:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:12:59.572529 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035786ed-5178-42e4-9523-f261c145b2f9 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:59.572815 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035786ed-5178-42e4-9523-f261c145b2f9 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:59.573086 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035786ed-5178-42e4-9523-f261c145b2f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:59.591033 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 765/1548] 10.222.0.79 () {60 vars in 1153 bytes} [Tue Aug 30 01:12:59 2022] POST /identity/v3/projects => generated 369 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:12:59.592823 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e4083d-5b00-4bc4-ac55-52f681a6f0a5 None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:59.593236 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e4083d-5b00-4bc4-ac55-52f681a6f0a5 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:59.593543 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e4083d-5b00-4bc4-ac55-52f681a6f0a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:59.595492 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-035786ed-5178-42e4-9523-f261c145b2f9 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:12:59.596804 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-035786ed-5178-42e4-9523-f261c145b2f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:12:59.617598 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-16e4083d-5b00-4bc4-ac55-52f681a6f0a5 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:12:59.618801 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-16e4083d-5b00-4bc4-ac55-52f681a6f0a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:12:59.660557 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 784/1549] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:12:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:12:59.661998 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035786ed-5178-42e4-9523-f261c145b2f9 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:59.673519 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035786ed-5178-42e4-9523-f261c145b2f9 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:59.678490 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbb91f5-d134-457f-a376-99622e737001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:59.679097 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbb91f5-d134-457f-a376-99622e737001 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:59.679482 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbb91f5-d134-457f-a376-99622e737001 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:59.679760 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbb91f5-d134-457f-a376-99622e737001 admin admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:59.680413 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbb91f5-d134-457f-a376-99622e737001 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:12:59.680711 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbb91f5-d134-457f-a376-99622e737001 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:59.682304 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbb91f5-d134-457f-a376-99622e737001 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:59.685933 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 766/1550] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:12:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:12:59.687151 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087af84f-9afd-4cad-9648-0b2740c153ec None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:59.687447 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087af84f-9afd-4cad-9648-0b2740c153ec None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:59.687733 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087af84f-9afd-4cad-9648-0b2740c153ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:59.701668 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 785/1551] 10.222.0.79 () {58 vars in 1153 bytes} [Tue Aug 30 01:12:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:12:59.701668 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fef935-d894-4d22-ae92-2be749f73fa8 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:59.701668 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fef935-d894-4d22-ae92-2be749f73fa8 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:59.701668 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fef935-d894-4d22-ae92-2be749f73fa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:59.707891 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-087af84f-9afd-4cad-9648-0b2740c153ec None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:12:59.710009 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-087af84f-9afd-4cad-9648-0b2740c153ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:12:59.717705 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-42fef935-d894-4d22-ae92-2be749f73fa8 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:12:59.717974 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 767/1552] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:12:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:12:59.718770 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087af84f-9afd-4cad-9648-0b2740c153ec None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:59.718952 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-42fef935-d894-4d22-ae92-2be749f73fa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:12:59.729600 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 786/1553] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:12:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:12:59.730978 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fef935-d894-4d22-ae92-2be749f73fa8 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:59.735316 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087af84f-9afd-4cad-9648-0b2740c153ec None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:59.740851 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5af229e-4950-4e7f-ae9e-92608cca7205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:59.741260 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fef935-d894-4d22-ae92-2be749f73fa8 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:59.741476 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5af229e-4950-4e7f-ae9e-92608cca7205 admin admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:59.741746 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5af229e-4950-4e7f-ae9e-92608cca7205 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:59.742044 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5af229e-4950-4e7f-ae9e-92608cca7205 admin admin] PATH_INFO: `/v3/domains` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:59.742731 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5af229e-4950-4e7f-ae9e-92608cca7205 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:12:59.742994 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5af229e-4950-4e7f-ae9e-92608cca7205 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:59.744626 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5af229e-4950-4e7f-ae9e-92608cca7205 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:59.746062 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d84e1f1-78ca-4005-a899-43fa45db9704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:59.746660 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d84e1f1-78ca-4005-a899-43fa45db9704 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:59.746939 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d84e1f1-78ca-4005-a899-43fa45db9704 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:59.747244 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d84e1f1-78ca-4005-a899-43fa45db9704 admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:59.747872 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d84e1f1-78ca-4005-a899-43fa45db9704 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:59.749763 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d84e1f1-78ca-4005-a899-43fa45db9704 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:59.756922 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 768/1554] 10.222.0.79 () {58 vars in 1153 bytes} [Tue Aug 30 01:12:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:12:59.758194 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f764db-3832-4ea0-aabb-77c571eb0f0e None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:59.758479 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f764db-3832-4ea0-aabb-77c571eb0f0e None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:59.758752 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f764db-3832-4ea0-aabb-77c571eb0f0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:59.774492 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 787/1555] 10.222.0.79 () {60 vars in 1144 bytes} [Tue Aug 30 01:12:59 2022] POST /identity/v3/users => generated 285 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:12:59.774746 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6dfc48-47c1-4b2d-8010-f4e8ceab4988 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:59.775504 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6dfc48-47c1-4b2d-8010-f4e8ceab4988 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:59.775504 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6dfc48-47c1-4b2d-8010-f4e8ceab4988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:59.780888 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-50f764db-3832-4ea0-aabb-77c571eb0f0e None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:12:59.782130 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-50f764db-3832-4ea0-aabb-77c571eb0f0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:12:59.791531 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 769/1556] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:12:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:12:59.792345 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f764db-3832-4ea0-aabb-77c571eb0f0e None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:59.795460 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-0d6dfc48-47c1-4b2d-8010-f4e8ceab4988 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:12:59.796652 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-0d6dfc48-47c1-4b2d-8010-f4e8ceab4988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:12:59.802213 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f764db-3832-4ea0-aabb-77c571eb0f0e None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:59.806464 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 788/1557] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:12:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:12:59.807101 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6dfc48-47c1-4b2d-8010-f4e8ceab4988 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:59.812058 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721fe4cf-65fe-4810-85f3-12bc9e4009b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:59.812503 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721fe4cf-65fe-4810-85f3-12bc9e4009b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:59.812784 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721fe4cf-65fe-4810-85f3-12bc9e4009b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:59.813588 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721fe4cf-65fe-4810-85f3-12bc9e4009b0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:59.813726 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721fe4cf-65fe-4810-85f3-12bc9e4009b0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:12:59.814009 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721fe4cf-65fe-4810-85f3-12bc9e4009b0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:59.815636 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721fe4cf-65fe-4810-85f3-12bc9e4009b0 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:59.816997 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6dfc48-47c1-4b2d-8010-f4e8ceab4988 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:59.822570 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90318493-e31f-4b68-b4ef-3818a0f9f589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:59.823183 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90318493-e31f-4b68-b4ef-3818a0f9f589 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:59.823458 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90318493-e31f-4b68-b4ef-3818a0f9f589 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:59.823722 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90318493-e31f-4b68-b4ef-3818a0f9f589 admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:59.824345 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90318493-e31f-4b68-b4ef-3818a0f9f589 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:59.825344 dv-cinder-819667-6-smb devstack@keystone.service[81999]: WARNING py.warnings [None req-90318493-e31f-4b68-b4ef-3818a0f9f589 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 01:12:59.825344 dv-cinder-819667-6-smb devstack@keystone.service[81999]: warnings.warn(msg) Aug 30 01:12:59.825344 dv-cinder-819667-6-smb devstack@keystone.service[81999]: Aug 30 01:12:59.826576 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90318493-e31f-4b68-b4ef-3818a0f9f589 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:59.828947 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 770/1558] 10.222.0.79 () {58 vars in 1153 bytes} [Tue Aug 30 01:12:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:12:59.830413 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c2985f-bfd2-431c-a71c-1eeff0071d3a None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:59.830703 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c2985f-bfd2-431c-a71c-1eeff0071d3a None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:59.831013 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c2985f-bfd2-431c-a71c-1eeff0071d3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:59.856867 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 789/1559] 10.222.0.79 () {60 vars in 1153 bytes} [Tue Aug 30 01:12:59 2022] POST /identity/v3/projects => generated 383 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:12:59.858132 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5d8f39-6190-4fe0-8817-cd82f09349e7 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:59.858298 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-b4c2985f-bfd2-431c-a71c-1eeff0071d3a None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:12:59.858410 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5d8f39-6190-4fe0-8817-cd82f09349e7 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:59.858669 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5d8f39-6190-4fe0-8817-cd82f09349e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:59.859483 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-b4c2985f-bfd2-431c-a71c-1eeff0071d3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:12:59.877910 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-0b5d8f39-6190-4fe0-8817-cd82f09349e7 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:12:59.879090 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-0b5d8f39-6190-4fe0-8817-cd82f09349e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:12:59.922271 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 771/1560] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:12:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:12:59.923103 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c2985f-bfd2-431c-a71c-1eeff0071d3a None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:59.929455 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:12:59.934097 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c2985f-bfd2-431c-a71c-1eeff0071d3a None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:59.939984 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574de984-d643-4591-9966-7dc8ec987b89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:59.940503 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574de984-d643-4591-9966-7dc8ec987b89 admin admin] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:59.940777 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574de984-d643-4591-9966-7dc8ec987b89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:59.941042 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574de984-d643-4591-9966-7dc8ec987b89 admin admin] PATH_INFO: `/v3/projects` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:59.941665 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574de984-d643-4591-9966-7dc8ec987b89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:59.943276 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 790/1561] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:12:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:12:59.944385 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574de984-d643-4591-9966-7dc8ec987b89 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:59.944483 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5d8f39-6190-4fe0-8817-cd82f09349e7 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:59.948913 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:12:59.955022 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5d8f39-6190-4fe0-8817-cd82f09349e7 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:59.960954 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780d47f3-b739-4bd3-a400-bff6d5d5772a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:59.961540 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780d47f3-b739-4bd3-a400-bff6d5d5772a admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:59.961871 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780d47f3-b739-4bd3-a400-bff6d5d5772a admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:59.962146 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780d47f3-b739-4bd3-a400-bff6d5d5772a admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:59.962790 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780d47f3-b739-4bd3-a400-bff6d5d5772a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:59.964618 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780d47f3-b739-4bd3-a400-bff6d5d5772a admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:59.976942 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 772/1562] 10.222.0.79 () {60 vars in 1153 bytes} [Tue Aug 30 01:12:59 2022] POST /identity/v3/projects => generated 393 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:12:59.977146 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 791/1563] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:12:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:12:59.977234 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620a3b35-6ace-46dc-bc60-7dcf46fa2552 None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:59.977322 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780d47f3-b739-4bd3-a400-bff6d5d5772a admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:59.977407 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620a3b35-6ace-46dc-bc60-7dcf46fa2552 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:59.977407 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620a3b35-6ace-46dc-bc60-7dcf46fa2552 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:59.988163 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780d47f3-b739-4bd3-a400-bff6d5d5772a admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:59.996979 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-620a3b35-6ace-46dc-bc60-7dcf46fa2552 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:12:59.998201 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-620a3b35-6ace-46dc-bc60-7dcf46fa2552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:00.048821 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd2f513-78ef-4edd-b52b-6a900d9f7c81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:00.049429 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd2f513-78ef-4edd-b52b-6a900d9f7c81 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:00.049741 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd2f513-78ef-4edd-b52b-6a900d9f7c81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:00.049980 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd2f513-78ef-4edd-b52b-6a900d9f7c81 admin admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:00.050618 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd2f513-78ef-4edd-b52b-6a900d9f7c81 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:13:00.050922 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd2f513-78ef-4edd-b52b-6a900d9f7c81 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:00.052893 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd2f513-78ef-4edd-b52b-6a900d9f7c81 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:00.065640 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 792/1564] 10.222.0.79 () {58 vars in 1153 bytes} [Tue Aug 30 01:12:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:13:00.066382 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 773/1565] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:12:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:13:00.067245 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620a3b35-6ace-46dc-bc60-7dcf46fa2552 None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:00.069221 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd2f513-78ef-4edd-b52b-6a900d9f7c81 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:00.077925 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620a3b35-6ace-46dc-bc60-7dcf46fa2552 None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:00.079555 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd2f513-78ef-4edd-b52b-6a900d9f7c81 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:00.082539 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff0aa55-634b-4930-b1d6-3267c9c3d896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:00.083191 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff0aa55-634b-4930-b1d6-3267c9c3d896 admin admin] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:00.084281 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff0aa55-634b-4930-b1d6-3267c9c3d896 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:00.084921 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff0aa55-634b-4930-b1d6-3267c9c3d896 admin admin] PATH_INFO: `/v3/projects` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:00.085343 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca745ef6-c345-4d9f-8b7a-5df06fa5737f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:00.085552 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff0aa55-634b-4930-b1d6-3267c9c3d896 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:00.085943 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca745ef6-c345-4d9f-8b7a-5df06fa5737f admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:00.086215 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca745ef6-c345-4d9f-8b7a-5df06fa5737f admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:00.086481 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca745ef6-c345-4d9f-8b7a-5df06fa5737f admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:00.087169 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca745ef6-c345-4d9f-8b7a-5df06fa5737f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:00.087464 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff0aa55-634b-4930-b1d6-3267c9c3d896 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:00.089094 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca745ef6-c345-4d9f-8b7a-5df06fa5737f admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:00.112252 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 793/1566] 10.222.0.79 () {60 vars in 1144 bytes} [Tue Aug 30 01:13:00 2022] POST /identity/v3/users => generated 292 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:13:00.113422 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca745ef6-c345-4d9f-8b7a-5df06fa5737f admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:00.119935 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 774/1567] 10.222.0.79 () {60 vars in 1153 bytes} [Tue Aug 30 01:13:00 2022] POST /identity/v3/projects => generated 389 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:13:00.119935 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff0aa55-634b-4930-b1d6-3267c9c3d896 admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:00.123622 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca745ef6-c345-4d9f-8b7a-5df06fa5737f admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:00.183626 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f26e30-7570-4ba5-b146-545068c6fd6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:00.184229 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f26e30-7570-4ba5-b146-545068c6fd6d admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:00.184508 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f26e30-7570-4ba5-b146-545068c6fd6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:00.184776 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f26e30-7570-4ba5-b146-545068c6fd6d admin admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:00.185419 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f26e30-7570-4ba5-b146-545068c6fd6d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:13:00.185763 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f26e30-7570-4ba5-b146-545068c6fd6d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:00.186032 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff0aa55-634b-4930-b1d6-3267c9c3d896 admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:00.187375 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f26e30-7570-4ba5-b146-545068c6fd6d admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:00.190858 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ed6ff0-2c2d-4802-8c20-ad1d98a4ba60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:00.191424 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ed6ff0-2c2d-4802-8c20-ad1d98a4ba60 admin admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:00.191697 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ed6ff0-2c2d-4802-8c20-ad1d98a4ba60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:00.191958 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ed6ff0-2c2d-4802-8c20-ad1d98a4ba60 admin admin] PATH_INFO: `/v3/domains` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:00.193246 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ed6ff0-2c2d-4802-8c20-ad1d98a4ba60 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:13:00.193977 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ed6ff0-2c2d-4802-8c20-ad1d98a4ba60 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:00.195595 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ed6ff0-2c2d-4802-8c20-ad1d98a4ba60 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:00.200053 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 794/1568] 10.222.0.79 () {58 vars in 1153 bytes} [Tue Aug 30 01:13:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:13:00.200849 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f26e30-7570-4ba5-b146-545068c6fd6d admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:00.210484 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f26e30-7570-4ba5-b146-545068c6fd6d admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:00.213090 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 775/1569] 10.222.0.79 () {58 vars in 1153 bytes} [Tue Aug 30 01:13:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:13:00.213926 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ed6ff0-2c2d-4802-8c20-ad1d98a4ba60 admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:00.215394 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5ed1cd-15b4-4bcc-befa-dd4f5ee0070d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:00.216010 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5ed1cd-15b4-4bcc-befa-dd4f5ee0070d admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:00.216419 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5ed1cd-15b4-4bcc-befa-dd4f5ee0070d admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:00.216833 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5ed1cd-15b4-4bcc-befa-dd4f5ee0070d admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:00.217463 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5ed1cd-15b4-4bcc-befa-dd4f5ee0070d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:00.219397 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5ed1cd-15b4-4bcc-befa-dd4f5ee0070d admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:00.224166 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ed6ff0-2c2d-4802-8c20-ad1d98a4ba60 admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:00.228955 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecf8ab6-08f5-4384-8eea-183a0a7f57f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:00.229669 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecf8ab6-08f5-4384-8eea-183a0a7f57f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:00.230053 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecf8ab6-08f5-4384-8eea-183a0a7f57f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:00.230423 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecf8ab6-08f5-4384-8eea-183a0a7f57f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:00.231168 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecf8ab6-08f5-4384-8eea-183a0a7f57f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:00.232962 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecf8ab6-08f5-4384-8eea-183a0a7f57f9 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:00.243351 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 795/1570] 10.222.0.79 () {60 vars in 1144 bytes} [Tue Aug 30 01:13:00 2022] POST /identity/v3/users => generated 297 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:13:00.244184 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5ed1cd-15b4-4bcc-befa-dd4f5ee0070d admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:00.252463 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 776/1571] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:13:00 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:13:00.252463 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecf8ab6-08f5-4384-8eea-183a0a7f57f9 admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:00.257556 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5ed1cd-15b4-4bcc-befa-dd4f5ee0070d admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:00.260471 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecf8ab6-08f5-4384-8eea-183a0a7f57f9 admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:00.262215 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d290d817-1d7b-406e-b519-6b1fa8350463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:00.262774 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d290d817-1d7b-406e-b519-6b1fa8350463 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:00.263081 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d290d817-1d7b-406e-b519-6b1fa8350463 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:00.263384 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d290d817-1d7b-406e-b519-6b1fa8350463 admin admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:00.264055 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d290d817-1d7b-406e-b519-6b1fa8350463 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:13:00.264320 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d290d817-1d7b-406e-b519-6b1fa8350463 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:00.265209 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9771a38b-c16a-4c83-9bf0-5c87bb23ffce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:00.265789 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9771a38b-c16a-4c83-9bf0-5c87bb23ffce admin admin] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:00.265898 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d290d817-1d7b-406e-b519-6b1fa8350463 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:00.266066 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9771a38b-c16a-4c83-9bf0-5c87bb23ffce admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:00.266336 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9771a38b-c16a-4c83-9bf0-5c87bb23ffce admin admin] PATH_INFO: `/v3/projects` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:00.266955 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9771a38b-c16a-4c83-9bf0-5c87bb23ffce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:00.268851 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9771a38b-c16a-4c83-9bf0-5c87bb23ffce admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:00.278237 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 796/1572] 10.222.0.79 () {58 vars in 1153 bytes} [Tue Aug 30 01:13:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:13:00.280624 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d290d817-1d7b-406e-b519-6b1fa8350463 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:00.293136 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d290d817-1d7b-406e-b519-6b1fa8350463 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:00.297990 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a092df-f702-4b77-9be9-f21a5f67d9e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:00.298206 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 777/1573] 10.222.0.79 () {60 vars in 1153 bytes} [Tue Aug 30 01:13:00 2022] POST /identity/v3/projects => generated 383 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:13:00.298308 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a092df-f702-4b77-9be9-f21a5f67d9e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:00.298576 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a092df-f702-4b77-9be9-f21a5f67d9e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:00.298917 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a092df-f702-4b77-9be9-f21a5f67d9e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:00.299320 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9771a38b-c16a-4c83-9bf0-5c87bb23ffce admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:00.299743 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a092df-f702-4b77-9be9-f21a5f67d9e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:00.301470 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a092df-f702-4b77-9be9-f21a5f67d9e8 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:00.315271 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 797/1574] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:13:00 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:13:00.315271 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a092df-f702-4b77-9be9-f21a5f67d9e8 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:00.326512 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:13:00.327060 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a092df-f702-4b77-9be9-f21a5f67d9e8 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:00.345899 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:13:00.367273 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9771a38b-c16a-4c83-9bf0-5c87bb23ffce admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:00.372528 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743400f7-9951-4c0b-8889-f070261b8554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:00.373138 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743400f7-9951-4c0b-8889-f070261b8554 admin admin] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:00.373417 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743400f7-9951-4c0b-8889-f070261b8554 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:00.373688 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743400f7-9951-4c0b-8889-f070261b8554 admin admin] PATH_INFO: `/v3/users` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:00.374316 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743400f7-9951-4c0b-8889-f070261b8554 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:00.375396 dv-cinder-819667-6-smb devstack@keystone.service[81998]: WARNING py.warnings [None req-743400f7-9951-4c0b-8889-f070261b8554 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 01:13:00.375396 dv-cinder-819667-6-smb devstack@keystone.service[81998]: warnings.warn(msg) Aug 30 01:13:00.375396 dv-cinder-819667-6-smb devstack@keystone.service[81998]: Aug 30 01:13:00.376711 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743400f7-9951-4c0b-8889-f070261b8554 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:00.388562 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51014c8d-a3fd-44ad-b38b-382a979bfc6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:00.389578 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51014c8d-a3fd-44ad-b38b-382a979bfc6e admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:00.389950 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51014c8d-a3fd-44ad-b38b-382a979bfc6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:00.390315 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51014c8d-a3fd-44ad-b38b-382a979bfc6e admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:00.391069 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51014c8d-a3fd-44ad-b38b-382a979bfc6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:00.393295 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51014c8d-a3fd-44ad-b38b-382a979bfc6e admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:00.398996 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 778/1575] 10.222.0.79 () {60 vars in 1144 bytes} [Tue Aug 30 01:13:00 2022] POST /identity/v3/users => generated 295 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:13:00.400238 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743400f7-9951-4c0b-8889-f070261b8554 admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:00.410055 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743400f7-9951-4c0b-8889-f070261b8554 admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:00.415698 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245bd7c0-5297-416c-9351-bf08abba981f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:00.416405 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245bd7c0-5297-416c-9351-bf08abba981f admin admin] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:00.416763 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245bd7c0-5297-416c-9351-bf08abba981f admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:00.417102 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245bd7c0-5297-416c-9351-bf08abba981f admin admin] PATH_INFO: `/v3/projects` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:00.417794 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245bd7c0-5297-416c-9351-bf08abba981f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:00.419784 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245bd7c0-5297-416c-9351-bf08abba981f admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:00.424579 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 798/1576] 10.222.0.79 () {60 vars in 1153 bytes} [Tue Aug 30 01:13:00 2022] POST /identity/v3/projects => generated 373 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:13:00.424579 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51014c8d-a3fd-44ad-b38b-382a979bfc6e admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:00.454019 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 779/1577] 10.222.0.79 () {60 vars in 1153 bytes} [Tue Aug 30 01:13:00 2022] POST /identity/v3/projects => generated 355 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:13:00.454899 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245bd7c0-5297-416c-9351-bf08abba981f admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:00.491389 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51014c8d-a3fd-44ad-b38b-382a979bfc6e admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:00.520324 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245bd7c0-5297-416c-9351-bf08abba981f admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:00.525154 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba91542-e1fb-407c-9a89-ec97e37becc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:00.525813 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba91542-e1fb-407c-9a89-ec97e37becc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:00.526421 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba91542-e1fb-407c-9a89-ec97e37becc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:00.526692 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba91542-e1fb-407c-9a89-ec97e37becc9 admin admin] PATH_INFO: `/v3/projects/88c8577d35054fa2a6349b2c20a9baff/users/d8b89f37494746d98e4fe9954abdb30f/roles/c37945a17623465f899d4f217e7af593` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:00.542118 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba91542-e1fb-407c-9a89-ec97e37becc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88c8577d35054fa2a6349b2c20a9baff, user_id=d8b89f37494746d98e4fe9954abdb30f, role_id=c37945a17623465f899d4f217e7af593)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:00.544832 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba91542-e1fb-407c-9a89-ec97e37becc9 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:00.550246 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1169d136-45c6-4abd-aa98-2ef1b206090c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:00.551028 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1169d136-45c6-4abd-aa98-2ef1b206090c admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:00.551351 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1169d136-45c6-4abd-aa98-2ef1b206090c admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:00.551634 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1169d136-45c6-4abd-aa98-2ef1b206090c admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:00.553091 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1169d136-45c6-4abd-aa98-2ef1b206090c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:00.554912 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1169d136-45c6-4abd-aa98-2ef1b206090c admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:00.559043 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 780/1578] 10.222.0.79 () {60 vars in 1483 bytes} [Tue Aug 30 01:13:00 2022] PUT /identity/v3/projects/88c8577d35054fa2a6349b2c20a9baff/users/d8b89f37494746d98e4fe9954abdb30f/roles/c37945a17623465f899d4f217e7af593 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:13:00.570962 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba91542-e1fb-407c-9a89-ec97e37becc9 admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:00.577074 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 799/1579] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:13:00 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:13:00.577773 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1169d136-45c6-4abd-aa98-2ef1b206090c admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:00.588692 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1169d136-45c6-4abd-aa98-2ef1b206090c admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:00.632913 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba91542-e1fb-407c-9a89-ec97e37becc9 admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:00.635099 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:13:00.639004 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3313f43-7746-4c46-b5b5-5679410fcd2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:00.639782 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3313f43-7746-4c46-b5b5-5679410fcd2b admin admin] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:00.640172 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3313f43-7746-4c46-b5b5-5679410fcd2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:00.640570 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3313f43-7746-4c46-b5b5-5679410fcd2b admin admin] PATH_INFO: `/v3/projects` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:00.641227 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3313f43-7746-4c46-b5b5-5679410fcd2b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:00.643120 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3313f43-7746-4c46-b5b5-5679410fcd2b admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:00.648846 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12b2b04-c78a-463c-9984-32d69aa3d475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:00.649480 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12b2b04-c78a-463c-9984-32d69aa3d475 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:00.649751 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12b2b04-c78a-463c-9984-32d69aa3d475 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:00.650018 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12b2b04-c78a-463c-9984-32d69aa3d475 admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:00.650648 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12b2b04-c78a-463c-9984-32d69aa3d475 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:00.652561 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12b2b04-c78a-463c-9984-32d69aa3d475 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:00.665118 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:13:00.675477 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 781/1580] 10.222.0.79 () {60 vars in 1153 bytes} [Tue Aug 30 01:13:00 2022] POST /identity/v3/projects => generated 379 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:13:00.676535 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 800/1581] 10.222.0.79 () {60 vars in 1144 bytes} [Tue Aug 30 01:13:00 2022] POST /identity/v3/users => generated 292 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:13:00.676668 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3313f43-7746-4c46-b5b5-5679410fcd2b admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:00.677862 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12b2b04-c78a-463c-9984-32d69aa3d475 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:00.691640 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12b2b04-c78a-463c-9984-32d69aa3d475 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:00.744448 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3313f43-7746-4c46-b5b5-5679410fcd2b admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:00.751368 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffac991-ac99-4f05-9d30-0f727e775e35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:00.752046 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13886c3-2135-43e2-9cea-d7a240a0dbe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:00.752243 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffac991-ac99-4f05-9d30-0f727e775e35 admin admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:00.752653 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffac991-ac99-4f05-9d30-0f727e775e35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:00.752811 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13886c3-2135-43e2-9cea-d7a240a0dbe7 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:00.753052 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffac991-ac99-4f05-9d30-0f727e775e35 admin admin] PATH_INFO: `/v3/roles` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:00.753199 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13886c3-2135-43e2-9cea-d7a240a0dbe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:00.753356 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13886c3-2135-43e2-9cea-d7a240a0dbe7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:00.754023 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13886c3-2135-43e2-9cea-d7a240a0dbe7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:00.754221 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffac991-ac99-4f05-9d30-0f727e775e35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:00.755758 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13886c3-2135-43e2-9cea-d7a240a0dbe7 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:00.756523 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffac991-ac99-4f05-9d30-0f727e775e35 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:00.767710 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 782/1582] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:13:00 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:13:00.769603 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 801/1583] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:13:00 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:13:00.772128 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffac991-ac99-4f05-9d30-0f727e775e35 admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:00.772446 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13886c3-2135-43e2-9cea-d7a240a0dbe7 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:00.782570 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffac991-ac99-4f05-9d30-0f727e775e35 admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:00.783064 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13886c3-2135-43e2-9cea-d7a240a0dbe7 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:00.787942 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2776b5a1-4356-4fe5-9809-6af14a8ec7c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:00.788578 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2776b5a1-4356-4fe5-9809-6af14a8ec7c5 admin admin] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:00.788695 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd6d9aa-9689-441a-ae79-37991150d8a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:00.788910 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2776b5a1-4356-4fe5-9809-6af14a8ec7c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:00.789133 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2776b5a1-4356-4fe5-9809-6af14a8ec7c5 admin admin] PATH_INFO: `/v3/users` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:00.789233 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd6d9aa-9689-441a-ae79-37991150d8a1 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:00.789506 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd6d9aa-9689-441a-ae79-37991150d8a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:00.789768 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2776b5a1-4356-4fe5-9809-6af14a8ec7c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:00.789867 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd6d9aa-9689-441a-ae79-37991150d8a1 admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:00.790394 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd6d9aa-9689-441a-ae79-37991150d8a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:00.791711 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2776b5a1-4356-4fe5-9809-6af14a8ec7c5 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:00.792323 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd6d9aa-9689-441a-ae79-37991150d8a1 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:00.815660 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 783/1584] 10.222.0.79 () {60 vars in 1144 bytes} [Tue Aug 30 01:13:00 2022] POST /identity/v3/users => generated 287 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:13:00.818642 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 802/1585] 10.222.0.79 () {60 vars in 1144 bytes} [Tue Aug 30 01:13:00 2022] POST /identity/v3/users => generated 278 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:13:00.819650 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd6d9aa-9689-441a-ae79-37991150d8a1 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:00.820138 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067cef31-1ced-4dd9-9ac5-d808711b6d8a None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:00.820433 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067cef31-1ced-4dd9-9ac5-d808711b6d8a None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:00.820714 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067cef31-1ced-4dd9-9ac5-d808711b6d8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:00.830997 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd6d9aa-9689-441a-ae79-37991150d8a1 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:00.835628 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c287960-0f1e-43f5-ba2f-4fd369436394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:00.836267 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c287960-0f1e-43f5-ba2f-4fd369436394 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:00.836549 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c287960-0f1e-43f5-ba2f-4fd369436394 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:00.836813 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c287960-0f1e-43f5-ba2f-4fd369436394 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:00.837462 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c287960-0f1e-43f5-ba2f-4fd369436394 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:00.839279 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c287960-0f1e-43f5-ba2f-4fd369436394 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:00.850075 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 803/1586] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:13:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:13:00.853568 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-067cef31-1ced-4dd9-9ac5-d808711b6d8a None None] MFA Rules not processed for user `d8b89f37494746d98e4fe9954abdb30f`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:13:00.853688 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c287960-0f1e-43f5-ba2f-4fd369436394 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:00.853783 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-067cef31-1ced-4dd9-9ac5-d808711b6d8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:00.863088 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c287960-0f1e-43f5-ba2f-4fd369436394 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:00.868488 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cb657c-d05c-45a2-901b-7ef2ffc29466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:00.869066 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cb657c-d05c-45a2-901b-7ef2ffc29466 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:00.869341 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cb657c-d05c-45a2-901b-7ef2ffc29466 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:00.869608 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cb657c-d05c-45a2-901b-7ef2ffc29466 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:00.870230 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cb657c-d05c-45a2-901b-7ef2ffc29466 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:00.871861 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cb657c-d05c-45a2-901b-7ef2ffc29466 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:00.882741 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 804/1587] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:13:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:13:00.883626 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cb657c-d05c-45a2-901b-7ef2ffc29466 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:00.893071 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cb657c-d05c-45a2-901b-7ef2ffc29466 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:00.897982 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d38c3d-ef0b-4d9b-b2b2-dad848378822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:00.898557 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d38c3d-ef0b-4d9b-b2b2-dad848378822 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:00.898830 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d38c3d-ef0b-4d9b-b2b2-dad848378822 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:00.899094 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d38c3d-ef0b-4d9b-b2b2-dad848378822 admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:00.899747 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d38c3d-ef0b-4d9b-b2b2-dad848378822 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:00.901628 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d38c3d-ef0b-4d9b-b2b2-dad848378822 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:00.921398 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 784/1588] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:13:00 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:13:00.922443 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067cef31-1ced-4dd9-9ac5-d808711b6d8a None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:00.931364 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 805/1589] 10.222.0.79 () {60 vars in 1144 bytes} [Tue Aug 30 01:13:00 2022] POST /identity/v3/users => generated 290 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:13:00.932235 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d38c3d-ef0b-4d9b-b2b2-dad848378822 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:00.935483 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067cef31-1ced-4dd9-9ac5-d808711b6d8a None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:00.941374 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189b1533-9e98-482a-88a6-d630eaf828d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:00.942408 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d38c3d-ef0b-4d9b-b2b2-dad848378822 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:00.942525 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189b1533-9e98-482a-88a6-d630eaf828d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:00.942525 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189b1533-9e98-482a-88a6-d630eaf828d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:00.942691 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189b1533-9e98-482a-88a6-d630eaf828d1 admin admin] PATH_INFO: `/v3/projects/facf0aba2124485882eabed18d4d7bfc/users/9c8c72f316994b67b735b44086a7a562/roles/c37945a17623465f899d4f217e7af593` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:00.948465 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8785d3-47e9-4815-841d-a53de0f2467f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:00.949163 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8785d3-47e9-4815-841d-a53de0f2467f admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:00.949447 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8785d3-47e9-4815-841d-a53de0f2467f admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:00.949868 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8785d3-47e9-4815-841d-a53de0f2467f admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:00.950533 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8785d3-47e9-4815-841d-a53de0f2467f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:00.952167 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8785d3-47e9-4815-841d-a53de0f2467f admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:00.962914 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189b1533-9e98-482a-88a6-d630eaf828d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=facf0aba2124485882eabed18d4d7bfc, user_id=9c8c72f316994b67b735b44086a7a562, role_id=c37945a17623465f899d4f217e7af593)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:00.963563 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 806/1590] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:13:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:13:00.964518 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8785d3-47e9-4815-841d-a53de0f2467f admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:00.966274 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189b1533-9e98-482a-88a6-d630eaf828d1 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:00.974907 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8785d3-47e9-4815-841d-a53de0f2467f admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:00.981249 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 785/1591] 10.222.0.79 () {60 vars in 1483 bytes} [Tue Aug 30 01:13:00 2022] PUT /identity/v3/projects/facf0aba2124485882eabed18d4d7bfc/users/9c8c72f316994b67b735b44086a7a562/roles/c37945a17623465f899d4f217e7af593 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:13:00.982208 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189b1533-9e98-482a-88a6-d630eaf828d1 admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:01.028800 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:13:01.042441 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61b6fe3-1888-4388-94e3-96313d21082a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:01.043051 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61b6fe3-1888-4388-94e3-96313d21082a admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:01.043359 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61b6fe3-1888-4388-94e3-96313d21082a admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:01.043633 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61b6fe3-1888-4388-94e3-96313d21082a admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:01.044319 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61b6fe3-1888-4388-94e3-96313d21082a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:01.045894 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61b6fe3-1888-4388-94e3-96313d21082a admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:01.047489 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189b1533-9e98-482a-88a6-d630eaf828d1 admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:01.052769 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cbdc80-43fb-455e-9cf0-3162e39073eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:01.053381 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cbdc80-43fb-455e-9cf0-3162e39073eb admin admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:01.053660 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cbdc80-43fb-455e-9cf0-3162e39073eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:01.053931 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cbdc80-43fb-455e-9cf0-3162e39073eb admin admin] PATH_INFO: `/v3/roles` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:01.054586 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cbdc80-43fb-455e-9cf0-3162e39073eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:01.056083 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 807/1592] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:13:00 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:13:01.056225 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cbdc80-43fb-455e-9cf0-3162e39073eb admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:01.056877 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61b6fe3-1888-4388-94e3-96313d21082a admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:01.063778 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=91,keystone:INSERT=9 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:13:01.066773 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 786/1593] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:13:00 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:13:01.067687 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cbdc80-43fb-455e-9cf0-3162e39073eb admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:01.069151 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61b6fe3-1888-4388-94e3-96313d21082a admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:01.075029 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1eab8a6-c652-4d78-9013-1c9f2429ad9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:01.075712 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eab8a6-c652-4d78-9013-1c9f2429ad9e admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:01.075990 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eab8a6-c652-4d78-9013-1c9f2429ad9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:01.076264 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eab8a6-c652-4d78-9013-1c9f2429ad9e admin admin] PATH_INFO: `/v3/projects/749a5392b9e249dbbd2966645062d8c6/users/3f1b91d3b73646c58cb2f49b416961f4/roles/c37945a17623465f899d4f217e7af593` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:01.078392 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cbdc80-43fb-455e-9cf0-3162e39073eb admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:01.083864 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90be34ea-ba2d-4f1a-8391-e0453b48ded8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:01.084648 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90be34ea-ba2d-4f1a-8391-e0453b48ded8 admin admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:01.084924 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90be34ea-ba2d-4f1a-8391-e0453b48ded8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:01.085193 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90be34ea-ba2d-4f1a-8391-e0453b48ded8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:01.085851 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90be34ea-ba2d-4f1a-8391-e0453b48ded8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:01.087456 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90be34ea-ba2d-4f1a-8391-e0453b48ded8 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:01.091725 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1eab8a6-c652-4d78-9013-1c9f2429ad9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=749a5392b9e249dbbd2966645062d8c6, user_id=3f1b91d3b73646c58cb2f49b416961f4, role_id=c37945a17623465f899d4f217e7af593)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:01.092755 dv-cinder-819667-6-smb devstack@keystone.service[81999]: WARNING py.warnings [None req-a1eab8a6-c652-4d78-9013-1c9f2429ad9e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 01:13:01.092755 dv-cinder-819667-6-smb devstack@keystone.service[81999]: warnings.warn(msg) Aug 30 01:13:01.092755 dv-cinder-819667-6-smb devstack@keystone.service[81999]: Aug 30 01:13:01.094679 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1eab8a6-c652-4d78-9013-1c9f2429ad9e admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:01.098020 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 787/1594] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:13:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:13:01.099401 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90be34ea-ba2d-4f1a-8391-e0453b48ded8 admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:01.111481 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 808/1595] 10.222.0.79 () {60 vars in 1483 bytes} [Tue Aug 30 01:13:01 2022] PUT /identity/v3/projects/749a5392b9e249dbbd2966645062d8c6/users/3f1b91d3b73646c58cb2f49b416961f4/roles/c37945a17623465f899d4f217e7af593 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:13:01.111677 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90be34ea-ba2d-4f1a-8391-e0453b48ded8 admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:01.116625 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78fdeba-92be-4925-becd-29f29bf771bd None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:01.116911 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78fdeba-92be-4925-becd-29f29bf771bd None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:01.117177 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78fdeba-92be-4925-becd-29f29bf771bd None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:01.118640 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 809/1596] 10.222.0.79 () {54 vars in 962 bytes} [Tue Aug 30 01:13:01 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:13:01.119143 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78fdeba-92be-4925-becd-29f29bf771bd None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:01.182282 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2c1a7c-b4c8-4259-bfb6-0e48602de5d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:01.182885 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2c1a7c-b4c8-4259-bfb6-0e48602de5d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:01.183215 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2c1a7c-b4c8-4259-bfb6-0e48602de5d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:01.183444 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2c1a7c-b4c8-4259-bfb6-0e48602de5d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:01.184091 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2c1a7c-b4c8-4259-bfb6-0e48602de5d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:01.185696 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2c1a7c-b4c8-4259-bfb6-0e48602de5d0 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:01.191465 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78fdeba-92be-4925-becd-29f29bf771bd None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:01.197521 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348ae73b-912a-4b7c-93db-7b0a67fbb8c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:01.198231 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348ae73b-912a-4b7c-93db-7b0a67fbb8c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:01.198543 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 788/1597] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:13:01 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:13:01.198665 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348ae73b-912a-4b7c-93db-7b0a67fbb8c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:01.198997 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348ae73b-912a-4b7c-93db-7b0a67fbb8c6 admin admin] PATH_INFO: `/v3/projects/0a751c73b64d4c5197b9e072fb7f6952/users/ef92b49bac944122b2a24db6da89d7f0/roles/c37945a17623465f899d4f217e7af593` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:01.200029 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2affb6db-f31f-40f3-933c-c2ee172685db None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:01.200318 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2affb6db-f31f-40f3-933c-c2ee172685db None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:01.200597 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2affb6db-f31f-40f3-933c-c2ee172685db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:01.216742 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348ae73b-912a-4b7c-93db-7b0a67fbb8c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a751c73b64d4c5197b9e072fb7f6952, user_id=ef92b49bac944122b2a24db6da89d7f0, role_id=c37945a17623465f899d4f217e7af593)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:01.219583 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348ae73b-912a-4b7c-93db-7b0a67fbb8c6 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:01.232989 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-2affb6db-f31f-40f3-933c-c2ee172685db None None] MFA Rules not processed for user `9c8c72f316994b67b735b44086a7a562`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:13:01.234217 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-2affb6db-f31f-40f3-933c-c2ee172685db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:01.239058 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 810/1598] 10.222.0.79 () {60 vars in 1483 bytes} [Tue Aug 30 01:13:01 2022] PUT /identity/v3/projects/0a751c73b64d4c5197b9e072fb7f6952/users/ef92b49bac944122b2a24db6da89d7f0/roles/c37945a17623465f899d4f217e7af593 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:13:01.244338 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348ae73b-912a-4b7c-93db-7b0a67fbb8c6 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:01.300791 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 789/1599] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:13:01 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:13:01.301553 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2affb6db-f31f-40f3-933c-c2ee172685db None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:01.310504 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348ae73b-912a-4b7c-93db-7b0a67fbb8c6 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:01.315531 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a471d65-c09c-4810-b34c-d6b7badb9364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:01.316158 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a471d65-c09c-4810-b34c-d6b7badb9364 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:01.316446 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a471d65-c09c-4810-b34c-d6b7badb9364 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:01.316718 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a471d65-c09c-4810-b34c-d6b7badb9364 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:01.317366 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a471d65-c09c-4810-b34c-d6b7badb9364 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:01.319790 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a471d65-c09c-4810-b34c-d6b7badb9364 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:01.322586 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2affb6db-f31f-40f3-933c-c2ee172685db None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:01.328442 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cf3da0-a167-4479-85ad-8fa7e3c8c8fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:01.329076 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cf3da0-a167-4479-85ad-8fa7e3c8c8fa admin admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:01.329628 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cf3da0-a167-4479-85ad-8fa7e3c8c8fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:01.329628 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cf3da0-a167-4479-85ad-8fa7e3c8c8fa admin admin] PATH_INFO: `/v3/roles` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:01.330317 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cf3da0-a167-4479-85ad-8fa7e3c8c8fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:01.331950 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cf3da0-a167-4479-85ad-8fa7e3c8c8fa admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:01.335434 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 811/1600] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:13:01 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:13:01.336804 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a471d65-c09c-4810-b34c-d6b7badb9364 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:01.343699 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 790/1601] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:13:01 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:13:01.344952 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a43fd2-4cd2-4a08-a899-8a9e3974c469 None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:01.345234 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a43fd2-4cd2-4a08-a899-8a9e3974c469 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:01.345502 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a43fd2-4cd2-4a08-a899-8a9e3974c469 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:01.348539 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a471d65-c09c-4810-b34c-d6b7badb9364 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:01.353470 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c69e216-1e25-4cb7-bb14-9f16991241cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:01.354125 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c69e216-1e25-4cb7-bb14-9f16991241cd admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:01.354410 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c69e216-1e25-4cb7-bb14-9f16991241cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:01.354682 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c69e216-1e25-4cb7-bb14-9f16991241cd admin admin] PATH_INFO: `/v3/projects/497e00b7b49041a5bd2c92b19e45c4fc/users/3ddcdbd4269c44c9b9e8d1c109de061f/roles/c37945a17623465f899d4f217e7af593` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:01.364203 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-f4a43fd2-4cd2-4a08-a899-8a9e3974c469 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:13:01.365580 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-f4a43fd2-4cd2-4a08-a899-8a9e3974c469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:01.371617 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c69e216-1e25-4cb7-bb14-9f16991241cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=497e00b7b49041a5bd2c92b19e45c4fc, user_id=3ddcdbd4269c44c9b9e8d1c109de061f, role_id=c37945a17623465f899d4f217e7af593)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:01.373484 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 791/1602] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:13:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:13:01.374406 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c69e216-1e25-4cb7-bb14-9f16991241cd admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:01.374517 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c819a494-d8f0-448f-b277-f00124a92a6d None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:01.374735 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c819a494-d8f0-448f-b277-f00124a92a6d None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:01.375000 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c819a494-d8f0-448f-b277-f00124a92a6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:01.392906 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 812/1603] 10.222.0.79 () {60 vars in 1483 bytes} [Tue Aug 30 01:13:01 2022] PUT /identity/v3/projects/497e00b7b49041a5bd2c92b19e45c4fc/users/3ddcdbd4269c44c9b9e8d1c109de061f/roles/c37945a17623465f899d4f217e7af593 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:13:01.392906 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c69e216-1e25-4cb7-bb14-9f16991241cd admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:01.414256 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-c819a494-d8f0-448f-b277-f00124a92a6d None None] MFA Rules not processed for user `6480b2f14c37474c89df9fba48f7cd91`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:13:01.415493 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-c819a494-d8f0-448f-b277-f00124a92a6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:01.426565 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:13:01.434472 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:13:01.461999 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c69e216-1e25-4cb7-bb14-9f16991241cd admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:01.467134 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4b4528-9486-456a-a4da-473f7d514174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:01.467907 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4b4528-9486-456a-a4da-473f7d514174 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:01.468246 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4b4528-9486-456a-a4da-473f7d514174 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:01.468891 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4b4528-9486-456a-a4da-473f7d514174 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:01.469294 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4b4528-9486-456a-a4da-473f7d514174 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:01.471019 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4b4528-9486-456a-a4da-473f7d514174 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:01.483300 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 813/1604] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:13:01 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:13:01.486113 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a95365-4861-4c29-b101-52548db06d6b None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:01.486402 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a95365-4861-4c29-b101-52548db06d6b None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:01.486803 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a95365-4861-4c29-b101-52548db06d6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:01.493174 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 792/1605] 10.222.0.79 () {58 vars in 1059 bytes} [Tue Aug 30 01:13:01 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:13:01.494428 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a455504-ef88-46fe-bd90-5d1b2d31baba None None] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:01.495064 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a455504-ef88-46fe-bd90-5d1b2d31baba None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:01.495371 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a455504-ef88-46fe-bd90-5d1b2d31baba None None] PATH_INFO: `/` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:01.497794 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 793/1606] 10.222.0.79 () {54 vars in 962 bytes} [Tue Aug 30 01:13:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:13:01.498420 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a455504-ef88-46fe-bd90-5d1b2d31baba None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:01.508158 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-e7a95365-4861-4c29-b101-52548db06d6b None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:13:01.509398 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-e7a95365-4861-4c29-b101-52548db06d6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:01.514248 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a455504-ef88-46fe-bd90-5d1b2d31baba None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:01.517718 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 814/1607] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:13:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:13:01.518602 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a95365-4861-4c29-b101-52548db06d6b None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:01.519748 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1af6e33-1a31-42d1-857b-9ef4d6a24ca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:01.520428 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1af6e33-1a31-42d1-857b-9ef4d6a24ca5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:01.521312 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1af6e33-1a31-42d1-857b-9ef4d6a24ca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:01.521973 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1af6e33-1a31-42d1-857b-9ef4d6a24ca5 admin admin] PATH_INFO: `/v3/projects/fd9b65be36144db4829529c35e942a02/users/e7986fc5b8d2451e8e39be9455d44f55/roles/c37945a17623465f899d4f217e7af593` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:01.534390 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a95365-4861-4c29-b101-52548db06d6b None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:01.539088 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1af6e33-1a31-42d1-857b-9ef4d6a24ca5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd9b65be36144db4829529c35e942a02, user_id=e7986fc5b8d2451e8e39be9455d44f55, role_id=c37945a17623465f899d4f217e7af593)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:01.539900 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d31a36-df71-4717-ab2e-6b932d787e60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:01.540640 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d31a36-df71-4717-ab2e-6b932d787e60 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:01.540923 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d31a36-df71-4717-ab2e-6b932d787e60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:01.541199 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d31a36-df71-4717-ab2e-6b932d787e60 admin admin] PATH_INFO: `/v3/projects/2ad9642c33d043ef879e1061f89bff91/users/4a0345907db64a09910a392439aa712c/roles/c37945a17623465f899d4f217e7af593` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:01.543832 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1af6e33-1a31-42d1-857b-9ef4d6a24ca5 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:01.558037 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d31a36-df71-4717-ab2e-6b932d787e60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ad9642c33d043ef879e1061f89bff91, user_id=4a0345907db64a09910a392439aa712c, role_id=c37945a17623465f899d4f217e7af593)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:01.563502 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 794/1608] 10.222.0.79 () {60 vars in 1483 bytes} [Tue Aug 30 01:13:01 2022] PUT /identity/v3/projects/fd9b65be36144db4829529c35e942a02/users/e7986fc5b8d2451e8e39be9455d44f55/roles/c37945a17623465f899d4f217e7af593 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:13:01.563502 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1af6e33-1a31-42d1-857b-9ef4d6a24ca5 admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:01.563812 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d31a36-df71-4717-ab2e-6b932d787e60 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:01.580697 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 815/1609] 10.222.0.79 () {60 vars in 1483 bytes} [Tue Aug 30 01:13:01 2022] PUT /identity/v3/projects/2ad9642c33d043ef879e1061f89bff91/users/4a0345907db64a09910a392439aa712c/roles/c37945a17623465f899d4f217e7af593 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:13:01.582123 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61edc32-f7a6-4452-a063-8db31107371c None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:01.582511 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61edc32-f7a6-4452-a063-8db31107371c None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:01.582879 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61edc32-f7a6-4452-a063-8db31107371c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:01.611019 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-a61edc32-f7a6-4452-a063-8db31107371c None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:13:01.612644 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-a61edc32-f7a6-4452-a063-8db31107371c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:01.626720 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1af6e33-1a31-42d1-857b-9ef4d6a24ca5 admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:01.678544 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 816/1610] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:13:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:13:01.679406 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61edc32-f7a6-4452-a063-8db31107371c None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:01.680291 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc162fae-bc45-49d7-a8d9-c608598eef44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16e6a0ca26fc4ef892c188ad89a1e132', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:01.680912 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc162fae-bc45-49d7-a8d9-c608598eef44 service neutron] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:01.681206 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc162fae-bc45-49d7-a8d9-c608598eef44 service neutron] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:01.681452 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc162fae-bc45-49d7-a8d9-c608598eef44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:01.690876 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc162fae-bc45-49d7-a8d9-c608598eef44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:01.692372 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc162fae-bc45-49d7-a8d9-c608598eef44 service neutron] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:01.692568 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61edc32-f7a6-4452-a063-8db31107371c None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:01.697793 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fda65df-6f8f-4c14-af33-37a374f4b573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:01.698470 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fda65df-6f8f-4c14-af33-37a374f4b573 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:01.698887 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fda65df-6f8f-4c14-af33-37a374f4b573 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:01.699259 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fda65df-6f8f-4c14-af33-37a374f4b573 admin admin] PATH_INFO: `/v3/projects/a8f44254a7f5453c81bc021153375831/users/5b55e7ed5f194f4dabd56b80573aa3c0/roles/c37945a17623465f899d4f217e7af593` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:01.703454 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 795/1611] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:13:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:13:01.704710 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5190612c-d347-4470-8d31-f17400549aae None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:01.704973 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5190612c-d347-4470-8d31-f17400549aae None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:01.705241 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5190612c-d347-4470-8d31-f17400549aae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:01.714512 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fda65df-6f8f-4c14-af33-37a374f4b573 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8f44254a7f5453c81bc021153375831, user_id=5b55e7ed5f194f4dabd56b80573aa3c0, role_id=c37945a17623465f899d4f217e7af593)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:01.717429 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fda65df-6f8f-4c14-af33-37a374f4b573 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:01.725805 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-5190612c-d347-4470-8d31-f17400549aae None None] MFA Rules not processed for user `6480b2f14c37474c89df9fba48f7cd91`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:13:01.727077 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-5190612c-d347-4470-8d31-f17400549aae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:01.733182 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 817/1612] 10.222.0.79 () {60 vars in 1483 bytes} [Tue Aug 30 01:13:01 2022] PUT /identity/v3/projects/a8f44254a7f5453c81bc021153375831/users/5b55e7ed5f194f4dabd56b80573aa3c0/roles/c37945a17623465f899d4f217e7af593 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:13:01.734158 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fda65df-6f8f-4c14-af33-37a374f4b573 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:01.792605 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:13:01.826183 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 796/1613] 10.222.0.79 () {58 vars in 1059 bytes} [Tue Aug 30 01:13:01 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:13:01.827540 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5190612c-d347-4470-8d31-f17400549aae None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:01.829249 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-5190612c-d347-4470-8d31-f17400549aae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:01.841389 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fda65df-6f8f-4c14-af33-37a374f4b573 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:01.848256 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b485ee-ad6c-4150-9436-cf56ecd54097 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6480b2f14c37474c89df9fba48f7cd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:01.848945 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b485ee-ad6c-4150-9436-cf56ecd54097 service nova] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:01.849840 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b485ee-ad6c-4150-9436-cf56ecd54097 service nova] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:01.850164 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b485ee-ad6c-4150-9436-cf56ecd54097 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:01.865070 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:13:01.904668 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5190612c-d347-4470-8d31-f17400549aae None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:01.909441 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e43a00-4462-488d-aad8-688fde59d099 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16e6a0ca26fc4ef892c188ad89a1e132', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:01.911028 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e43a00-4462-488d-aad8-688fde59d099 service neutron] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:01.911028 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e43a00-4462-488d-aad8-688fde59d099 service neutron] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:01.911028 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e43a00-4462-488d-aad8-688fde59d099 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:01.937092 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b485ee-ad6c-4150-9436-cf56ecd54097 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:01.938952 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b485ee-ad6c-4150-9436-cf56ecd54097 service nova] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:01.951321 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 818/1614] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:13:01 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:13:01.952703 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f8353c-aeb8-4043-9142-d2a03395d766 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:01.952990 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f8353c-aeb8-4043-9142-d2a03395d766 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:01.953379 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f8353c-aeb8-4043-9142-d2a03395d766 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:01.986958 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-72f8353c-aeb8-4043-9142-d2a03395d766 None None] MFA Rules not processed for user `e7986fc5b8d2451e8e39be9455d44f55`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:13:01.988254 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-72f8353c-aeb8-4043-9142-d2a03395d766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:02.006966 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e43a00-4462-488d-aad8-688fde59d099 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:02.008604 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e43a00-4462-488d-aad8-688fde59d099 service neutron] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:02.019879 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 797/1615] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:13:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:13:02.022622 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dc0a3a-4066-4fcb-aa64-a70718bc7f2f None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:02.022622 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dc0a3a-4066-4fcb-aa64-a70718bc7f2f None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:02.023055 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dc0a3a-4066-4fcb-aa64-a70718bc7f2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:02.071288 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-93dc0a3a-4066-4fcb-aa64-a70718bc7f2f None None] MFA Rules not processed for user `4a0345907db64a09910a392439aa712c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:13:02.075771 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-93dc0a3a-4066-4fcb-aa64-a70718bc7f2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:02.127928 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 819/1616] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:13:01 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:13:02.132889 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f8353c-aeb8-4043-9142-d2a03395d766 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:02.156767 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f8353c-aeb8-4043-9142-d2a03395d766 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:02.166199 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ebf7cd-ea6f-4738-9df7-73006c79960d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16e6a0ca26fc4ef892c188ad89a1e132', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:02.169163 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ebf7cd-ea6f-4738-9df7-73006c79960d service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:02.169433 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ebf7cd-ea6f-4738-9df7-73006c79960d service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:02.169709 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ebf7cd-ea6f-4738-9df7-73006c79960d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:02.199445 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ebf7cd-ea6f-4738-9df7-73006c79960d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:02.204003 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ebf7cd-ea6f-4738-9df7-73006c79960d service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:02.225891 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 798/1617] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:13:02 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:13:02.228414 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30024f02-97c6-4c8e-8044-4770ad99b18e None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:02.228681 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30024f02-97c6-4c8e-8044-4770ad99b18e None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:02.229910 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30024f02-97c6-4c8e-8044-4770ad99b18e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:02.252204 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 820/1618] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:13:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:13:02.252952 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ebf7cd-ea6f-4738-9df7-73006c79960d service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:02.264681 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-30024f02-97c6-4c8e-8044-4770ad99b18e None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:13:02.266432 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-30024f02-97c6-4c8e-8044-4770ad99b18e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:02.281016 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 799/1619] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:13:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:13:02.281933 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30024f02-97c6-4c8e-8044-4770ad99b18e None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:02.282954 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ebf7cd-ea6f-4738-9df7-73006c79960d service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:02.294430 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30024f02-97c6-4c8e-8044-4770ad99b18e None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:02.295936 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1b6aa0-2486-4e03-9157-7b7e62668f22 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6480b2f14c37474c89df9fba48f7cd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:02.296578 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1b6aa0-2486-4e03-9157-7b7e62668f22 service nova] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:02.296832 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1b6aa0-2486-4e03-9157-7b7e62668f22 service nova] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:02.297124 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1b6aa0-2486-4e03-9157-7b7e62668f22 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:02.300830 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abb96c8-9f0b-414f-bfde-33d18531673d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:02.301442 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abb96c8-9f0b-414f-bfde-33d18531673d admin admin] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:02.301714 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abb96c8-9f0b-414f-bfde-33d18531673d admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:02.302037 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abb96c8-9f0b-414f-bfde-33d18531673d admin admin] PATH_INFO: `/v3/projects` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:02.303225 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abb96c8-9f0b-414f-bfde-33d18531673d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:02.305611 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abb96c8-9f0b-414f-bfde-33d18531673d admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:02.322801 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:13:02.346810 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 800/1620] 10.222.0.79 () {60 vars in 1153 bytes} [Tue Aug 30 01:13:02 2022] POST /identity/v3/projects => generated 373 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:13:02.347589 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abb96c8-9f0b-414f-bfde-33d18531673d admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:02.388849 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1b6aa0-2486-4e03-9157-7b7e62668f22 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:02.390727 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1b6aa0-2486-4e03-9157-7b7e62668f22 service nova] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:02.402592 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 821/1621] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:13:02 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:13:02.404053 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f3d78f-4ab1-410c-9ad1-189bde30603b None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:02.404340 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f3d78f-4ab1-410c-9ad1-189bde30603b None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:02.404959 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f3d78f-4ab1-410c-9ad1-189bde30603b None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:02.410739 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 822/1622] 10.222.0.79 () {54 vars in 912 bytes} [Tue Aug 30 01:13:02 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:13:02.412252 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f3d78f-4ab1-410c-9ad1-189bde30603b None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:02.449325 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:13:02.479267 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f3d78f-4ab1-410c-9ad1-189bde30603b None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:02.480123 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abb96c8-9f0b-414f-bfde-33d18531673d admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:02.484738 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290cda87-23a4-4313-a98e-4bc8f4686cbb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16e6a0ca26fc4ef892c188ad89a1e132', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:02.485643 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290cda87-23a4-4313-a98e-4bc8f4686cbb service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:02.485643 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290cda87-23a4-4313-a98e-4bc8f4686cbb service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:02.485950 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290cda87-23a4-4313-a98e-4bc8f4686cbb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:02.492028 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91822c1-bf01-4d48-9226-b7332c2d1a1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:02.493798 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91822c1-bf01-4d48-9226-b7332c2d1a1a admin admin] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:02.494086 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91822c1-bf01-4d48-9226-b7332c2d1a1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:02.494359 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91822c1-bf01-4d48-9226-b7332c2d1a1a admin admin] PATH_INFO: `/v3/projects` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:02.497592 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290cda87-23a4-4313-a98e-4bc8f4686cbb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:02.498009 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91822c1-bf01-4d48-9226-b7332c2d1a1a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:02.499157 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290cda87-23a4-4313-a98e-4bc8f4686cbb service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:02.503582 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91822c1-bf01-4d48-9226-b7332c2d1a1a admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:02.512372 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 823/1623] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:13:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:13:02.513854 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290cda87-23a4-4313-a98e-4bc8f4686cbb service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:02.524343 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290cda87-23a4-4313-a98e-4bc8f4686cbb service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:02.531289 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e9a49e-75c9-449b-9976-bbd9707aeddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:02.533898 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e9a49e-75c9-449b-9976-bbd9707aeddc admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:02.534194 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e9a49e-75c9-449b-9976-bbd9707aeddc admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:02.534469 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e9a49e-75c9-449b-9976-bbd9707aeddc admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:02.536776 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e9a49e-75c9-449b-9976-bbd9707aeddc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:02.541995 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e9a49e-75c9-449b-9976-bbd9707aeddc admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:02.565028 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 801/1624] 10.222.0.79 () {60 vars in 1153 bytes} [Tue Aug 30 01:13:02 2022] POST /identity/v3/projects => generated 355 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:13:02.570516 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40e99c0-50ea-4398-9b57-a6fb44276867 None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:02.570796 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40e99c0-50ea-4398-9b57-a6fb44276867 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:02.572327 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40e99c0-50ea-4398-9b57-a6fb44276867 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:02.597513 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 824/1625] 10.222.0.79 () {60 vars in 1144 bytes} [Tue Aug 30 01:13:02 2022] POST /identity/v3/users => generated 293 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:13:02.599720 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e9a49e-75c9-449b-9976-bbd9707aeddc admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:02.603385 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-f40e99c0-50ea-4398-9b57-a6fb44276867 None None] MFA Rules not processed for user `6480b2f14c37474c89df9fba48f7cd91`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:13:02.604811 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-f40e99c0-50ea-4398-9b57-a6fb44276867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:02.634241 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e9a49e-75c9-449b-9976-bbd9707aeddc admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:02.759178 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 802/1626] 10.222.0.79 () {58 vars in 1009 bytes} [Tue Aug 30 01:13:02 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:13:02.761056 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40e99c0-50ea-4398-9b57-a6fb44276867 None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:02.764184 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cf0f5f-efcf-4e50-869e-8e317ebe12ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:02.764504 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cf0f5f-efcf-4e50-869e-8e317ebe12ec admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:02.764796 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cf0f5f-efcf-4e50-869e-8e317ebe12ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:02.765364 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cf0f5f-efcf-4e50-869e-8e317ebe12ec admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:02.765703 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cf0f5f-efcf-4e50-869e-8e317ebe12ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:02.773437 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cf0f5f-efcf-4e50-869e-8e317ebe12ec admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:02.782538 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40e99c0-50ea-4398-9b57-a6fb44276867 None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:02.790519 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860d4591-ed8e-4d4b-995b-e2b494eb39df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:02.791229 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860d4591-ed8e-4d4b-995b-e2b494eb39df admin admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:02.791507 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860d4591-ed8e-4d4b-995b-e2b494eb39df admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:02.791773 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860d4591-ed8e-4d4b-995b-e2b494eb39df admin admin] PATH_INFO: `/v3/roles` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:02.792819 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860d4591-ed8e-4d4b-995b-e2b494eb39df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:02.794559 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860d4591-ed8e-4d4b-995b-e2b494eb39df admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:02.811483 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 803/1627] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:13:02 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:13:02.812863 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860d4591-ed8e-4d4b-995b-e2b494eb39df admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:02.841999 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 825/1628] 10.222.0.79 () {60 vars in 1144 bytes} [Tue Aug 30 01:13:02 2022] POST /identity/v3/users => generated 284 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:13:02.843069 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cf0f5f-efcf-4e50-869e-8e317ebe12ec admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:02.857961 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cf0f5f-efcf-4e50-869e-8e317ebe12ec admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:02.867312 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e4bdcd-0dae-49f9-8370-0b4bd8b72b56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:02.868045 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e4bdcd-0dae-49f9-8370-0b4bd8b72b56 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:02.868333 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e4bdcd-0dae-49f9-8370-0b4bd8b72b56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:02.868601 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e4bdcd-0dae-49f9-8370-0b4bd8b72b56 admin admin] PATH_INFO: `/v3/projects/d652190d15eb4301ab0ec408d493c7aa/users/068d54a76cdd4232807eb857ec4d75ff/roles/d14c3070c9184d76a7b23df69bd3db07` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:02.909594 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e4bdcd-0dae-49f9-8370-0b4bd8b72b56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d652190d15eb4301ab0ec408d493c7aa, user_id=068d54a76cdd4232807eb857ec4d75ff, role_id=d14c3070c9184d76a7b23df69bd3db07)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:02.914280 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e4bdcd-0dae-49f9-8370-0b4bd8b72b56 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:02.932052 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860d4591-ed8e-4d4b-995b-e2b494eb39df admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:02.935110 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 826/1629] 10.222.0.79 () {60 vars in 1483 bytes} [Tue Aug 30 01:13:02 2022] PUT /identity/v3/projects/d652190d15eb4301ab0ec408d493c7aa/users/068d54a76cdd4232807eb857ec4d75ff/roles/d14c3070c9184d76a7b23df69bd3db07 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:13:02.937575 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c35448-507a-4c20-a0d0-e5218eddce51 None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:02.945135 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c35448-507a-4c20-a0d0-e5218eddce51 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:02.945512 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c35448-507a-4c20-a0d0-e5218eddce51 None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:02.946965 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:13:02.947159 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 827/1630] 10.222.0.79 () {54 vars in 912 bytes} [Tue Aug 30 01:13:02 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:13:02.948254 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c35448-507a-4c20-a0d0-e5218eddce51 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:03.013655 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e588ea-2272-4c7a-aefc-24d19c24af6d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f827c7670b74d938ffe066ced88d1c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:03.014486 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e588ea-2272-4c7a-aefc-24d19c24af6d service cinder] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:03.014759 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e588ea-2272-4c7a-aefc-24d19c24af6d service cinder] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:03.015070 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e588ea-2272-4c7a-aefc-24d19c24af6d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:03.102100 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c35448-507a-4c20-a0d0-e5218eddce51 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:03.110368 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d5a417-ce03-4060-81b7-e7cfa73fcf74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:03.111059 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d5a417-ce03-4060-81b7-e7cfa73fcf74 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:03.112119 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d5a417-ce03-4060-81b7-e7cfa73fcf74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:03.113835 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d5a417-ce03-4060-81b7-e7cfa73fcf74 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:03.115575 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d5a417-ce03-4060-81b7-e7cfa73fcf74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:03.121158 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d5a417-ce03-4060-81b7-e7cfa73fcf74 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:03.136813 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 828/1631] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:13:02 2022] GET /identity/v3/roles => generated 1420 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:13:03.151857 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d5a417-ce03-4060-81b7-e7cfa73fcf74 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:03.155867 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e588ea-2272-4c7a-aefc-24d19c24af6d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:03.157930 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e588ea-2272-4c7a-aefc-24d19c24af6d service cinder] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:03.166031 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d5a417-ce03-4060-81b7-e7cfa73fcf74 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:03.171246 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa10dd4-50f3-4af9-a548-77ceb49a4b12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:03.172107 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa10dd4-50f3-4af9-a548-77ceb49a4b12 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:03.172657 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa10dd4-50f3-4af9-a548-77ceb49a4b12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:03.173031 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa10dd4-50f3-4af9-a548-77ceb49a4b12 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:03.173769 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa10dd4-50f3-4af9-a548-77ceb49a4b12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:03.174907 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 804/1632] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:13:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:13:03.177642 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa10dd4-50f3-4af9-a548-77ceb49a4b12 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:03.178771 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e65c424-6206-470d-84c4-b32218763312 None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:03.179102 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e65c424-6206-470d-84c4-b32218763312 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:03.179846 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e65c424-6206-470d-84c4-b32218763312 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:03.194415 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 829/1633] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:13:03 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:13:03.195535 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa10dd4-50f3-4af9-a548-77ceb49a4b12 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:03.201870 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:13:03.211986 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa10dd4-50f3-4af9-a548-77ceb49a4b12 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:03.218973 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594f22c7-1d3a-499d-8a61-92bfb14118a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:03.219975 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594f22c7-1d3a-499d-8a61-92bfb14118a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:03.220517 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594f22c7-1d3a-499d-8a61-92bfb14118a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:03.221055 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594f22c7-1d3a-499d-8a61-92bfb14118a2 admin admin] PATH_INFO: `/v3/projects/0648b7150ea64d6bb4fc185660b3255f/users/59e2562057134e928ff89dec245ce62f/roles/d14c3070c9184d76a7b23df69bd3db07` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:03.233691 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-6e65c424-6206-470d-84c4-b32218763312 None None] MFA Rules not processed for user `6480b2f14c37474c89df9fba48f7cd91`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:13:03.238332 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-6e65c424-6206-470d-84c4-b32218763312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:03.266485 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594f22c7-1d3a-499d-8a61-92bfb14118a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0648b7150ea64d6bb4fc185660b3255f, user_id=59e2562057134e928ff89dec245ce62f, role_id=d14c3070c9184d76a7b23df69bd3db07)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:03.269133 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594f22c7-1d3a-499d-8a61-92bfb14118a2 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:03.276074 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 805/1634] 10.222.0.79 () {58 vars in 1009 bytes} [Tue Aug 30 01:13:03 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:13:03.277131 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e65c424-6206-470d-84c4-b32218763312 None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:03.298341 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 830/1635] 10.222.0.79 () {60 vars in 1483 bytes} [Tue Aug 30 01:13:03 2022] PUT /identity/v3/projects/0648b7150ea64d6bb4fc185660b3255f/users/59e2562057134e928ff89dec245ce62f/roles/d14c3070c9184d76a7b23df69bd3db07 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:13:03.299757 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594f22c7-1d3a-499d-8a61-92bfb14118a2 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:03.302004 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e65c424-6206-470d-84c4-b32218763312 None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:03.389528 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594f22c7-1d3a-499d-8a61-92bfb14118a2 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:03.394095 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005d860a-3421-47fd-8aa2-c968932f1938 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f827c7670b74d938ffe066ced88d1c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:03.394976 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005d860a-3421-47fd-8aa2-c968932f1938 service cinder] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:03.396034 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005d860a-3421-47fd-8aa2-c968932f1938 service cinder] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:03.396659 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005d860a-3421-47fd-8aa2-c968932f1938 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:03.400031 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a2cb95-293d-4718-9f9a-3ffef2c5a345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:03.400762 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a2cb95-293d-4718-9f9a-3ffef2c5a345 admin admin] REQUEST_METHOD: `PUT` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:03.401092 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a2cb95-293d-4718-9f9a-3ffef2c5a345 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:03.402343 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a2cb95-293d-4718-9f9a-3ffef2c5a345 admin admin] PATH_INFO: `/v3/projects/d652190d15eb4301ab0ec408d493c7aa/users/068d54a76cdd4232807eb857ec4d75ff/roles/d14c3070c9184d76a7b23df69bd3db07` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:03.405061 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a2cb95-293d-4718-9f9a-3ffef2c5a345 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d652190d15eb4301ab0ec408d493c7aa, user_id=068d54a76cdd4232807eb857ec4d75ff, role_id=d14c3070c9184d76a7b23df69bd3db07)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:03.408492 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a2cb95-293d-4718-9f9a-3ffef2c5a345 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:03.431315 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 806/1636] 10.222.0.79 () {60 vars in 1483 bytes} [Tue Aug 30 01:13:03 2022] PUT /identity/v3/projects/d652190d15eb4301ab0ec408d493c7aa/users/068d54a76cdd4232807eb857ec4d75ff/roles/d14c3070c9184d76a7b23df69bd3db07 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:13:03.440222 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a2cb95-293d-4718-9f9a-3ffef2c5a345 admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:03.541503 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005d860a-3421-47fd-8aa2-c968932f1938 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:03.543415 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005d860a-3421-47fd-8aa2-c968932f1938 service cinder] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:03.572012 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 831/1637] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:13:03 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:13:03.573927 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10388bce-e2dd-4fc9-970b-6211155c4f9f None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:03.575709 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10388bce-e2dd-4fc9-970b-6211155c4f9f None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:03.578630 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:13:03.579156 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10388bce-e2dd-4fc9-970b-6211155c4f9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:03.625747 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a2cb95-293d-4718-9f9a-3ffef2c5a345 admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:03.640590 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90ab339-6fd5-4e5d-8bbd-35ae6d6ff97d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:03.641666 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90ab339-6fd5-4e5d-8bbd-35ae6d6ff97d admin admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:03.641822 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90ab339-6fd5-4e5d-8bbd-35ae6d6ff97d admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:03.642440 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90ab339-6fd5-4e5d-8bbd-35ae6d6ff97d admin admin] PATH_INFO: `/v3/roles` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:03.643713 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90ab339-6fd5-4e5d-8bbd-35ae6d6ff97d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:03.647216 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90ab339-6fd5-4e5d-8bbd-35ae6d6ff97d admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:03.649807 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-10388bce-e2dd-4fc9-970b-6211155c4f9f None None] MFA Rules not processed for user `068d54a76cdd4232807eb857ec4d75ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:13:03.653591 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-10388bce-e2dd-4fc9-970b-6211155c4f9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:03.686603 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 807/1638] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:13:03 2022] GET /identity/v3/roles => generated 1420 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:13:03.688447 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90ab339-6fd5-4e5d-8bbd-35ae6d6ff97d admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:03.723665 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90ab339-6fd5-4e5d-8bbd-35ae6d6ff97d admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:03.751928 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2399a5c9-7679-4808-ad73-c0e2fde3be64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:03.757067 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2399a5c9-7679-4808-ad73-c0e2fde3be64 admin admin] REQUEST_METHOD: `PUT` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:03.758271 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2399a5c9-7679-4808-ad73-c0e2fde3be64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:03.759655 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2399a5c9-7679-4808-ad73-c0e2fde3be64 admin admin] PATH_INFO: `/v3/projects/0648b7150ea64d6bb4fc185660b3255f/users/59e2562057134e928ff89dec245ce62f/roles/d14c3070c9184d76a7b23df69bd3db07` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:03.770428 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2399a5c9-7679-4808-ad73-c0e2fde3be64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0648b7150ea64d6bb4fc185660b3255f, user_id=59e2562057134e928ff89dec245ce62f, role_id=d14c3070c9184d76a7b23df69bd3db07)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:03.780552 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2399a5c9-7679-4808-ad73-c0e2fde3be64 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:03.816632 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 808/1639] 10.222.0.79 () {60 vars in 1483 bytes} [Tue Aug 30 01:13:03 2022] PUT /identity/v3/projects/0648b7150ea64d6bb4fc185660b3255f/users/59e2562057134e928ff89dec245ce62f/roles/d14c3070c9184d76a7b23df69bd3db07 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:13:03.828050 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc4e5cd-9afb-4b82-b54f-d5b2511ecd5a None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:03.828336 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc4e5cd-9afb-4b82-b54f-d5b2511ecd5a None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:03.828610 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc4e5cd-9afb-4b82-b54f-d5b2511ecd5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:03.838715 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 832/1640] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:13:03 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:13:03.885131 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-cfc4e5cd-9afb-4b82-b54f-d5b2511ecd5a None None] MFA Rules not processed for user `59e2562057134e928ff89dec245ce62f`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:13:03.887055 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-cfc4e5cd-9afb-4b82-b54f-d5b2511ecd5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:04.045251 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 809/1641] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:13:03 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:13:04.292353 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10388bce-e2dd-4fc9-970b-6211155c4f9f None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:04.299613 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:13:04.444956 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10388bce-e2dd-4fc9-970b-6211155c4f9f None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:04.485140 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc4e5cd-9afb-4b82-b54f-d5b2511ecd5a None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:04.508358 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e3f870-edd3-446b-af37-fcb6565ca1c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f827c7670b74d938ffe066ced88d1c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:04.509131 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e3f870-edd3-446b-af37-fcb6565ca1c3 service cinder] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:04.509442 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e3f870-edd3-446b-af37-fcb6565ca1c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:04.509692 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e3f870-edd3-446b-af37-fcb6565ca1c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:04.595734 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc4e5cd-9afb-4b82-b54f-d5b2511ecd5a None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:04.598984 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e3f870-edd3-446b-af37-fcb6565ca1c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:04.603880 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e3f870-edd3-446b-af37-fcb6565ca1c3 service cinder] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:04.607891 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84a5519-acaf-4718-8251-e9ceaaacb352 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f827c7670b74d938ffe066ced88d1c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:04.609067 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84a5519-acaf-4718-8251-e9ceaaacb352 service cinder] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:04.609355 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84a5519-acaf-4718-8251-e9ceaaacb352 service cinder] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:04.609815 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84a5519-acaf-4718-8251-e9ceaaacb352 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:04.618535 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 833/1642] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:13:04 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:13:04.627203 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84a5519-acaf-4718-8251-e9ceaaacb352 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:04.627203 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84a5519-acaf-4718-8251-e9ceaaacb352 service cinder] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:04.643712 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 810/1643] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:13:04 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:13:05.013915 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e3f870-edd3-446b-af37-fcb6565ca1c3 service cinder] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:05.032863 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e3f870-edd3-446b-af37-fcb6565ca1c3 service cinder] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:05.033011 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84a5519-acaf-4718-8251-e9ceaaacb352 service cinder] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:05.041058 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425000bc-f474-400c-b066-5870fc053eb9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f827c7670b74d938ffe066ced88d1c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:05.041623 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425000bc-f474-400c-b066-5870fc053eb9 service cinder] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:05.041918 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425000bc-f474-400c-b066-5870fc053eb9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:05.042194 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425000bc-f474-400c-b066-5870fc053eb9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:05.050584 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84a5519-acaf-4718-8251-e9ceaaacb352 service cinder] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:05.058926 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bd59c1-a078-409e-9611-3c2a5eb58097 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f827c7670b74d938ffe066ced88d1c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:05.059609 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bd59c1-a078-409e-9611-3c2a5eb58097 service cinder] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:05.059893 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bd59c1-a078-409e-9611-3c2a5eb58097 service cinder] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:05.060170 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bd59c1-a078-409e-9611-3c2a5eb58097 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:05.128456 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:13:05.145383 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bd59c1-a078-409e-9611-3c2a5eb58097 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:05.151318 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bd59c1-a078-409e-9611-3c2a5eb58097 service cinder] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:05.178470 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 811/1644] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:13:05 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 01:13:05.216055 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425000bc-f474-400c-b066-5870fc053eb9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:05.217706 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425000bc-f474-400c-b066-5870fc053eb9 service cinder] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:05.252335 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 834/1645] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:13:05 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:13:06.043874 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bd59c1-a078-409e-9611-3c2a5eb58097 service cinder] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:06.249157 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bd59c1-a078-409e-9611-3c2a5eb58097 service cinder] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:06.261279 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a483c6d4-d3fb-4959-848b-1456accb818a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:06.262140 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a483c6d4-d3fb-4959-848b-1456accb818a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:06.262756 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a483c6d4-d3fb-4959-848b-1456accb818a admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:06.263425 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a483c6d4-d3fb-4959-848b-1456accb818a admin admin] PATH_INFO: `/v3/users/d8b89f37494746d98e4fe9954abdb30f` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:06.268960 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a483c6d4-d3fb-4959-848b-1456accb818a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8b89f37494746d98e4fe9954abdb30f)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:06.274974 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a483c6d4-d3fb-4959-848b-1456accb818a admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:06.417046 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-a483c6d4-d3fb-4959-848b-1456accb818a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8b89f37494746d98e4fe9954abdb30f'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:06.458484 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-a483c6d4-d3fb-4959-848b-1456accb818a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8b89f37494746d98e4fe9954abdb30f'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:06.513885 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-a483c6d4-d3fb-4959-848b-1456accb818a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8b89f37494746d98e4fe9954abdb30f'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:06.516464 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-a483c6d4-d3fb-4959-848b-1456accb818a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8b89f37494746d98e4fe9954abdb30f'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:06.540056 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-a483c6d4-d3fb-4959-848b-1456accb818a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8b89f37494746d98e4fe9954abdb30f'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:06.562608 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 812/1646] 10.222.0.79 () {58 vars in 1224 bytes} [Tue Aug 30 01:13:06 2022] DELETE /identity/v3/users/d8b89f37494746d98e4fe9954abdb30f => generated 0 bytes in 555 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:13:06.564456 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9630894-542c-4612-bae9-ea99e8ed9843 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:06.565028 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9630894-542c-4612-bae9-ea99e8ed9843 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:06.565423 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9630894-542c-4612-bae9-ea99e8ed9843 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:06.625123 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-e9630894-542c-4612-bae9-ea99e8ed9843 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:13:06.627709 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-e9630894-542c-4612-bae9-ea99e8ed9843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:06.640667 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:13:06.883490 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 835/1647] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:13:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:13:06.936631 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a483c6d4-d3fb-4959-848b-1456accb818a admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:06.940979 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-a483c6d4-d3fb-4959-848b-1456accb818a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:07.166656 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a483c6d4-d3fb-4959-848b-1456accb818a admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:07.177697 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c957a405-2b3c-4ce0-b225-fc6af8a4a2f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16e6a0ca26fc4ef892c188ad89a1e132', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:07.181132 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c957a405-2b3c-4ce0-b225-fc6af8a4a2f0 service neutron] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:07.181831 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c957a405-2b3c-4ce0-b225-fc6af8a4a2f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:07.182807 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c957a405-2b3c-4ce0-b225-fc6af8a4a2f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:07.209496 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c957a405-2b3c-4ce0-b225-fc6af8a4a2f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:07.214978 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c957a405-2b3c-4ce0-b225-fc6af8a4a2f0 service neutron] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:07.246502 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 813/1648] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:13:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:13:09.435230 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9630894-542c-4612-bae9-ea99e8ed9843 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:09.436769 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-e9630894-542c-4612-bae9-ea99e8ed9843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:09.459631 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9630894-542c-4612-bae9-ea99e8ed9843 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:09.495570 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbffa634-8142-41bc-9a96-036186fa39bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:09.496228 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbffa634-8142-41bc-9a96-036186fa39bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:09.496511 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbffa634-8142-41bc-9a96-036186fa39bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:09.496787 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbffa634-8142-41bc-9a96-036186fa39bc admin admin] PATH_INFO: `/v3/projects/88c8577d35054fa2a6349b2c20a9baff` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:09.502147 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbffa634-8142-41bc-9a96-036186fa39bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=88c8577d35054fa2a6349b2c20a9baff)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:09.504403 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbffa634-8142-41bc-9a96-036186fa39bc admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:09.690974 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-dbffa634-8142-41bc-9a96-036186fa39bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88c8577d35054fa2a6349b2c20a9baff', 'request_id': 'req-dbffa634-8142-41bc-9a96-036186fa39bc'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:09.715595 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-dbffa634-8142-41bc-9a96-036186fa39bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88c8577d35054fa2a6349b2c20a9baff', 'request_id': 'req-dbffa634-8142-41bc-9a96-036186fa39bc'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:09.731846 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-dbffa634-8142-41bc-9a96-036186fa39bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88c8577d35054fa2a6349b2c20a9baff', 'request_id': 'req-dbffa634-8142-41bc-9a96-036186fa39bc'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:09.764910 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-dbffa634-8142-41bc-9a96-036186fa39bc admin admin] The token cache is being invalidate because project 88c8577d35054fa2a6349b2c20a9baff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:13:09.774556 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-dbffa634-8142-41bc-9a96-036186fa39bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:09.776080 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-dbffa634-8142-41bc-9a96-036186fa39bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:09.780413 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 836/1649] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 30 01:13:09 2022] DELETE /identity/v3/projects/88c8577d35054fa2a6349b2c20a9baff => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:13:09.785318 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a851db8-2d55-4c55-8a15-dde2a8c9c59c None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:09.785811 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a851db8-2d55-4c55-8a15-dde2a8c9c59c None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:09.785962 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a851db8-2d55-4c55-8a15-dde2a8c9c59c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:09.841941 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-5a851db8-2d55-4c55-8a15-dde2a8c9c59c None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:13:09.844721 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-5a851db8-2d55-4c55-8a15-dde2a8c9c59c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:09.900717 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:13:10.077667 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 814/1650] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:13:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:13:10.079853 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f781ba-8a3e-43dd-b5ee-d75848870939 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:10.080143 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f781ba-8a3e-43dd-b5ee-d75848870939 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:10.080430 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f781ba-8a3e-43dd-b5ee-d75848870939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:10.158221 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-81f781ba-8a3e-43dd-b5ee-d75848870939 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:13:10.166404 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-81f781ba-8a3e-43dd-b5ee-d75848870939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:10.166932 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a851db8-2d55-4c55-8a15-dde2a8c9c59c None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:10.169194 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-5a851db8-2d55-4c55-8a15-dde2a8c9c59c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:10.198082 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 837/1651] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:13:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:13:10.205183 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a851db8-2d55-4c55-8a15-dde2a8c9c59c None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:10.205396 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f781ba-8a3e-43dd-b5ee-d75848870939 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:10.221233 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b0a0b5-911c-421c-92d9-d244b953e868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:10.228878 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b0a0b5-911c-421c-92d9-d244b953e868 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:10.229606 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b0a0b5-911c-421c-92d9-d244b953e868 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:10.230039 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b0a0b5-911c-421c-92d9-d244b953e868 admin admin] PATH_INFO: `/v3/users/9c8c72f316994b67b735b44086a7a562` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:10.232619 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b0a0b5-911c-421c-92d9-d244b953e868 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c8c72f316994b67b735b44086a7a562)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:10.241249 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b0a0b5-911c-421c-92d9-d244b953e868 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:10.243883 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f781ba-8a3e-43dd-b5ee-d75848870939 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:10.268148 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68eae4e-e44a-4dc9-93e7-01052e43bfb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:10.269137 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68eae4e-e44a-4dc9-93e7-01052e43bfb9 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:10.269572 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68eae4e-e44a-4dc9-93e7-01052e43bfb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:10.275912 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68eae4e-e44a-4dc9-93e7-01052e43bfb9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:10.276777 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68eae4e-e44a-4dc9-93e7-01052e43bfb9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:13:10.277093 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68eae4e-e44a-4dc9-93e7-01052e43bfb9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:10.278719 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68eae4e-e44a-4dc9-93e7-01052e43bfb9 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:10.331962 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 838/1652] 10.222.0.79 () {58 vars in 1153 bytes} [Tue Aug 30 01:13:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:13:10.339541 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68eae4e-e44a-4dc9-93e7-01052e43bfb9 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:10.365098 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-92b0a0b5-911c-421c-92d9-d244b953e868 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c8c72f316994b67b735b44086a7a562'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:10.367761 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68eae4e-e44a-4dc9-93e7-01052e43bfb9 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:10.384146 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-92b0a0b5-911c-421c-92d9-d244b953e868 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c8c72f316994b67b735b44086a7a562'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:10.389873 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770bcfd2-74ac-48c9-929a-1341d43d7556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:10.391488 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770bcfd2-74ac-48c9-929a-1341d43d7556 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:10.394256 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770bcfd2-74ac-48c9-929a-1341d43d7556 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:10.394563 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770bcfd2-74ac-48c9-929a-1341d43d7556 admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:10.395297 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770bcfd2-74ac-48c9-929a-1341d43d7556 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:10.407006 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770bcfd2-74ac-48c9-929a-1341d43d7556 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:10.414678 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-92b0a0b5-911c-421c-92d9-d244b953e868 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c8c72f316994b67b735b44086a7a562'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:10.417130 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-92b0a0b5-911c-421c-92d9-d244b953e868 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c8c72f316994b67b735b44086a7a562'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:10.435534 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-92b0a0b5-911c-421c-92d9-d244b953e868 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c8c72f316994b67b735b44086a7a562'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:10.445904 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 815/1653] 10.222.0.79 () {58 vars in 1224 bytes} [Tue Aug 30 01:13:10 2022] DELETE /identity/v3/users/9c8c72f316994b67b735b44086a7a562 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:13:10.450505 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5f0950-ce28-4313-8a34-4a2c1da3ca07 None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:10.450866 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5f0950-ce28-4313-8a34-4a2c1da3ca07 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:10.451814 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5f0950-ce28-4313-8a34-4a2c1da3ca07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:10.496996 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 839/1654] 10.222.0.79 () {60 vars in 1153 bytes} [Tue Aug 30 01:13:10 2022] POST /identity/v3/projects => generated 403 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:13:10.500074 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770bcfd2-74ac-48c9-929a-1341d43d7556 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:10.502138 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-770bcfd2-74ac-48c9-929a-1341d43d7556 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:10.529276 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-6e5f0950-ce28-4313-8a34-4a2c1da3ca07 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:13:10.533780 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-6e5f0950-ce28-4313-8a34-4a2c1da3ca07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:10.661386 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:13:10.710320 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770bcfd2-74ac-48c9-929a-1341d43d7556 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:10.736818 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 816/1655] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:13:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:13:10.739696 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ee9faa-e40e-4173-970c-9009fecc6ebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:10.741213 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ee9faa-e40e-4173-970c-9009fecc6ebb admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:10.741556 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ee9faa-e40e-4173-970c-9009fecc6ebb admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:10.741833 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ee9faa-e40e-4173-970c-9009fecc6ebb admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:10.742489 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ee9faa-e40e-4173-970c-9009fecc6ebb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:10.749719 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ee9faa-e40e-4173-970c-9009fecc6ebb admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:10.797474 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 840/1656] 10.222.0.79 () {60 vars in 1144 bytes} [Tue Aug 30 01:13:10 2022] POST /identity/v3/users => generated 302 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:13:10.801400 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5f0950-ce28-4313-8a34-4a2c1da3ca07 None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:10.815583 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5f0950-ce28-4313-8a34-4a2c1da3ca07 None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:10.822438 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ccbb2e-446a-41e0-8b33-c55282546a92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:10.823400 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ccbb2e-446a-41e0-8b33-c55282546a92 admin admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:10.823827 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ccbb2e-446a-41e0-8b33-c55282546a92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:10.824508 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ccbb2e-446a-41e0-8b33-c55282546a92 admin admin] PATH_INFO: `/v3/roles` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:10.825501 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ccbb2e-446a-41e0-8b33-c55282546a92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:10.827588 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ccbb2e-446a-41e0-8b33-c55282546a92 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:10.849773 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 817/1657] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:13:10 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:13:10.856723 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ee9faa-e40e-4173-970c-9009fecc6ebb admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:10.876968 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ccbb2e-446a-41e0-8b33-c55282546a92 admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:10.883796 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-a0ccbb2e-446a-41e0-8b33-c55282546a92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:10.884144 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ee9faa-e40e-4173-970c-9009fecc6ebb admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:10.900084 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8d7532-4893-4ae7-ba2a-e5a34f46327e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:10.902417 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8d7532-4893-4ae7-ba2a-e5a34f46327e admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:10.904029 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8d7532-4893-4ae7-ba2a-e5a34f46327e admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:10.907296 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8d7532-4893-4ae7-ba2a-e5a34f46327e admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:10.912647 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8d7532-4893-4ae7-ba2a-e5a34f46327e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:10.922056 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8d7532-4893-4ae7-ba2a-e5a34f46327e admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:10.967221 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 841/1658] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:13:10 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:13:10.968842 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:13:10.970592 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8d7532-4893-4ae7-ba2a-e5a34f46327e admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:11.029447 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8d7532-4893-4ae7-ba2a-e5a34f46327e admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:11.044940 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc9fd94-0a17-4ea1-a211-faed29d4f792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:11.049016 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc9fd94-0a17-4ea1-a211-faed29d4f792 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:11.049187 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc9fd94-0a17-4ea1-a211-faed29d4f792 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:11.049492 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc9fd94-0a17-4ea1-a211-faed29d4f792 admin admin] PATH_INFO: `/v3/projects/6937cb5260464228865b6947ee96cf65/users/856e536265fc443c9a56214fe68ff8bf/roles/c37945a17623465f899d4f217e7af593` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:11.119119 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc9fd94-0a17-4ea1-a211-faed29d4f792 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6937cb5260464228865b6947ee96cf65, user_id=856e536265fc443c9a56214fe68ff8bf, role_id=c37945a17623465f899d4f217e7af593)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:11.132616 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc9fd94-0a17-4ea1-a211-faed29d4f792 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:11.148354 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ccbb2e-446a-41e0-8b33-c55282546a92 admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:11.159881 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d04aa5-1321-40d8-be8b-e5afadb46484 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16e6a0ca26fc4ef892c188ad89a1e132', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:11.165132 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d04aa5-1321-40d8-be8b-e5afadb46484 service neutron] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:11.166478 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d04aa5-1321-40d8-be8b-e5afadb46484 service neutron] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:11.168902 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d04aa5-1321-40d8-be8b-e5afadb46484 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:11.179174 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 842/1659] 10.222.0.79 () {60 vars in 1483 bytes} [Tue Aug 30 01:13:10 2022] PUT /identity/v3/projects/6937cb5260464228865b6947ee96cf65/users/856e536265fc443c9a56214fe68ff8bf/roles/c37945a17623465f899d4f217e7af593 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:13:11.194592 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce37db39-c577-4216-9943-efaeab656fd9 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:11.203851 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce37db39-c577-4216-9943-efaeab656fd9 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:11.203989 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce37db39-c577-4216-9943-efaeab656fd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:11.204999 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d04aa5-1321-40d8-be8b-e5afadb46484 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:11.210183 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d04aa5-1321-40d8-be8b-e5afadb46484 service neutron] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:11.247902 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 818/1660] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:13:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:13:11.299256 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-ce37db39-c577-4216-9943-efaeab656fd9 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:13:11.300508 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-ce37db39-c577-4216-9943-efaeab656fd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:11.522994 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 843/1661] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:13:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:13:11.584500 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d04aa5-1321-40d8-be8b-e5afadb46484 service neutron] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:11.594800 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d04aa5-1321-40d8-be8b-e5afadb46484 service neutron] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:11.751373 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ca4676-7dbb-4082-8744-9e7166c39214 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16e6a0ca26fc4ef892c188ad89a1e132', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:11.752161 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ca4676-7dbb-4082-8744-9e7166c39214 service neutron] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:11.752446 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ca4676-7dbb-4082-8744-9e7166c39214 service neutron] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:11.752718 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ca4676-7dbb-4082-8744-9e7166c39214 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:11.773076 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ca4676-7dbb-4082-8744-9e7166c39214 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:11.774580 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ca4676-7dbb-4082-8744-9e7166c39214 service neutron] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:11.798460 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 819/1662] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:13:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:13:12.728537 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce37db39-c577-4216-9943-efaeab656fd9 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:12.730050 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-ce37db39-c577-4216-9943-efaeab656fd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:12.769695 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce37db39-c577-4216-9943-efaeab656fd9 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:12.792259 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71eb2e3-f898-471f-8540-66dd8eceb705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:12.792927 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71eb2e3-f898-471f-8540-66dd8eceb705 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:12.793213 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71eb2e3-f898-471f-8540-66dd8eceb705 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:12.793467 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71eb2e3-f898-471f-8540-66dd8eceb705 admin admin] PATH_INFO: `/v3/projects/facf0aba2124485882eabed18d4d7bfc` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:12.808978 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71eb2e3-f898-471f-8540-66dd8eceb705 admin admin] RBAC: Authorizing `identity:delete_project(project_id=facf0aba2124485882eabed18d4d7bfc)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:12.815410 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71eb2e3-f898-471f-8540-66dd8eceb705 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:13.004117 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b71eb2e3-f898-471f-8540-66dd8eceb705 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'facf0aba2124485882eabed18d4d7bfc', 'request_id': 'req-b71eb2e3-f898-471f-8540-66dd8eceb705'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:13.060995 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b71eb2e3-f898-471f-8540-66dd8eceb705 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'facf0aba2124485882eabed18d4d7bfc', 'request_id': 'req-b71eb2e3-f898-471f-8540-66dd8eceb705'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:13.088199 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b71eb2e3-f898-471f-8540-66dd8eceb705 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'facf0aba2124485882eabed18d4d7bfc', 'request_id': 'req-b71eb2e3-f898-471f-8540-66dd8eceb705'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:13.117910 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b71eb2e3-f898-471f-8540-66dd8eceb705 admin admin] The token cache is being invalidate because project facf0aba2124485882eabed18d4d7bfc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:13:13.118515 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b71eb2e3-f898-471f-8540-66dd8eceb705 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:13.120148 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b71eb2e3-f898-471f-8540-66dd8eceb705 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:13.128104 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 844/1663] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 30 01:13:12 2022] DELETE /identity/v3/projects/facf0aba2124485882eabed18d4d7bfc => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:13:13.129718 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc3ebac-d638-453d-aacc-c1109aefbdc8 None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:13.130846 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc3ebac-d638-453d-aacc-c1109aefbdc8 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:13.130846 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc3ebac-d638-453d-aacc-c1109aefbdc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:13.208229 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-7fc3ebac-d638-453d-aacc-c1109aefbdc8 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:13:13.209940 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-7fc3ebac-d638-453d-aacc-c1109aefbdc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:13.399806 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 820/1664] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:13:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:13:13.403910 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76725c5-439e-42cc-905e-27977756a559 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:13.404141 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76725c5-439e-42cc-905e-27977756a559 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:13.404417 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76725c5-439e-42cc-905e-27977756a559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:13.451558 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-f76725c5-439e-42cc-905e-27977756a559 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:13:13.452838 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-f76725c5-439e-42cc-905e-27977756a559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:13.469062 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 845/1665] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:13:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:13:13.475911 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc3ebac-d638-453d-aacc-c1109aefbdc8 None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:13.514842 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc3ebac-d638-453d-aacc-c1109aefbdc8 None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:13.525128 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921132e7-3518-4ddd-a95e-a7e09fef49d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:13.528315 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921132e7-3518-4ddd-a95e-a7e09fef49d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:13.528737 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921132e7-3518-4ddd-a95e-a7e09fef49d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:13.529678 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921132e7-3518-4ddd-a95e-a7e09fef49d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:13.530582 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921132e7-3518-4ddd-a95e-a7e09fef49d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:13:13.531006 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921132e7-3518-4ddd-a95e-a7e09fef49d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:13.532834 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921132e7-3518-4ddd-a95e-a7e09fef49d1 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:13.553144 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 821/1666] 10.222.0.79 () {58 vars in 1153 bytes} [Tue Aug 30 01:13:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:13:13.557319 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76725c5-439e-42cc-905e-27977756a559 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:13.582035 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76725c5-439e-42cc-905e-27977756a559 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:13.601114 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f74b6f-f009-46fd-b145-85eb2e254361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:13.602383 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f74b6f-f009-46fd-b145-85eb2e254361 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:13.602673 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f74b6f-f009-46fd-b145-85eb2e254361 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:13.604206 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f74b6f-f009-46fd-b145-85eb2e254361 admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:13.610959 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f74b6f-f009-46fd-b145-85eb2e254361 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:13.634887 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f74b6f-f009-46fd-b145-85eb2e254361 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:13.720948 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=87,keystone:INSERT=6,keystone:DELETE=7 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:13:13.735188 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 846/1667] 10.222.0.79 () {60 vars in 1153 bytes} [Tue Aug 30 01:13:13 2022] POST /identity/v3/projects => generated 373 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:13:13.738080 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921132e7-3518-4ddd-a95e-a7e09fef49d1 admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:13.769255 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921132e7-3518-4ddd-a95e-a7e09fef49d1 admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:13.919571 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:13:13.968332 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cf346e-2319-459d-bddc-951c6f100ef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:13.971270 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cf346e-2319-459d-bddc-951c6f100ef4 admin admin] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:13.971521 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cf346e-2319-459d-bddc-951c6f100ef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:13.971800 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cf346e-2319-459d-bddc-951c6f100ef4 admin admin] PATH_INFO: `/v3/users` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:13.972459 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cf346e-2319-459d-bddc-951c6f100ef4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:13.987033 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cf346e-2319-459d-bddc-951c6f100ef4 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:14.061186 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 822/1668] 10.222.0.79 () {60 vars in 1144 bytes} [Tue Aug 30 01:13:13 2022] POST /identity/v3/users => generated 287 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:13:14.065171 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f74b6f-f009-46fd-b145-85eb2e254361 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:14.078426 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f74b6f-f009-46fd-b145-85eb2e254361 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:14.092969 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4087d4-660d-4cd3-827d-7e5fea63365d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:14.094460 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4087d4-660d-4cd3-827d-7e5fea63365d admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:14.094743 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4087d4-660d-4cd3-827d-7e5fea63365d admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:14.095060 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4087d4-660d-4cd3-827d-7e5fea63365d admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:14.095753 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4087d4-660d-4cd3-827d-7e5fea63365d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:14.097771 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4087d4-660d-4cd3-827d-7e5fea63365d admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:14.116258 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 847/1669] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:13:14 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:13:14.120248 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cf346e-2319-459d-bddc-951c6f100ef4 admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:14.133990 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cf346e-2319-459d-bddc-951c6f100ef4 admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:14.144025 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0251ff-8dc2-4e09-acc6-799ebcbcb722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:14.145179 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0251ff-8dc2-4e09-acc6-799ebcbcb722 admin admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:14.145714 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0251ff-8dc2-4e09-acc6-799ebcbcb722 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:14.146213 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0251ff-8dc2-4e09-acc6-799ebcbcb722 admin admin] PATH_INFO: `/v3/roles` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:14.148134 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0251ff-8dc2-4e09-acc6-799ebcbcb722 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:14.151298 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0251ff-8dc2-4e09-acc6-799ebcbcb722 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:14.167976 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 823/1670] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:13:14 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:13:14.173383 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4087d4-660d-4cd3-827d-7e5fea63365d admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:14.197200 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4087d4-660d-4cd3-827d-7e5fea63365d admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:14.211844 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3fbdb0-084a-4df6-8854-f1ee3ebd2bc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:14.213000 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3fbdb0-084a-4df6-8854-f1ee3ebd2bc5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:14.215773 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3fbdb0-084a-4df6-8854-f1ee3ebd2bc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:14.216238 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3fbdb0-084a-4df6-8854-f1ee3ebd2bc5 admin admin] PATH_INFO: `/v3/projects/e28ceb93e40b413eb3c1c3b9612b0420/users/d080369bb49e40aaae8007a92011a055/roles/c37945a17623465f899d4f217e7af593` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:14.242695 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3fbdb0-084a-4df6-8854-f1ee3ebd2bc5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e28ceb93e40b413eb3c1c3b9612b0420, user_id=d080369bb49e40aaae8007a92011a055, role_id=c37945a17623465f899d4f217e7af593)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:14.249663 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3fbdb0-084a-4df6-8854-f1ee3ebd2bc5 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:14.305526 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 848/1671] 10.222.0.79 () {60 vars in 1483 bytes} [Tue Aug 30 01:13:14 2022] PUT /identity/v3/projects/e28ceb93e40b413eb3c1c3b9612b0420/users/d080369bb49e40aaae8007a92011a055/roles/c37945a17623465f899d4f217e7af593 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:13:14.316864 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554a6432-9628-4f51-b6fc-6ac1cfb0d2ad None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:14.318627 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554a6432-9628-4f51-b6fc-6ac1cfb0d2ad None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:14.319072 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554a6432-9628-4f51-b6fc-6ac1cfb0d2ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:14.402043 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-554a6432-9628-4f51-b6fc-6ac1cfb0d2ad None None] MFA Rules not processed for user `d080369bb49e40aaae8007a92011a055`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:13:14.405175 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-554a6432-9628-4f51-b6fc-6ac1cfb0d2ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:14.684715 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 824/1672] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:13:14 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 369 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:13:14.697024 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3fbdb0-084a-4df6-8854-f1ee3ebd2bc5 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:14.702396 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-3e3fbdb0-084a-4df6-8854-f1ee3ebd2bc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:14.881636 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3fbdb0-084a-4df6-8854-f1ee3ebd2bc5 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:14.888827 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b04025-8672-4b00-a545-a30ad4542fe8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6480b2f14c37474c89df9fba48f7cd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:14.889750 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b04025-8672-4b00-a545-a30ad4542fe8 service nova] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:14.890605 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b04025-8672-4b00-a545-a30ad4542fe8 service nova] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:14.891158 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b04025-8672-4b00-a545-a30ad4542fe8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:14.903668 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b04025-8672-4b00-a545-a30ad4542fe8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:14.905613 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b04025-8672-4b00-a545-a30ad4542fe8 service nova] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:14.918736 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 849/1673] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:13:14 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:13:15.280869 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554a6432-9628-4f51-b6fc-6ac1cfb0d2ad None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:15.316868 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d07d7f0-fa3c-4217-91d9-92656654047b None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:15.317216 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d07d7f0-fa3c-4217-91d9-92656654047b None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:15.317545 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d07d7f0-fa3c-4217-91d9-92656654047b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:15.371143 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-1d07d7f0-fa3c-4217-91d9-92656654047b None None] MFA Rules not processed for user `ef92b49bac944122b2a24db6da89d7f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:13:15.374569 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-1d07d7f0-fa3c-4217-91d9-92656654047b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:15.421307 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554a6432-9628-4f51-b6fc-6ac1cfb0d2ad None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:15.435399 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddad45f5-2aad-47ee-9a4c-229a8ae93d39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:15.436065 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddad45f5-2aad-47ee-9a4c-229a8ae93d39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:15.436347 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddad45f5-2aad-47ee-9a4c-229a8ae93d39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:15.436619 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddad45f5-2aad-47ee-9a4c-229a8ae93d39 admin admin] PATH_INFO: `/v3/users/d080369bb49e40aaae8007a92011a055` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:15.440431 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddad45f5-2aad-47ee-9a4c-229a8ae93d39 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d080369bb49e40aaae8007a92011a055)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:15.442570 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddad45f5-2aad-47ee-9a4c-229a8ae93d39 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:15.539033 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 850/1674] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:13:15 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:13:15.544279 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-ddad45f5-2aad-47ee-9a4c-229a8ae93d39 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd080369bb49e40aaae8007a92011a055'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:15.550965 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d07d7f0-fa3c-4217-91d9-92656654047b None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:15.555573 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-ddad45f5-2aad-47ee-9a4c-229a8ae93d39 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd080369bb49e40aaae8007a92011a055'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:15.559443 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:13:15.574932 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d07d7f0-fa3c-4217-91d9-92656654047b None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:15.590108 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-ddad45f5-2aad-47ee-9a4c-229a8ae93d39 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd080369bb49e40aaae8007a92011a055'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:15.590734 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d435b9ae-8748-4d0a-89d2-19a2ed7ededb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6480b2f14c37474c89df9fba48f7cd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:15.590889 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-ddad45f5-2aad-47ee-9a4c-229a8ae93d39 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd080369bb49e40aaae8007a92011a055'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:15.591408 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d435b9ae-8748-4d0a-89d2-19a2ed7ededb service nova] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:15.591687 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d435b9ae-8748-4d0a-89d2-19a2ed7ededb service nova] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:15.591957 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d435b9ae-8748-4d0a-89d2-19a2ed7ededb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:15.596570 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-d435b9ae-8748-4d0a-89d2-19a2ed7ededb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:15.610971 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-ddad45f5-2aad-47ee-9a4c-229a8ae93d39 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd080369bb49e40aaae8007a92011a055'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:15.617449 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d435b9ae-8748-4d0a-89d2-19a2ed7ededb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:15.619098 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d435b9ae-8748-4d0a-89d2-19a2ed7ededb service nova] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:15.620901 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 825/1675] 10.222.0.79 () {58 vars in 1224 bytes} [Tue Aug 30 01:13:15 2022] DELETE /identity/v3/users/d080369bb49e40aaae8007a92011a055 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:13:15.625097 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5390c53f-007d-4301-96a3-916585402f73 None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:15.625402 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5390c53f-007d-4301-96a3-916585402f73 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:15.625662 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5390c53f-007d-4301-96a3-916585402f73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:15.651545 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 851/1676] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:13:15 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:13:15.668432 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-5390c53f-007d-4301-96a3-916585402f73 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:13:15.669753 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-5390c53f-007d-4301-96a3-916585402f73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:15.773499 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8d8cc1-17c0-42ae-bbc7-a93990727a4d None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:15.773775 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8d8cc1-17c0-42ae-bbc7-a93990727a4d None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:15.774054 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8d8cc1-17c0-42ae-bbc7-a93990727a4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:15.806048 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 826/1677] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:13:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:13:15.875381 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-0f8d8cc1-17c0-42ae-bbc7-a93990727a4d None None] MFA Rules not processed for user `856e536265fc443c9a56214fe68ff8bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:13:15.880066 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-0f8d8cc1-17c0-42ae-bbc7-a93990727a4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:15.885429 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5390c53f-007d-4301-96a3-916585402f73 None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:15.886873 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-5390c53f-007d-4301-96a3-916585402f73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:15.940167 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:13:16.017911 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5390c53f-007d-4301-96a3-916585402f73 None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:16.028077 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc72c79-de03-4f83-91af-b8a6120406c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16e6a0ca26fc4ef892c188ad89a1e132', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:16.028725 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc72c79-de03-4f83-91af-b8a6120406c0 service neutron] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:16.029011 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc72c79-de03-4f83-91af-b8a6120406c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:16.029282 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc72c79-de03-4f83-91af-b8a6120406c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:16.056286 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc72c79-de03-4f83-91af-b8a6120406c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:16.060003 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc72c79-de03-4f83-91af-b8a6120406c0 service neutron] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:16.085678 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 827/1678] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:13:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:13:16.159698 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 852/1679] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:13:15 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 387 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:13:16.165418 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc72c79-de03-4f83-91af-b8a6120406c0 service neutron] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:16.166915 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-4bc72c79-de03-4f83-91af-b8a6120406c0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:16.183571 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc72c79-de03-4f83-91af-b8a6120406c0 service neutron] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:16.191001 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be740676-c244-433c-ab31-af11cfe4fdc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:16.191759 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be740676-c244-433c-ab31-af11cfe4fdc9 admin admin] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:16.192158 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be740676-c244-433c-ab31-af11cfe4fdc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:16.192682 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be740676-c244-433c-ab31-af11cfe4fdc9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:16.194559 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be740676-c244-433c-ab31-af11cfe4fdc9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:16.197049 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be740676-c244-433c-ab31-af11cfe4fdc9 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:16.259422 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8d8cc1-17c0-42ae-bbc7-a93990727a4d None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:16.271627 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 828/1680] 10.222.0.79 () {60 vars in 1153 bytes} [Tue Aug 30 01:13:16 2022] POST /identity/v3/projects => generated 403 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:13:16.276900 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8d8cc1-17c0-42ae-bbc7-a93990727a4d None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:16.394310 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dd6e7b-db4a-4fad-b1c9-c001c7de4d84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:16.398289 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dd6e7b-db4a-4fad-b1c9-c001c7de4d84 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:16.399395 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dd6e7b-db4a-4fad-b1c9-c001c7de4d84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:16.400459 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dd6e7b-db4a-4fad-b1c9-c001c7de4d84 admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:16.401602 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dd6e7b-db4a-4fad-b1c9-c001c7de4d84 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:16.415638 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dd6e7b-db4a-4fad-b1c9-c001c7de4d84 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:16.464105 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 853/1681] 10.222.0.79 () {60 vars in 1144 bytes} [Tue Aug 30 01:13:16 2022] POST /identity/v3/users => generated 308 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:13:16.468586 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be740676-c244-433c-ab31-af11cfe4fdc9 admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:16.481522 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be740676-c244-433c-ab31-af11cfe4fdc9 admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:16.501996 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beae61b6-4610-4727-a9be-470cf94f9e14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:16.502626 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beae61b6-4610-4727-a9be-470cf94f9e14 admin admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:16.502907 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beae61b6-4610-4727-a9be-470cf94f9e14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:16.503200 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beae61b6-4610-4727-a9be-470cf94f9e14 admin admin] PATH_INFO: `/v3/roles` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:16.503863 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beae61b6-4610-4727-a9be-470cf94f9e14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:16.505637 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beae61b6-4610-4727-a9be-470cf94f9e14 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:16.529291 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dd6e7b-db4a-4fad-b1c9-c001c7de4d84 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:16.548646 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 829/1682] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:13:16 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:13:16.552370 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dd6e7b-db4a-4fad-b1c9-c001c7de4d84 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:16.567803 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de0bd36-7849-471e-adf3-b2b18c47c4a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:16.568744 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de0bd36-7849-471e-adf3-b2b18c47c4a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:16.569026 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de0bd36-7849-471e-adf3-b2b18c47c4a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:16.569441 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de0bd36-7849-471e-adf3-b2b18c47c4a7 admin admin] PATH_INFO: `/v3/projects/479e083d4cb94f4c964fac9016f69644/users/4dda782150f3457e8576ecf7a091292b/roles/d14c3070c9184d76a7b23df69bd3db07` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:16.617168 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de0bd36-7849-471e-adf3-b2b18c47c4a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=479e083d4cb94f4c964fac9016f69644, user_id=4dda782150f3457e8576ecf7a091292b, role_id=d14c3070c9184d76a7b23df69bd3db07)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:16.622068 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de0bd36-7849-471e-adf3-b2b18c47c4a7 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:16.663857 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beae61b6-4610-4727-a9be-470cf94f9e14 admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:16.667245 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 854/1683] 10.222.0.79 () {60 vars in 1483 bytes} [Tue Aug 30 01:13:16 2022] PUT /identity/v3/projects/479e083d4cb94f4c964fac9016f69644/users/4dda782150f3457e8576ecf7a091292b/roles/d14c3070c9184d76a7b23df69bd3db07 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:13:16.677333 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beae61b6-4610-4727-a9be-470cf94f9e14 admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:16.805163 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:13:16.848014 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5bac22-5f69-405b-b33e-344450fa57fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:16.849507 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5bac22-5f69-405b-b33e-344450fa57fc admin admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:16.850789 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5bac22-5f69-405b-b33e-344450fa57fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:16.851238 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5bac22-5f69-405b-b33e-344450fa57fc admin admin] PATH_INFO: `/v3/roles` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:16.853381 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5bac22-5f69-405b-b33e-344450fa57fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:16.859210 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5bac22-5f69-405b-b33e-344450fa57fc admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:16.892183 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de0bd36-7849-471e-adf3-b2b18c47c4a7 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:16.899621 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 830/1684] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:13:16 2022] GET /identity/v3/roles => generated 1420 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:13:16.906221 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de0bd36-7849-471e-adf3-b2b18c47c4a7 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:16.921108 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253d2d36-1654-40b1-983b-9b86c182aab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:16.922829 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253d2d36-1654-40b1-983b-9b86c182aab1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:16.924136 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253d2d36-1654-40b1-983b-9b86c182aab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:16.924650 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253d2d36-1654-40b1-983b-9b86c182aab1 admin admin] PATH_INFO: `/v3/projects/479e083d4cb94f4c964fac9016f69644/users/4dda782150f3457e8576ecf7a091292b/roles/d14c3070c9184d76a7b23df69bd3db07` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:16.930746 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253d2d36-1654-40b1-983b-9b86c182aab1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=479e083d4cb94f4c964fac9016f69644, user_id=4dda782150f3457e8576ecf7a091292b, role_id=d14c3070c9184d76a7b23df69bd3db07)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:16.940710 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253d2d36-1654-40b1-983b-9b86c182aab1 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:16.981068 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 855/1685] 10.222.0.79 () {60 vars in 1483 bytes} [Tue Aug 30 01:13:16 2022] PUT /identity/v3/projects/479e083d4cb94f4c964fac9016f69644/users/4dda782150f3457e8576ecf7a091292b/roles/d14c3070c9184d76a7b23df69bd3db07 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:13:17.689590 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9a6fa1-0fb5-4569-9f65-86f3e7a6878b None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:17.690220 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9a6fa1-0fb5-4569-9f65-86f3e7a6878b None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:17.690220 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9a6fa1-0fb5-4569-9f65-86f3e7a6878b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:17.773365 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-0c9a6fa1-0fb5-4569-9f65-86f3e7a6878b None None] MFA Rules not processed for user `3f1b91d3b73646c58cb2f49b416961f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:13:17.774863 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-0c9a6fa1-0fb5-4569-9f65-86f3e7a6878b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:17.963934 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90bccd2-30e4-48ce-93f0-f24876e30a5a None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:17.964499 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90bccd2-30e4-48ce-93f0-f24876e30a5a None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:17.964499 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90bccd2-30e4-48ce-93f0-f24876e30a5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:17.968369 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 831/1686] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:13:17 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:13:18.002180 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-e90bccd2-30e4-48ce-93f0-f24876e30a5a None None] MFA Rules not processed for user `3f1b91d3b73646c58cb2f49b416961f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:13:18.003593 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-e90bccd2-30e4-48ce-93f0-f24876e30a5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:18.044329 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 856/1687] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:13:17 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:13:18.072962 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9a6fa1-0fb5-4569-9f65-86f3e7a6878b None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:18.074663 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-0c9a6fa1-0fb5-4569-9f65-86f3e7a6878b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:18.310453 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9a6fa1-0fb5-4569-9f65-86f3e7a6878b None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:18.322263 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e5c753-5994-4018-b159-3fa8ab6b3e4b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6480b2f14c37474c89df9fba48f7cd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:18.323841 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e5c753-5994-4018-b159-3fa8ab6b3e4b service nova] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:18.331260 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e5c753-5994-4018-b159-3fa8ab6b3e4b service nova] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:18.331920 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e5c753-5994-4018-b159-3fa8ab6b3e4b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:18.367517 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e5c753-5994-4018-b159-3fa8ab6b3e4b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:18.369587 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e5c753-5994-4018-b159-3fa8ab6b3e4b service nova] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:18.422379 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 832/1688] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:13:18 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:13:18.466166 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90bccd2-30e4-48ce-93f0-f24876e30a5a None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:18.470374 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-e90bccd2-30e4-48ce-93f0-f24876e30a5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:18.907011 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90bccd2-30e4-48ce-93f0-f24876e30a5a None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:18.936754 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e192d8-d5e6-41d7-8291-07b181bf23e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:18.936754 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e192d8-d5e6-41d7-8291-07b181bf23e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:18.936754 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e192d8-d5e6-41d7-8291-07b181bf23e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:18.936754 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e192d8-d5e6-41d7-8291-07b181bf23e5 admin admin] PATH_INFO: `/v3/projects/e28ceb93e40b413eb3c1c3b9612b0420` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:18.952239 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e192d8-d5e6-41d7-8291-07b181bf23e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e28ceb93e40b413eb3c1c3b9612b0420)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:18.963117 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e192d8-d5e6-41d7-8291-07b181bf23e5 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:18.972936 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:13:19.209263 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b3e192d8-d5e6-41d7-8291-07b181bf23e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e28ceb93e40b413eb3c1c3b9612b0420', 'request_id': 'req-b3e192d8-d5e6-41d7-8291-07b181bf23e5'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:19.233815 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b3e192d8-d5e6-41d7-8291-07b181bf23e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e28ceb93e40b413eb3c1c3b9612b0420', 'request_id': 'req-b3e192d8-d5e6-41d7-8291-07b181bf23e5'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:19.250095 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b3e192d8-d5e6-41d7-8291-07b181bf23e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e28ceb93e40b413eb3c1c3b9612b0420', 'request_id': 'req-b3e192d8-d5e6-41d7-8291-07b181bf23e5'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:19.289917 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b3e192d8-d5e6-41d7-8291-07b181bf23e5 admin admin] The token cache is being invalidate because project e28ceb93e40b413eb3c1c3b9612b0420 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:13:19.290226 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b3e192d8-d5e6-41d7-8291-07b181bf23e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:19.292615 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b3e192d8-d5e6-41d7-8291-07b181bf23e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:19.297960 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 857/1689] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 30 01:13:18 2022] DELETE /identity/v3/projects/e28ceb93e40b413eb3c1c3b9612b0420 => generated 0 bytes in 834 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:13:19.303348 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6a9024-2eda-473c-bcf2-9ff4a001d925 None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:19.303796 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6a9024-2eda-473c-bcf2-9ff4a001d925 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:19.303898 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6a9024-2eda-473c-bcf2-9ff4a001d925 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:19.351415 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-8c6a9024-2eda-473c-bcf2-9ff4a001d925 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:13:19.353585 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-8c6a9024-2eda-473c-bcf2-9ff4a001d925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:19.445100 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:13:19.467313 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 833/1690] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:13:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:13:19.468999 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ef0770-0418-499b-829f-66cf0bc03ff3 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:19.469623 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ef0770-0418-499b-829f-66cf0bc03ff3 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:19.470441 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ef0770-0418-499b-829f-66cf0bc03ff3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:19.517350 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-44ef0770-0418-499b-829f-66cf0bc03ff3 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:13:19.522828 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-44ef0770-0418-499b-829f-66cf0bc03ff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:19.551032 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 858/1691] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:13:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:13:19.554214 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6a9024-2eda-473c-bcf2-9ff4a001d925 None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:19.589095 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6a9024-2eda-473c-bcf2-9ff4a001d925 None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:19.602385 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c9ae05-7ff7-4f8d-a00b-c5447ea7ca72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:19.603553 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c9ae05-7ff7-4f8d-a00b-c5447ea7ca72 admin admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:19.604024 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c9ae05-7ff7-4f8d-a00b-c5447ea7ca72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:19.604520 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c9ae05-7ff7-4f8d-a00b-c5447ea7ca72 admin admin] PATH_INFO: `/v3/domains` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:19.605445 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c9ae05-7ff7-4f8d-a00b-c5447ea7ca72 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:13:19.606567 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c9ae05-7ff7-4f8d-a00b-c5447ea7ca72 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:19.608763 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c9ae05-7ff7-4f8d-a00b-c5447ea7ca72 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:19.694654 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 834/1692] 10.222.0.79 () {58 vars in 1153 bytes} [Tue Aug 30 01:13:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:13:19.699230 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ef0770-0418-499b-829f-66cf0bc03ff3 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:19.710663 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ef0770-0418-499b-829f-66cf0bc03ff3 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:19.716220 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4cb774-bc05-4170-a2aa-eb4f0f1aa152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:19.716854 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4cb774-bc05-4170-a2aa-eb4f0f1aa152 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:19.717133 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4cb774-bc05-4170-a2aa-eb4f0f1aa152 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:19.717403 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4cb774-bc05-4170-a2aa-eb4f0f1aa152 admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:19.718055 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4cb774-bc05-4170-a2aa-eb4f0f1aa152 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:19.720033 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4cb774-bc05-4170-a2aa-eb4f0f1aa152 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:19.770507 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 859/1693] 10.222.0.79 () {60 vars in 1153 bytes} [Tue Aug 30 01:13:19 2022] POST /identity/v3/projects => generated 367 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:13:19.772432 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c9ae05-7ff7-4f8d-a00b-c5447ea7ca72 admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:19.783110 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c9ae05-7ff7-4f8d-a00b-c5447ea7ca72 admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:19.964334 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4bede9-4efd-4c91-a2af-846e0990dc62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:19.965590 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4bede9-4efd-4c91-a2af-846e0990dc62 admin admin] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:19.965875 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4bede9-4efd-4c91-a2af-846e0990dc62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:19.966266 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4bede9-4efd-4c91-a2af-846e0990dc62 admin admin] PATH_INFO: `/v3/users` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:19.978242 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4bede9-4efd-4c91-a2af-846e0990dc62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:19.992471 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4bede9-4efd-4c91-a2af-846e0990dc62 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:20.057003 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 835/1694] 10.222.0.79 () {60 vars in 1144 bytes} [Tue Aug 30 01:13:19 2022] POST /identity/v3/users => generated 284 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:13:20.058230 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4cb774-bc05-4170-a2aa-eb4f0f1aa152 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:20.085229 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4cb774-bc05-4170-a2aa-eb4f0f1aa152 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:20.104058 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dd66c1-ce5a-4c73-b625-3f7c37b1f549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:20.104854 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dd66c1-ce5a-4c73-b625-3f7c37b1f549 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:20.105574 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dd66c1-ce5a-4c73-b625-3f7c37b1f549 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:20.106111 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dd66c1-ce5a-4c73-b625-3f7c37b1f549 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:20.107704 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dd66c1-ce5a-4c73-b625-3f7c37b1f549 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:20.109577 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dd66c1-ce5a-4c73-b625-3f7c37b1f549 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:20.127412 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 860/1695] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:13:20 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:13:20.132434 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4bede9-4efd-4c91-a2af-846e0990dc62 admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:20.147112 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4bede9-4efd-4c91-a2af-846e0990dc62 admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:20.173601 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc96dd1-000d-48ab-aba6-ebc593157faa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:20.174531 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc96dd1-000d-48ab-aba6-ebc593157faa admin admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:20.174950 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc96dd1-000d-48ab-aba6-ebc593157faa admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:20.176106 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc96dd1-000d-48ab-aba6-ebc593157faa admin admin] PATH_INFO: `/v3/roles` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:20.181229 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc96dd1-000d-48ab-aba6-ebc593157faa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:20.186224 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc96dd1-000d-48ab-aba6-ebc593157faa admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:20.253679 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dd66c1-ce5a-4c73-b625-3f7c37b1f549 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:20.253893 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 836/1696] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:13:20 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:13:20.288203 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dd66c1-ce5a-4c73-b625-3f7c37b1f549 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:20.315264 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13214c87-4bee-46f6-a878-51430085308c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:20.316267 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13214c87-4bee-46f6-a878-51430085308c admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:20.316690 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13214c87-4bee-46f6-a878-51430085308c admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:20.317279 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13214c87-4bee-46f6-a878-51430085308c admin admin] PATH_INFO: `/v3/projects/a7182621307040cf880361b6b8b03d5a/users/e05f2ea0c47541cf88d91429173650e4/roles/c37945a17623465f899d4f217e7af593` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:20.351961 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13214c87-4bee-46f6-a878-51430085308c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7182621307040cf880361b6b8b03d5a, user_id=e05f2ea0c47541cf88d91429173650e4, role_id=c37945a17623465f899d4f217e7af593)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:20.354661 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13214c87-4bee-46f6-a878-51430085308c admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:20.386238 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 861/1697] 10.222.0.79 () {60 vars in 1483 bytes} [Tue Aug 30 01:13:20 2022] PUT /identity/v3/projects/a7182621307040cf880361b6b8b03d5a/users/e05f2ea0c47541cf88d91429173650e4/roles/c37945a17623465f899d4f217e7af593 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:13:20.396657 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de55da8-f896-4dda-8ea4-1a8f05bd3813 None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:20.397153 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de55da8-f896-4dda-8ea4-1a8f05bd3813 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:20.397232 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de55da8-f896-4dda-8ea4-1a8f05bd3813 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:20.431381 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6010b4b0-2745-427c-86a3-aee7a6c6264a None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:20.431673 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6010b4b0-2745-427c-86a3-aee7a6c6264a None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:20.431948 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6010b4b0-2745-427c-86a3-aee7a6c6264a None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:20.433390 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 862/1698] 10.222.0.79 () {54 vars in 912 bytes} [Tue Aug 30 01:13:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 01:13:20.439517 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfd756b-cec6-441e-b763-64cb90227646 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:20.439795 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfd756b-cec6-441e-b763-64cb90227646 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:20.440222 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfd756b-cec6-441e-b763-64cb90227646 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:20.498661 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-9de55da8-f896-4dda-8ea4-1a8f05bd3813 None None] MFA Rules not processed for user `e05f2ea0c47541cf88d91429173650e4`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:13:20.499952 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-9de55da8-f896-4dda-8ea4-1a8f05bd3813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:20.557750 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-bbfd756b-cec6-441e-b763-64cb90227646 None None] MFA Rules not processed for user `16e6a0ca26fc4ef892c188ad89a1e132`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:13:20.559084 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-bbfd756b-cec6-441e-b763-64cb90227646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:20.686904 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 837/1699] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:13:20 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:13:20.687967 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de55da8-f896-4dda-8ea4-1a8f05bd3813 None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:20.797687 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:13:20.809733 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 863/1700] 10.222.0.79 () {58 vars in 1009 bytes} [Tue Aug 30 01:13:20 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 370 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:13:20.823537 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de55da8-f896-4dda-8ea4-1a8f05bd3813 None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:20.830249 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3314e8d-6cd5-41de-8eb2-920a6d2aed4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:20.830853 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3314e8d-6cd5-41de-8eb2-920a6d2aed4b admin admin] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:20.831212 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3314e8d-6cd5-41de-8eb2-920a6d2aed4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:20.831431 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3314e8d-6cd5-41de-8eb2-920a6d2aed4b admin admin] PATH_INFO: `/v3/projects` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:20.832295 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3314e8d-6cd5-41de-8eb2-920a6d2aed4b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:20.835097 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3314e8d-6cd5-41de-8eb2-920a6d2aed4b admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:20.862281 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfd756b-cec6-441e-b763-64cb90227646 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:20.864324 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-bbfd756b-cec6-441e-b763-64cb90227646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:20.880889 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfd756b-cec6-441e-b763-64cb90227646 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:20.888759 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545efa55-51ac-45e4-baa2-440e7db3f3ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16e6a0ca26fc4ef892c188ad89a1e132', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:20.889384 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545efa55-51ac-45e4-baa2-440e7db3f3ad service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:20.889658 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545efa55-51ac-45e4-baa2-440e7db3f3ad service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:20.889925 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545efa55-51ac-45e4-baa2-440e7db3f3ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:20.890767 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 838/1701] 10.222.0.79 () {60 vars in 1153 bytes} [Tue Aug 30 01:13:20 2022] POST /identity/v3/projects => generated 367 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:13:20.892221 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3314e8d-6cd5-41de-8eb2-920a6d2aed4b admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:20.909075 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545efa55-51ac-45e4-baa2-440e7db3f3ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:20.915407 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545efa55-51ac-45e4-baa2-440e7db3f3ad service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:20.940555 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 864/1702] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:13:20 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:13:20.951702 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b28b30-9092-4cc8-9056-b9aadee71bff None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:20.951980 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b28b30-9092-4cc8-9056-b9aadee71bff None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:20.952255 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b28b30-9092-4cc8-9056-b9aadee71bff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:21.009718 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:13:21.050941 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-98b28b30-9092-4cc8-9056-b9aadee71bff None None] MFA Rules not processed for user `5b55e7ed5f194f4dabd56b80573aa3c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:13:21.072118 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-98b28b30-9092-4cc8-9056-b9aadee71bff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:21.099260 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3314e8d-6cd5-41de-8eb2-920a6d2aed4b admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:21.118267 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d821ec4-5287-474e-b5d1-c7e63ad01d75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:21.118906 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d821ec4-5287-474e-b5d1-c7e63ad01d75 admin admin] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:21.120699 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d821ec4-5287-474e-b5d1-c7e63ad01d75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:21.121011 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d821ec4-5287-474e-b5d1-c7e63ad01d75 admin admin] PATH_INFO: `/v3/users` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:21.126563 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d821ec4-5287-474e-b5d1-c7e63ad01d75 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:21.134058 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d821ec4-5287-474e-b5d1-c7e63ad01d75 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:21.206654 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 839/1703] 10.222.0.79 () {60 vars in 1144 bytes} [Tue Aug 30 01:13:20 2022] POST /identity/v3/users => generated 290 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:13:21.212005 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c000fe65-efd5-490b-b493-da8a0d17a776 None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:21.212293 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c000fe65-efd5-490b-b493-da8a0d17a776 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:21.212837 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c000fe65-efd5-490b-b493-da8a0d17a776 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:21.283297 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 865/1704] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:13:20 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 333 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:13:21.284274 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b28b30-9092-4cc8-9056-b9aadee71bff None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:21.285756 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-c000fe65-efd5-490b-b493-da8a0d17a776 None None] MFA Rules not processed for user `3ddcdbd4269c44c9b9e8d1c109de061f`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:13:21.287270 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-c000fe65-efd5-490b-b493-da8a0d17a776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:21.319316 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b28b30-9092-4cc8-9056-b9aadee71bff None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:21.343367 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e17644-acb8-4d1f-a98b-edd197635d3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:21.344370 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e17644-acb8-4d1f-a98b-edd197635d3d admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:21.354406 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e17644-acb8-4d1f-a98b-edd197635d3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:21.355007 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e17644-acb8-4d1f-a98b-edd197635d3d admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:21.356026 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e17644-acb8-4d1f-a98b-edd197635d3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:21.358505 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e17644-acb8-4d1f-a98b-edd197635d3d admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:21.372887 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 866/1705] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:13:21 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:13:21.378715 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd86bbfe-277f-46bb-b8b0-dfbdcbadeb4b None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:21.379394 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd86bbfe-277f-46bb-b8b0-dfbdcbadeb4b None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:21.381083 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd86bbfe-277f-46bb-b8b0-dfbdcbadeb4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:21.410163 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-bd86bbfe-277f-46bb-b8b0-dfbdcbadeb4b None None] MFA Rules not processed for user `5b55e7ed5f194f4dabd56b80573aa3c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:13:21.411502 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-bd86bbfe-277f-46bb-b8b0-dfbdcbadeb4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:21.431591 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 840/1706] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:13:21 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:13:21.432525 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c000fe65-efd5-490b-b493-da8a0d17a776 None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:21.444262 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 867/1707] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:13:21 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:13:21.449940 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd86bbfe-277f-46bb-b8b0-dfbdcbadeb4b None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:21.452160 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-bd86bbfe-277f-46bb-b8b0-dfbdcbadeb4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:21.454578 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c000fe65-efd5-490b-b493-da8a0d17a776 None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:21.473085 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d04a083-de1c-43c3-91fe-9e60d139bf38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:21.473897 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d04a083-de1c-43c3-91fe-9e60d139bf38 admin admin] REQUEST_METHOD: `PUT` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:21.474170 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d04a083-de1c-43c3-91fe-9e60d139bf38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:21.474596 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d04a083-de1c-43c3-91fe-9e60d139bf38 admin admin] PATH_INFO: `/v3/projects/4eb82afe0ac24d4e84a5f1ef1108e7cc/users/eb7112de7f0544eaa74044c7f1007940/roles/d14c3070c9184d76a7b23df69bd3db07` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:21.506742 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d04a083-de1c-43c3-91fe-9e60d139bf38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4eb82afe0ac24d4e84a5f1ef1108e7cc, user_id=eb7112de7f0544eaa74044c7f1007940, role_id=d14c3070c9184d76a7b23df69bd3db07)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:21.509494 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d04a083-de1c-43c3-91fe-9e60d139bf38 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:21.536485 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 841/1708] 10.222.0.79 () {60 vars in 1483 bytes} [Tue Aug 30 01:13:21 2022] PUT /identity/v3/projects/4eb82afe0ac24d4e84a5f1ef1108e7cc/users/eb7112de7f0544eaa74044c7f1007940/roles/d14c3070c9184d76a7b23df69bd3db07 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:13:21.540944 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d04a083-de1c-43c3-91fe-9e60d139bf38 admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:21.630771 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:13:21.636457 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd86bbfe-277f-46bb-b8b0-dfbdcbadeb4b None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:21.695857 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d04a083-de1c-43c3-91fe-9e60d139bf38 admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:21.710569 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632c21b4-c6b1-481b-ad6b-589bcc6401e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:21.712034 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632c21b4-c6b1-481b-ad6b-589bcc6401e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:21.714378 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632c21b4-c6b1-481b-ad6b-589bcc6401e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:21.714674 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632c21b4-c6b1-481b-ad6b-589bcc6401e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:21.715585 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632c21b4-c6b1-481b-ad6b-589bcc6401e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:21.736680 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632c21b4-c6b1-481b-ad6b-589bcc6401e8 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:21.775684 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5850b9b4-c93a-4b6f-8007-6bc3bc6fe644 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6480b2f14c37474c89df9fba48f7cd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:21.776302 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5850b9b4-c93a-4b6f-8007-6bc3bc6fe644 service nova] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:21.776577 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5850b9b4-c93a-4b6f-8007-6bc3bc6fe644 service nova] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:21.776846 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5850b9b4-c93a-4b6f-8007-6bc3bc6fe644 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:21.809626 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:13:21.829609 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 842/1709] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:13:21 2022] GET /identity/v3/roles => generated 1420 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 01:13:21.831187 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632c21b4-c6b1-481b-ad6b-589bcc6401e8 admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:21.847321 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-632c21b4-c6b1-481b-ad6b-589bcc6401e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:21.885483 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632c21b4-c6b1-481b-ad6b-589bcc6401e8 admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:21.903008 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674c7aff-1692-4104-80d7-2e723cbff56e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6480b2f14c37474c89df9fba48f7cd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:21.903762 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674c7aff-1692-4104-80d7-2e723cbff56e service nova] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:21.904057 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674c7aff-1692-4104-80d7-2e723cbff56e service nova] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:21.904352 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674c7aff-1692-4104-80d7-2e723cbff56e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:21.905748 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5850b9b4-c93a-4b6f-8007-6bc3bc6fe644 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:21.909817 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5850b9b4-c93a-4b6f-8007-6bc3bc6fe644 service nova] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:21.941981 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 868/1710] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:13:21 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 492 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:13:21.943670 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5850b9b4-c93a-4b6f-8007-6bc3bc6fe644 service nova] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:21.974392 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5850b9b4-c93a-4b6f-8007-6bc3bc6fe644 service nova] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:21.994072 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6af23f4-bfee-40e6-959f-3b4ee806769f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:21.996812 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6af23f4-bfee-40e6-959f-3b4ee806769f admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:21.997271 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6af23f4-bfee-40e6-959f-3b4ee806769f admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:21.997678 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6af23f4-bfee-40e6-959f-3b4ee806769f admin admin] PATH_INFO: `/v3/projects/4eb82afe0ac24d4e84a5f1ef1108e7cc/users/eb7112de7f0544eaa74044c7f1007940/roles/d14c3070c9184d76a7b23df69bd3db07` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:22.005460 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6af23f4-bfee-40e6-959f-3b4ee806769f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4eb82afe0ac24d4e84a5f1ef1108e7cc, user_id=eb7112de7f0544eaa74044c7f1007940, role_id=d14c3070c9184d76a7b23df69bd3db07)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:22.011272 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6af23f4-bfee-40e6-959f-3b4ee806769f admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:22.039331 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674c7aff-1692-4104-80d7-2e723cbff56e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:22.050318 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 869/1711] 10.222.0.79 () {60 vars in 1483 bytes} [Tue Aug 30 01:13:21 2022] PUT /identity/v3/projects/4eb82afe0ac24d4e84a5f1ef1108e7cc/users/eb7112de7f0544eaa74044c7f1007940/roles/d14c3070c9184d76a7b23df69bd3db07 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:13:22.050318 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965ce8cd-398a-45a4-a336-29625a0e0055 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:22.050318 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965ce8cd-398a-45a4-a336-29625a0e0055 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:22.050318 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965ce8cd-398a-45a4-a336-29625a0e0055 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:22.055038 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674c7aff-1692-4104-80d7-2e723cbff56e service nova] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:22.089915 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 843/1712] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:13:21 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:13:22.091084 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674c7aff-1692-4104-80d7-2e723cbff56e service nova] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:22.099718 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-674c7aff-1692-4104-80d7-2e723cbff56e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:22.137413 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-965ce8cd-398a-45a4-a336-29625a0e0055 None None] MFA Rules not processed for user `4dda782150f3457e8576ecf7a091292b`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:13:22.140429 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-965ce8cd-398a-45a4-a336-29625a0e0055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:22.345158 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674c7aff-1692-4104-80d7-2e723cbff56e service nova] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:22.424245 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 870/1713] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:13:22 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 383 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:13:22.428564 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d7f60f-77e4-4667-8e43-b2b00fae8bfe None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:22.428564 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d7f60f-77e4-4667-8e43-b2b00fae8bfe None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:22.428564 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d7f60f-77e4-4667-8e43-b2b00fae8bfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:22.492360 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-12d7f60f-77e4-4667-8e43-b2b00fae8bfe None None] MFA Rules not processed for user `eb7112de7f0544eaa74044c7f1007940`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:13:22.496801 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-12d7f60f-77e4-4667-8e43-b2b00fae8bfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:22.520395 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727880e9-b0a7-4de5-aa9c-9584652dc89f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd68e91e4259e449797fb83de548aec1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:22.521664 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727880e9-b0a7-4de5-aa9c-9584652dc89f service placement] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:22.524536 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727880e9-b0a7-4de5-aa9c-9584652dc89f service placement] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:22.526232 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727880e9-b0a7-4de5-aa9c-9584652dc89f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:22.532950 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-727880e9-b0a7-4de5-aa9c-9584652dc89f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:22.586025 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727880e9-b0a7-4de5-aa9c-9584652dc89f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:22.593540 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727880e9-b0a7-4de5-aa9c-9584652dc89f service placement] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:22.613491 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:13:22.628065 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 844/1714] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:13:22 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 535 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:13:22.632557 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eba245-8b1e-41dd-b32c-bf11fd100067 None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:22.632844 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eba245-8b1e-41dd-b32c-bf11fd100067 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:22.633117 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eba245-8b1e-41dd-b32c-bf11fd100067 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:22.637819 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 871/1715] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:13:22 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:13:22.639803 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cc20aa-7b1c-40d7-9537-ff3f97b95e7d None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:22.640612 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cc20aa-7b1c-40d7-9537-ff3f97b95e7d None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:22.641106 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cc20aa-7b1c-40d7-9537-ff3f97b95e7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:22.686619 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-86cc20aa-7b1c-40d7-9537-ff3f97b95e7d None None] MFA Rules not processed for user `3f1b91d3b73646c58cb2f49b416961f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:13:22.688714 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-86cc20aa-7b1c-40d7-9537-ff3f97b95e7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:22.706819 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-d8eba245-8b1e-41dd-b32c-bf11fd100067 None None] MFA Rules not processed for user `ef92b49bac944122b2a24db6da89d7f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:13:22.708902 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-d8eba245-8b1e-41dd-b32c-bf11fd100067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:22.725985 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:13:22.840763 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 872/1716] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:13:22 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:13:22.842413 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cc20aa-7b1c-40d7-9537-ff3f97b95e7d None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:22.844134 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-86cc20aa-7b1c-40d7-9537-ff3f97b95e7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:22.904932 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 845/1717] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:13:22 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:13:23.105508 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cc20aa-7b1c-40d7-9537-ff3f97b95e7d None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:23.129999 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36e90b7-3378-49aa-9f65-3257afc13e07 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f827c7670b74d938ffe066ced88d1c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:23.131022 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36e90b7-3378-49aa-9f65-3257afc13e07 service cinder] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:23.131412 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36e90b7-3378-49aa-9f65-3257afc13e07 service cinder] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:23.131770 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36e90b7-3378-49aa-9f65-3257afc13e07 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:23.177981 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36e90b7-3378-49aa-9f65-3257afc13e07 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:23.179707 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36e90b7-3378-49aa-9f65-3257afc13e07 service cinder] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:23.218435 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 873/1718] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:13:22 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:13:24.975869 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00873187-d2d2-43e8-bf69-a96dfff5c575 None None] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:24.976435 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00873187-d2d2-43e8-bf69-a96dfff5c575 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:24.976679 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00873187-d2d2-43e8-bf69-a96dfff5c575 None None] PATH_INFO: `/` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:24.978879 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 846/1719] 10.222.0.79 () {54 vars in 912 bytes} [Tue Aug 30 01:13:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:13:25.001839 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e90e67e-30b1-4a14-8f3e-e0384919ff2e None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:25.002975 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e90e67e-30b1-4a14-8f3e-e0384919ff2e None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:25.003421 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e90e67e-30b1-4a14-8f3e-e0384919ff2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:25.089470 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-8e90e67e-30b1-4a14-8f3e-e0384919ff2e None None] MFA Rules not processed for user `16e6a0ca26fc4ef892c188ad89a1e132`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:13:25.089470 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-8e90e67e-30b1-4a14-8f3e-e0384919ff2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:25.189131 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 874/1720] 10.222.0.79 () {58 vars in 1009 bytes} [Tue Aug 30 01:13:25 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:13:25.235790 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00873187-d2d2-43e8-bf69-a96dfff5c575 None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:25.242339 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-00873187-d2d2-43e8-bf69-a96dfff5c575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:25.298845 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00873187-d2d2-43e8-bf69-a96dfff5c575 None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:25.327902 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced0dcf1-7bfe-499a-ae34-e33e64d5083c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16e6a0ca26fc4ef892c188ad89a1e132', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:25.328538 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced0dcf1-7bfe-499a-ae34-e33e64d5083c service neutron] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:25.330937 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced0dcf1-7bfe-499a-ae34-e33e64d5083c service neutron] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:25.331385 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced0dcf1-7bfe-499a-ae34-e33e64d5083c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:25.394211 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced0dcf1-7bfe-499a-ae34-e33e64d5083c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:25.399802 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced0dcf1-7bfe-499a-ae34-e33e64d5083c service neutron] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:25.424174 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 847/1721] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:13:25 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:13:26.561122 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e90e67e-30b1-4a14-8f3e-e0384919ff2e None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:26.563334 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-8e90e67e-30b1-4a14-8f3e-e0384919ff2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:26.637550 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5450c07d-08c6-44a4-b3ba-e6486689846e None None] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:26.638056 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5450c07d-08c6-44a4-b3ba-e6486689846e None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:26.638056 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5450c07d-08c6-44a4-b3ba-e6486689846e None None] PATH_INFO: `/` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:26.640213 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 848/1722] 10.222.0.79 () {54 vars in 921 bytes} [Tue Aug 30 01:13:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 01:13:26.697278 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b80eec-c5fe-491f-b38e-f896f6b02ad7 None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:26.697828 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b80eec-c5fe-491f-b38e-f896f6b02ad7 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:26.698475 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b80eec-c5fe-491f-b38e-f896f6b02ad7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:26.744761 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-25b80eec-c5fe-491f-b38e-f896f6b02ad7 None None] MFA Rules not processed for user `d68e91e4259e449797fb83de548aec1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:13:26.748572 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-25b80eec-c5fe-491f-b38e-f896f6b02ad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:26.781864 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 849/1723] 10.222.0.79 () {58 vars in 1018 bytes} [Tue Aug 30 01:13:26 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:13:26.861135 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e90e67e-30b1-4a14-8f3e-e0384919ff2e None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:26.869193 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c113098e-7276-47b5-8e65-09638b4151a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:26.869890 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c113098e-7276-47b5-8e65-09638b4151a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:26.870171 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c113098e-7276-47b5-8e65-09638b4151a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:26.870446 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c113098e-7276-47b5-8e65-09638b4151a3 admin admin] PATH_INFO: `/v3/users/4a0345907db64a09910a392439aa712c` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:26.874964 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c113098e-7276-47b5-8e65-09638b4151a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a0345907db64a09910a392439aa712c)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:26.876223 dv-cinder-819667-6-smb devstack@keystone.service[81999]: WARNING py.warnings [None req-c113098e-7276-47b5-8e65-09638b4151a3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 01:13:26.876223 dv-cinder-819667-6-smb devstack@keystone.service[81999]: warnings.warn(msg) Aug 30 01:13:26.876223 dv-cinder-819667-6-smb devstack@keystone.service[81999]: Aug 30 01:13:26.893496 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c113098e-7276-47b5-8e65-09638b4151a3 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:26.967408 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:13:27.009141 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da14cee-a693-4c87-9eba-f44aad60883b None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:27.009432 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da14cee-a693-4c87-9eba-f44aad60883b None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:27.009887 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da14cee-a693-4c87-9eba-f44aad60883b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:27.093906 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-c113098e-7276-47b5-8e65-09638b4151a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a0345907db64a09910a392439aa712c'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:27.126082 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-c113098e-7276-47b5-8e65-09638b4151a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a0345907db64a09910a392439aa712c'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:27.164804 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-c113098e-7276-47b5-8e65-09638b4151a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a0345907db64a09910a392439aa712c'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:27.164804 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-c113098e-7276-47b5-8e65-09638b4151a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a0345907db64a09910a392439aa712c'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:27.193813 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-2da14cee-a693-4c87-9eba-f44aad60883b None None] MFA Rules not processed for user `5cacaed93420436e8f423f96a8041401`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:13:27.201499 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-2da14cee-a693-4c87-9eba-f44aad60883b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:27.218865 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-c113098e-7276-47b5-8e65-09638b4151a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a0345907db64a09910a392439aa712c'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:27.245770 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 875/1724] 10.222.0.79 () {58 vars in 1224 bytes} [Tue Aug 30 01:13:26 2022] DELETE /identity/v3/users/4a0345907db64a09910a392439aa712c => generated 0 bytes in 685 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:13:27.251612 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ced24c-e83f-4cc6-bb04-ce48104d31ca None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:27.251883 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ced24c-e83f-4cc6-bb04-ce48104d31ca None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:27.262424 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ced24c-e83f-4cc6-bb04-ce48104d31ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:27.362789 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-b3ced24c-e83f-4cc6-bb04-ce48104d31ca None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:13:27.370942 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-b3ced24c-e83f-4cc6-bb04-ce48104d31ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:27.532187 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 850/1725] 10.222.0.79 () {58 vars in 1009 bytes} [Tue Aug 30 01:13:27 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 525 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:13:27.532854 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da14cee-a693-4c87-9eba-f44aad60883b None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:27.535904 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-2da14cee-a693-4c87-9eba-f44aad60883b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:27.596498 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 876/1726] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:13:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 346 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:13:27.597288 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ced24c-e83f-4cc6-bb04-ce48104d31ca None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:27.601258 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da14cee-a693-4c87-9eba-f44aad60883b None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:27.604813 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-b3ced24c-e83f-4cc6-bb04-ce48104d31ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:27.608745 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe00703-f496-4e92-aefd-7b4aff5db922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:27.609598 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe00703-f496-4e92-aefd-7b4aff5db922 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:27.609865 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe00703-f496-4e92-aefd-7b4aff5db922 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:27.610238 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe00703-f496-4e92-aefd-7b4aff5db922 admin admin] PATH_INFO: `/v3/users/e05f2ea0c47541cf88d91429173650e4` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:27.614951 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe00703-f496-4e92-aefd-7b4aff5db922 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e05f2ea0c47541cf88d91429173650e4)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:27.617145 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe00703-f496-4e92-aefd-7b4aff5db922 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:27.741117 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-8fe00703-f496-4e92-aefd-7b4aff5db922 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e05f2ea0c47541cf88d91429173650e4'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:27.748054 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:13:27.763897 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-8fe00703-f496-4e92-aefd-7b4aff5db922 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e05f2ea0c47541cf88d91429173650e4'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:27.785927 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ced24c-e83f-4cc6-bb04-ce48104d31ca None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:27.811724 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a21313-be53-402b-8904-61f212656f81 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd68e91e4259e449797fb83de548aec1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:27.813224 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a21313-be53-402b-8904-61f212656f81 service placement] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:27.813541 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a21313-be53-402b-8904-61f212656f81 service placement] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:27.813813 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a21313-be53-402b-8904-61f212656f81 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:27.822817 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-76a21313-be53-402b-8904-61f212656f81 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:27.830186 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-8fe00703-f496-4e92-aefd-7b4aff5db922 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e05f2ea0c47541cf88d91429173650e4'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:27.833871 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-8fe00703-f496-4e92-aefd-7b4aff5db922 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e05f2ea0c47541cf88d91429173650e4'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:27.846970 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-8fe00703-f496-4e92-aefd-7b4aff5db922 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e05f2ea0c47541cf88d91429173650e4'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:27.862292 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 851/1727] 10.222.0.79 () {58 vars in 1224 bytes} [Tue Aug 30 01:13:27 2022] DELETE /identity/v3/users/e05f2ea0c47541cf88d91429173650e4 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:13:27.864370 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe00703-f496-4e92-aefd-7b4aff5db922 admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:27.866027 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-8fe00703-f496-4e92-aefd-7b4aff5db922 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:27.916930 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a21313-be53-402b-8904-61f212656f81 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:27.922976 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a21313-be53-402b-8904-61f212656f81 service placement] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:27.975085 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 877/1728] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:13:27 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:13:27.980366 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a21313-be53-402b-8904-61f212656f81 service placement] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:27.985205 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-76a21313-be53-402b-8904-61f212656f81 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:28.084800 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:13:28.172207 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe00703-f496-4e92-aefd-7b4aff5db922 admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:28.205752 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4c8186-95cd-43b2-b1fe-288fd1990f38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16e6a0ca26fc4ef892c188ad89a1e132', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:28.206777 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4c8186-95cd-43b2-b1fe-288fd1990f38 service neutron] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:28.207998 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4c8186-95cd-43b2-b1fe-288fd1990f38 service neutron] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:28.208785 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4c8186-95cd-43b2-b1fe-288fd1990f38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:28.229790 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-8f4c8186-95cd-43b2-b1fe-288fd1990f38 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:28.334326 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a21313-be53-402b-8904-61f212656f81 service placement] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:28.434228 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4c8186-95cd-43b2-b1fe-288fd1990f38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:28.435652 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4c8186-95cd-43b2-b1fe-288fd1990f38 service neutron] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:28.459628 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 852/1729] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:13:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 596 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:13:28.460946 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c9e01f-51e1-4a5f-ae83-49a35069c95a None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:28.461243 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c9e01f-51e1-4a5f-ae83-49a35069c95a None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:28.461508 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c9e01f-51e1-4a5f-ae83-49a35069c95a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:28.482310 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d42ce16-141c-4f77-8305-f885b729a41a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd556fa6ba464928b1e067325792a523', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:28.482940 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d42ce16-141c-4f77-8305-f885b729a41a service swift] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:28.483258 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d42ce16-141c-4f77-8305-f885b729a41a service swift] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:28.483537 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d42ce16-141c-4f77-8305-f885b729a41a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:28.490342 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-4d42ce16-141c-4f77-8305-f885b729a41a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:28.502128 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-d2c9e01f-51e1-4a5f-ae83-49a35069c95a None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:13:28.503409 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-d2c9e01f-51e1-4a5f-ae83-49a35069c95a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:28.533391 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 853/1730] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:13:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:13:28.614615 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d42ce16-141c-4f77-8305-f885b729a41a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:28.617205 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d42ce16-141c-4f77-8305-f885b729a41a service swift] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:28.632044 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 878/1731] 10.222.0.79 () {60 vars in 1384 bytes} [Tue Aug 30 01:13:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 656 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 01:13:28.657358 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f90bd19-a825-468a-9d9e-661131328603 None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:28.657358 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f90bd19-a825-468a-9d9e-661131328603 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:28.660540 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d42ce16-141c-4f77-8305-f885b729a41a service swift] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:28.662215 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-4d42ce16-141c-4f77-8305-f885b729a41a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:28.664745 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f90bd19-a825-468a-9d9e-661131328603 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:28.708320 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d42ce16-141c-4f77-8305-f885b729a41a service swift] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:28.743024 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d06676c-51e1-45f2-881c-60b2d1f54306 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16e6a0ca26fc4ef892c188ad89a1e132', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:28.743913 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d06676c-51e1-45f2-881c-60b2d1f54306 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:28.744300 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d06676c-51e1-45f2-881c-60b2d1f54306 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:28.745507 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d06676c-51e1-45f2-881c-60b2d1f54306 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:28.753271 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-4f90bd19-a825-468a-9d9e-661131328603 None None] MFA Rules not processed for user `3ddcdbd4269c44c9b9e8d1c109de061f`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:13:28.758543 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-4f90bd19-a825-468a-9d9e-661131328603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:28.780790 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d06676c-51e1-45f2-881c-60b2d1f54306 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:28.788934 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d06676c-51e1-45f2-881c-60b2d1f54306 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:28.832886 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 879/1732] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:13:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:13:29.034296 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 854/1733] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:13:28 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 379 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:13:31.100998 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d06676c-51e1-45f2-881c-60b2d1f54306 service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:31.104406 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-8d06676c-51e1-45f2-881c-60b2d1f54306 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:31.148983 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d06676c-51e1-45f2-881c-60b2d1f54306 service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:31.163753 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c74b01c-f4d0-4f1b-bc98-bfc3572f3531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:31.164765 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c74b01c-f4d0-4f1b-bc98-bfc3572f3531 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:31.170801 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c74b01c-f4d0-4f1b-bc98-bfc3572f3531 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:31.171652 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c74b01c-f4d0-4f1b-bc98-bfc3572f3531 admin admin] PATH_INFO: `/v3/projects/a7182621307040cf880361b6b8b03d5a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:31.179912 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c74b01c-f4d0-4f1b-bc98-bfc3572f3531 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7182621307040cf880361b6b8b03d5a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:31.189168 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c74b01c-f4d0-4f1b-bc98-bfc3572f3531 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:31.292594 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:13:31.324094 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-6c74b01c-f4d0-4f1b-bc98-bfc3572f3531 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7182621307040cf880361b6b8b03d5a', 'request_id': 'req-6c74b01c-f4d0-4f1b-bc98-bfc3572f3531'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:31.356520 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-6c74b01c-f4d0-4f1b-bc98-bfc3572f3531 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7182621307040cf880361b6b8b03d5a', 'request_id': 'req-6c74b01c-f4d0-4f1b-bc98-bfc3572f3531'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:31.383920 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-6c74b01c-f4d0-4f1b-bc98-bfc3572f3531 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7182621307040cf880361b6b8b03d5a', 'request_id': 'req-6c74b01c-f4d0-4f1b-bc98-bfc3572f3531'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:31.456887 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-6c74b01c-f4d0-4f1b-bc98-bfc3572f3531 admin admin] The token cache is being invalidate because project a7182621307040cf880361b6b8b03d5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:13:31.463344 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-6c74b01c-f4d0-4f1b-bc98-bfc3572f3531 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:31.470974 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-6c74b01c-f4d0-4f1b-bc98-bfc3572f3531 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:31.483647 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 880/1734] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 30 01:13:31 2022] DELETE /identity/v3/projects/a7182621307040cf880361b6b8b03d5a => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:13:31.487615 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f90bd19-a825-468a-9d9e-661131328603 None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:31.508625 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f90bd19-a825-468a-9d9e-661131328603 None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:31.577349 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:13:31.742627 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81f868f-7940-4dd7-b2e2-bd3b47a47afb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:31.743326 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81f868f-7940-4dd7-b2e2-bd3b47a47afb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:31.743609 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81f868f-7940-4dd7-b2e2-bd3b47a47afb admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:31.743883 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81f868f-7940-4dd7-b2e2-bd3b47a47afb admin admin] PATH_INFO: `/v3/users/eb7112de7f0544eaa74044c7f1007940` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:31.747542 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81f868f-7940-4dd7-b2e2-bd3b47a47afb admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb7112de7f0544eaa74044c7f1007940)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:31.749685 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81f868f-7940-4dd7-b2e2-bd3b47a47afb admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:31.903357 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-d81f868f-7940-4dd7-b2e2-bd3b47a47afb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb7112de7f0544eaa74044c7f1007940'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:31.938324 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-d81f868f-7940-4dd7-b2e2-bd3b47a47afb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb7112de7f0544eaa74044c7f1007940'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:31.993712 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-d81f868f-7940-4dd7-b2e2-bd3b47a47afb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb7112de7f0544eaa74044c7f1007940'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:31.995409 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-d81f868f-7940-4dd7-b2e2-bd3b47a47afb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb7112de7f0544eaa74044c7f1007940'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:32.015614 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-d81f868f-7940-4dd7-b2e2-bd3b47a47afb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb7112de7f0544eaa74044c7f1007940'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:32.058384 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 855/1735] 10.222.0.79 () {58 vars in 1224 bytes} [Tue Aug 30 01:13:31 2022] DELETE /identity/v3/users/eb7112de7f0544eaa74044c7f1007940 => generated 0 bytes in 571 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:13:32.461856 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c74b01c-f4d0-4f1b-bc98-bfc3572f3531 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:32.463390 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-6c74b01c-f4d0-4f1b-bc98-bfc3572f3531 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:32.501431 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c74b01c-f4d0-4f1b-bc98-bfc3572f3531 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:32.699494 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c332e983-d6e6-4c33-85dc-3eae8afb041b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:32.700361 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c332e983-d6e6-4c33-85dc-3eae8afb041b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:32.700796 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c332e983-d6e6-4c33-85dc-3eae8afb041b admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:32.701180 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c332e983-d6e6-4c33-85dc-3eae8afb041b admin admin] PATH_INFO: `/v3/projects/2ad9642c33d043ef879e1061f89bff91` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:32.702540 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c332e983-d6e6-4c33-85dc-3eae8afb041b admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ad9642c33d043ef879e1061f89bff91)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:32.704836 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c332e983-d6e6-4c33-85dc-3eae8afb041b admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:32.803468 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082bffef-51b0-4a60-a245-de1c909b6251 None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:32.804059 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082bffef-51b0-4a60-a245-de1c909b6251 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:32.804511 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082bffef-51b0-4a60-a245-de1c909b6251 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:32.825358 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-c332e983-d6e6-4c33-85dc-3eae8afb041b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ad9642c33d043ef879e1061f89bff91', 'request_id': 'req-c332e983-d6e6-4c33-85dc-3eae8afb041b'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:32.846931 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-c332e983-d6e6-4c33-85dc-3eae8afb041b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ad9642c33d043ef879e1061f89bff91', 'request_id': 'req-c332e983-d6e6-4c33-85dc-3eae8afb041b'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:32.855919 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-c332e983-d6e6-4c33-85dc-3eae8afb041b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ad9642c33d043ef879e1061f89bff91', 'request_id': 'req-c332e983-d6e6-4c33-85dc-3eae8afb041b'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:32.878262 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-082bffef-51b0-4a60-a245-de1c909b6251 None None] MFA Rules not processed for user `16e6a0ca26fc4ef892c188ad89a1e132`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:13:32.883974 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-082bffef-51b0-4a60-a245-de1c909b6251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:32.904157 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-c332e983-d6e6-4c33-85dc-3eae8afb041b admin admin] The token cache is being invalidate because project 2ad9642c33d043ef879e1061f89bff91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:13:32.904524 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-c332e983-d6e6-4c33-85dc-3eae8afb041b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:32.905172 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-c332e983-d6e6-4c33-85dc-3eae8afb041b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:32.910133 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 881/1736] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 30 01:13:32 2022] DELETE /identity/v3/projects/2ad9642c33d043ef879e1061f89bff91 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:13:32.913241 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c332e983-d6e6-4c33-85dc-3eae8afb041b admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:32.920275 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-c332e983-d6e6-4c33-85dc-3eae8afb041b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:33.074616 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:13:33.109221 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c332e983-d6e6-4c33-85dc-3eae8afb041b admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:33.145579 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 856/1737] 10.222.0.58 () {58 vars in 1015 bytes} [Tue Aug 30 01:13:32 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 343 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:13:33.146428 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4907f413-b137-4dca-b1e7-fe8f3321f5a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:33.147343 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4907f413-b137-4dca-b1e7-fe8f3321f5a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:33.147664 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4907f413-b137-4dca-b1e7-fe8f3321f5a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:33.147978 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4907f413-b137-4dca-b1e7-fe8f3321f5a7 admin admin] PATH_INFO: `/v3/users/59e2562057134e928ff89dec245ce62f` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:33.151375 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4907f413-b137-4dca-b1e7-fe8f3321f5a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=59e2562057134e928ff89dec245ce62f)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:33.153537 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4907f413-b137-4dca-b1e7-fe8f3321f5a7 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:33.244971 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082bffef-51b0-4a60-a245-de1c909b6251 None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:33.249145 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-082bffef-51b0-4a60-a245-de1c909b6251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:33.289000 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082bffef-51b0-4a60-a245-de1c909b6251 None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:33.310859 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3854ca9c-b82a-43f0-a063-78a8a768994c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16e6a0ca26fc4ef892c188ad89a1e132', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:33.314380 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-4907f413-b137-4dca-b1e7-fe8f3321f5a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59e2562057134e928ff89dec245ce62f'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:33.314522 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3854ca9c-b82a-43f0-a063-78a8a768994c service neutron] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:33.314620 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3854ca9c-b82a-43f0-a063-78a8a768994c service neutron] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:33.314957 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3854ca9c-b82a-43f0-a063-78a8a768994c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:33.344754 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-4907f413-b137-4dca-b1e7-fe8f3321f5a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59e2562057134e928ff89dec245ce62f'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:33.361160 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3854ca9c-b82a-43f0-a063-78a8a768994c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:33.363297 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3854ca9c-b82a-43f0-a063-78a8a768994c service neutron] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:33.391304 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-4907f413-b137-4dca-b1e7-fe8f3321f5a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59e2562057134e928ff89dec245ce62f'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:33.393293 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-4907f413-b137-4dca-b1e7-fe8f3321f5a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59e2562057134e928ff89dec245ce62f'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:33.429695 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 857/1738] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:13:33 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:13:33.444965 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-4907f413-b137-4dca-b1e7-fe8f3321f5a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59e2562057134e928ff89dec245ce62f'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:33.473466 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 882/1739] 10.222.0.79 () {58 vars in 1224 bytes} [Tue Aug 30 01:13:32 2022] DELETE /identity/v3/users/59e2562057134e928ff89dec245ce62f => generated 0 bytes in 556 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:13:34.055832 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3854ca9c-b82a-43f0-a063-78a8a768994c service neutron] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:34.057299 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-3854ca9c-b82a-43f0-a063-78a8a768994c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:34.096073 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3854ca9c-b82a-43f0-a063-78a8a768994c service neutron] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:34.224830 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:13:34.337348 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8809718a-d6a7-4b8f-88c9-0e80452ff8d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:34.339574 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8809718a-d6a7-4b8f-88c9-0e80452ff8d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:34.341375 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8809718a-d6a7-4b8f-88c9-0e80452ff8d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:34.341530 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8809718a-d6a7-4b8f-88c9-0e80452ff8d2 admin admin] PATH_INFO: `/v3/users/856e536265fc443c9a56214fe68ff8bf` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:34.347505 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8809718a-d6a7-4b8f-88c9-0e80452ff8d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=856e536265fc443c9a56214fe68ff8bf)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:34.355177 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8809718a-d6a7-4b8f-88c9-0e80452ff8d2 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:34.483911 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-8809718a-d6a7-4b8f-88c9-0e80452ff8d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '856e536265fc443c9a56214fe68ff8bf'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:34.506617 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-8809718a-d6a7-4b8f-88c9-0e80452ff8d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '856e536265fc443c9a56214fe68ff8bf'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:34.552904 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-8809718a-d6a7-4b8f-88c9-0e80452ff8d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '856e536265fc443c9a56214fe68ff8bf'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:34.554818 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-8809718a-d6a7-4b8f-88c9-0e80452ff8d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '856e536265fc443c9a56214fe68ff8bf'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:34.574672 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-8809718a-d6a7-4b8f-88c9-0e80452ff8d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '856e536265fc443c9a56214fe68ff8bf'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:34.600372 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 858/1740] 10.222.0.79 () {58 vars in 1224 bytes} [Tue Aug 30 01:13:34 2022] DELETE /identity/v3/users/856e536265fc443c9a56214fe68ff8bf => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:13:34.799722 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4907f413-b137-4dca-b1e7-fe8f3321f5a7 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:34.802062 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-4907f413-b137-4dca-b1e7-fe8f3321f5a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:34.889313 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4907f413-b137-4dca-b1e7-fe8f3321f5a7 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:35.201643 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0eb92d9-9200-4b4c-9ff6-7be1b07e2efc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:35.202337 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eb92d9-9200-4b4c-9ff6-7be1b07e2efc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:35.208899 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eb92d9-9200-4b4c-9ff6-7be1b07e2efc admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:35.209296 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eb92d9-9200-4b4c-9ff6-7be1b07e2efc admin admin] PATH_INFO: `/v3/projects/4eb82afe0ac24d4e84a5f1ef1108e7cc` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:35.212094 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0eb92d9-9200-4b4c-9ff6-7be1b07e2efc admin admin] RBAC: Authorizing `identity:delete_project(project_id=4eb82afe0ac24d4e84a5f1ef1108e7cc)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:35.214270 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0eb92d9-9200-4b4c-9ff6-7be1b07e2efc admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:35.361171 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-f0eb92d9-9200-4b4c-9ff6-7be1b07e2efc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4eb82afe0ac24d4e84a5f1ef1108e7cc', 'request_id': 'req-f0eb92d9-9200-4b4c-9ff6-7be1b07e2efc'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:35.373868 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-f0eb92d9-9200-4b4c-9ff6-7be1b07e2efc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4eb82afe0ac24d4e84a5f1ef1108e7cc', 'request_id': 'req-f0eb92d9-9200-4b4c-9ff6-7be1b07e2efc'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:35.398020 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-f0eb92d9-9200-4b4c-9ff6-7be1b07e2efc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4eb82afe0ac24d4e84a5f1ef1108e7cc', 'request_id': 'req-f0eb92d9-9200-4b4c-9ff6-7be1b07e2efc'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:35.443970 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:13:35.523053 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-f0eb92d9-9200-4b4c-9ff6-7be1b07e2efc admin admin] The token cache is being invalidate because project 4eb82afe0ac24d4e84a5f1ef1108e7cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:13:35.523390 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-f0eb92d9-9200-4b4c-9ff6-7be1b07e2efc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:35.530903 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-f0eb92d9-9200-4b4c-9ff6-7be1b07e2efc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:35.535158 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 883/1741] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 30 01:13:34 2022] DELETE /identity/v3/projects/4eb82afe0ac24d4e84a5f1ef1108e7cc => generated 0 bytes in 738 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:13:35.541244 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c42dfa3-bc30-4b19-a181-e5c6c4e64074 None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:35.542225 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c42dfa3-bc30-4b19-a181-e5c6c4e64074 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:35.542722 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c42dfa3-bc30-4b19-a181-e5c6c4e64074 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:35.581147 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-1c42dfa3-bc30-4b19-a181-e5c6c4e64074 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:13:35.587463 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-1c42dfa3-bc30-4b19-a181-e5c6c4e64074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:35.865019 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 859/1742] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:13:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:13:35.866081 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac843ad1-72d1-47b4-beee-aaf24114f343 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:35.866559 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac843ad1-72d1-47b4-beee-aaf24114f343 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:35.866963 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac843ad1-72d1-47b4-beee-aaf24114f343 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:35.965876 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-ac843ad1-72d1-47b4-beee-aaf24114f343 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:13:35.967029 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-ac843ad1-72d1-47b4-beee-aaf24114f343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:35.991578 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 884/1743] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:13:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:13:35.996204 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c42dfa3-bc30-4b19-a181-e5c6c4e64074 None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:36.012839 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c42dfa3-bc30-4b19-a181-e5c6c4e64074 None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:36.021400 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c81d511-f026-412b-bc1b-74d888423715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:36.022933 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c81d511-f026-412b-bc1b-74d888423715 admin admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:36.023835 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c81d511-f026-412b-bc1b-74d888423715 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:36.024403 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c81d511-f026-412b-bc1b-74d888423715 admin admin] PATH_INFO: `/v3/domains` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:36.025770 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c81d511-f026-412b-bc1b-74d888423715 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:13:36.026671 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c81d511-f026-412b-bc1b-74d888423715 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:36.029453 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c81d511-f026-412b-bc1b-74d888423715 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:36.048285 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 860/1744] 10.222.0.79 () {58 vars in 1153 bytes} [Tue Aug 30 01:13:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:13:36.052864 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac843ad1-72d1-47b4-beee-aaf24114f343 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:36.074735 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac843ad1-72d1-47b4-beee-aaf24114f343 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:36.106083 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ad2ed0-73f5-4fea-9109-bb97e5ff4c3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:36.107952 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ad2ed0-73f5-4fea-9109-bb97e5ff4c3a admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:36.109023 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ad2ed0-73f5-4fea-9109-bb97e5ff4c3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:36.110103 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ad2ed0-73f5-4fea-9109-bb97e5ff4c3a admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:36.111643 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ad2ed0-73f5-4fea-9109-bb97e5ff4c3a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:36.115694 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ad2ed0-73f5-4fea-9109-bb97e5ff4c3a admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:36.232525 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 885/1745] 10.222.0.79 () {60 vars in 1153 bytes} [Tue Aug 30 01:13:36 2022] POST /identity/v3/projects => generated 379 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:13:36.237000 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c81d511-f026-412b-bc1b-74d888423715 admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:36.287560 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c81d511-f026-412b-bc1b-74d888423715 admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:36.461575 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:13:36.522361 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de21b4aa-55d5-46bb-8d98-97cb43fd20d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:36.525859 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de21b4aa-55d5-46bb-8d98-97cb43fd20d0 admin admin] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:36.526441 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de21b4aa-55d5-46bb-8d98-97cb43fd20d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:36.527649 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de21b4aa-55d5-46bb-8d98-97cb43fd20d0 admin admin] PATH_INFO: `/v3/users` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:36.530240 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de21b4aa-55d5-46bb-8d98-97cb43fd20d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:36.534403 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de21b4aa-55d5-46bb-8d98-97cb43fd20d0 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:36.618229 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 861/1746] 10.222.0.79 () {60 vars in 1144 bytes} [Tue Aug 30 01:13:36 2022] POST /identity/v3/users => generated 290 bytes in 382 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:13:36.618911 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ad2ed0-73f5-4fea-9109-bb97e5ff4c3a admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:36.643033 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ad2ed0-73f5-4fea-9109-bb97e5ff4c3a admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:36.663924 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461f11ae-e178-4bc0-9283-355f4dccae71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:36.666267 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461f11ae-e178-4bc0-9283-355f4dccae71 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:36.666552 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461f11ae-e178-4bc0-9283-355f4dccae71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:36.669506 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461f11ae-e178-4bc0-9283-355f4dccae71 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:36.670343 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461f11ae-e178-4bc0-9283-355f4dccae71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:36.672022 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461f11ae-e178-4bc0-9283-355f4dccae71 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:36.705033 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 886/1747] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:13:36 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:13:36.710547 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de21b4aa-55d5-46bb-8d98-97cb43fd20d0 admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:36.731973 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de21b4aa-55d5-46bb-8d98-97cb43fd20d0 admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:36.749590 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fe30e5-a620-420a-8a23-f8fdb8fc55ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:36.750702 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fe30e5-a620-420a-8a23-f8fdb8fc55ef admin admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:36.751080 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fe30e5-a620-420a-8a23-f8fdb8fc55ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:36.751469 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fe30e5-a620-420a-8a23-f8fdb8fc55ef admin admin] PATH_INFO: `/v3/roles` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:36.752261 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fe30e5-a620-420a-8a23-f8fdb8fc55ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:36.754169 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fe30e5-a620-420a-8a23-f8fdb8fc55ef admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:36.783399 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 862/1748] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:13:36 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 01:13:36.787176 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461f11ae-e178-4bc0-9283-355f4dccae71 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:36.800082 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461f11ae-e178-4bc0-9283-355f4dccae71 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:36.808451 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e95325f-5c43-4b9a-93fd-aac0882c2b19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:36.809647 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e95325f-5c43-4b9a-93fd-aac0882c2b19 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:36.810325 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e95325f-5c43-4b9a-93fd-aac0882c2b19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:36.810746 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e95325f-5c43-4b9a-93fd-aac0882c2b19 admin admin] PATH_INFO: `/v3/projects/7f78950d0e444251b60155a9961f9c25/users/99913754bd0941cd927f7f1f74772e7b/roles/c37945a17623465f899d4f217e7af593` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:36.852075 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e95325f-5c43-4b9a-93fd-aac0882c2b19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f78950d0e444251b60155a9961f9c25, user_id=99913754bd0941cd927f7f1f74772e7b, role_id=c37945a17623465f899d4f217e7af593)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:36.856586 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e95325f-5c43-4b9a-93fd-aac0882c2b19 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:36.886876 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 887/1749] 10.222.0.79 () {60 vars in 1483 bytes} [Tue Aug 30 01:13:36 2022] PUT /identity/v3/projects/7f78950d0e444251b60155a9961f9c25/users/99913754bd0941cd927f7f1f74772e7b/roles/c37945a17623465f899d4f217e7af593 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:13:36.898535 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82e7d84-32f1-4c3b-a6f2-f448e7ce9bd5 None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:36.899204 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82e7d84-32f1-4c3b-a6f2-f448e7ce9bd5 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:36.899488 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82e7d84-32f1-4c3b-a6f2-f448e7ce9bd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:37.062354 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-b82e7d84-32f1-4c3b-a6f2-f448e7ce9bd5 None None] MFA Rules not processed for user `99913754bd0941cd927f7f1f74772e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:13:37.077966 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-b82e7d84-32f1-4c3b-a6f2-f448e7ce9bd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:37.277724 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e95325f-5c43-4b9a-93fd-aac0882c2b19 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:37.280158 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-9e95325f-5c43-4b9a-93fd-aac0882c2b19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:37.355921 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 863/1750] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:13:36 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 458 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:13:37.360360 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82e7d84-32f1-4c3b-a6f2-f448e7ce9bd5 None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:37.472439 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e95325f-5c43-4b9a-93fd-aac0882c2b19 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:37.485382 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80c83c2-c9e4-4072-b9d0-73e634b7628c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:37.486428 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80c83c2-c9e4-4072-b9d0-73e634b7628c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:37.490664 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80c83c2-c9e4-4072-b9d0-73e634b7628c admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:37.494256 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80c83c2-c9e4-4072-b9d0-73e634b7628c admin admin] PATH_INFO: `/v3/projects/0648b7150ea64d6bb4fc185660b3255f` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:37.500892 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80c83c2-c9e4-4072-b9d0-73e634b7628c admin admin] RBAC: Authorizing `identity:delete_project(project_id=0648b7150ea64d6bb4fc185660b3255f)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:37.507575 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80c83c2-c9e4-4072-b9d0-73e634b7628c admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:37.526730 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82e7d84-32f1-4c3b-a6f2-f448e7ce9bd5 None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:37.548675 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449ffe2f-2ed0-4ea3-8158-83985be24125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:37.549519 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449ffe2f-2ed0-4ea3-8158-83985be24125 admin admin] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:37.549949 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449ffe2f-2ed0-4ea3-8158-83985be24125 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:37.550345 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449ffe2f-2ed0-4ea3-8158-83985be24125 admin admin] PATH_INFO: `/v3/projects` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:37.553701 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449ffe2f-2ed0-4ea3-8158-83985be24125 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:37.555920 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449ffe2f-2ed0-4ea3-8158-83985be24125 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:37.684933 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-e80c83c2-c9e4-4072-b9d0-73e634b7628c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0648b7150ea64d6bb4fc185660b3255f', 'request_id': 'req-e80c83c2-c9e4-4072-b9d0-73e634b7628c'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:37.699246 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-e80c83c2-c9e4-4072-b9d0-73e634b7628c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0648b7150ea64d6bb4fc185660b3255f', 'request_id': 'req-e80c83c2-c9e4-4072-b9d0-73e634b7628c'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:37.699739 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 864/1751] 10.222.0.79 () {60 vars in 1153 bytes} [Tue Aug 30 01:13:37 2022] POST /identity/v3/projects => generated 377 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:13:37.701371 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449ffe2f-2ed0-4ea3-8158-83985be24125 admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:37.706660 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-449ffe2f-2ed0-4ea3-8158-83985be24125 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:37.717464 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-e80c83c2-c9e4-4072-b9d0-73e634b7628c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0648b7150ea64d6bb4fc185660b3255f', 'request_id': 'req-e80c83c2-c9e4-4072-b9d0-73e634b7628c'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:37.738402 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-e80c83c2-c9e4-4072-b9d0-73e634b7628c admin admin] The token cache is being invalidate because project 0648b7150ea64d6bb4fc185660b3255f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:13:37.738960 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-e80c83c2-c9e4-4072-b9d0-73e634b7628c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:37.739832 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-e80c83c2-c9e4-4072-b9d0-73e634b7628c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:37.745153 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 888/1752] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 30 01:13:37 2022] DELETE /identity/v3/projects/0648b7150ea64d6bb4fc185660b3255f => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:13:37.745153 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80c83c2-c9e4-4072-b9d0-73e634b7628c admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:37.745153 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-e80c83c2-c9e4-4072-b9d0-73e634b7628c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:37.793248 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:13:37.837584 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449ffe2f-2ed0-4ea3-8158-83985be24125 admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:37.841796 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:13:37.845766 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ae212c-ed60-4adb-ba92-cdb6d4ca7c19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:37.846876 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ae212c-ed60-4adb-ba92-cdb6d4ca7c19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:37.847313 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ae212c-ed60-4adb-ba92-cdb6d4ca7c19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:37.847885 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ae212c-ed60-4adb-ba92-cdb6d4ca7c19 admin admin] PATH_INFO: `/v3/projects/6937cb5260464228865b6947ee96cf65` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:37.849337 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ae212c-ed60-4adb-ba92-cdb6d4ca7c19 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6937cb5260464228865b6947ee96cf65)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:37.850962 dv-cinder-819667-6-smb devstack@keystone.service[81998]: WARNING py.warnings [None req-28ae212c-ed60-4adb-ba92-cdb6d4ca7c19 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 01:13:37.850962 dv-cinder-819667-6-smb devstack@keystone.service[81998]: warnings.warn(msg) Aug 30 01:13:37.850962 dv-cinder-819667-6-smb devstack@keystone.service[81998]: Aug 30 01:13:37.852579 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ae212c-ed60-4adb-ba92-cdb6d4ca7c19 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:37.967580 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80c83c2-c9e4-4072-b9d0-73e634b7628c admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:38.006295 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-28ae212c-ed60-4adb-ba92-cdb6d4ca7c19 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6937cb5260464228865b6947ee96cf65', 'request_id': 'req-28ae212c-ed60-4adb-ba92-cdb6d4ca7c19'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:38.026319 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-28ae212c-ed60-4adb-ba92-cdb6d4ca7c19 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6937cb5260464228865b6947ee96cf65', 'request_id': 'req-28ae212c-ed60-4adb-ba92-cdb6d4ca7c19'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:38.051502 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-28ae212c-ed60-4adb-ba92-cdb6d4ca7c19 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6937cb5260464228865b6947ee96cf65', 'request_id': 'req-28ae212c-ed60-4adb-ba92-cdb6d4ca7c19'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:38.099620 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-28ae212c-ed60-4adb-ba92-cdb6d4ca7c19 admin admin] The token cache is being invalidate because project 6937cb5260464228865b6947ee96cf65 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81998) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:13:38.101944 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-28ae212c-ed60-4adb-ba92-cdb6d4ca7c19 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:38.102772 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-28ae212c-ed60-4adb-ba92-cdb6d4ca7c19 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:38.105688 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 865/1753] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 30 01:13:37 2022] DELETE /identity/v3/projects/6937cb5260464228865b6947ee96cf65 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:13:38.109088 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eb28b8-5b33-444a-b341-243bb5b6040e None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:38.109595 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eb28b8-5b33-444a-b341-243bb5b6040e None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:38.110035 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eb28b8-5b33-444a-b341-243bb5b6040e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:38.121817 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7f83f0-0413-4bc5-a942-2d19de87ac35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:38.122800 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7f83f0-0413-4bc5-a942-2d19de87ac35 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:38.123490 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7f83f0-0413-4bc5-a942-2d19de87ac35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:38.123861 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7f83f0-0413-4bc5-a942-2d19de87ac35 admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:38.125027 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7f83f0-0413-4bc5-a942-2d19de87ac35 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:38.127437 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7f83f0-0413-4bc5-a942-2d19de87ac35 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:38.175264 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 889/1754] 10.222.0.79 () {60 vars in 1144 bytes} [Tue Aug 30 01:13:37 2022] POST /identity/v3/users => generated 289 bytes in 432 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:13:38.176611 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7f83f0-0413-4bc5-a942-2d19de87ac35 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:38.181177 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-1d7f83f0-0413-4bc5-a942-2d19de87ac35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:38.188275 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-14eb28b8-5b33-444a-b341-243bb5b6040e None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:13:38.189767 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-14eb28b8-5b33-444a-b341-243bb5b6040e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:38.213028 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7f83f0-0413-4bc5-a942-2d19de87ac35 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:38.213825 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 866/1755] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:13:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:13:38.215936 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14eb28b8-5b33-444a-b341-243bb5b6040e None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:38.218066 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-14eb28b8-5b33-444a-b341-243bb5b6040e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:38.249073 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d825713-dc47-4db4-9446-96d07a2e0ad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:38.250041 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d825713-dc47-4db4-9446-96d07a2e0ad3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:38.250529 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d825713-dc47-4db4-9446-96d07a2e0ad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:38.251235 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d825713-dc47-4db4-9446-96d07a2e0ad3 admin admin] PATH_INFO: `/v3/users/4dda782150f3457e8576ecf7a091292b` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:38.252765 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d825713-dc47-4db4-9446-96d07a2e0ad3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4dda782150f3457e8576ecf7a091292b)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:38.255664 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d825713-dc47-4db4-9446-96d07a2e0ad3 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:38.279857 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14eb28b8-5b33-444a-b341-243bb5b6040e None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:38.297962 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729059d2-914d-4620-af9d-4753eea9e68b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:38.299788 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729059d2-914d-4620-af9d-4753eea9e68b admin admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:38.301675 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729059d2-914d-4620-af9d-4753eea9e68b admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:38.302284 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729059d2-914d-4620-af9d-4753eea9e68b admin admin] PATH_INFO: `/v3/roles` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:38.304285 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729059d2-914d-4620-af9d-4753eea9e68b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:38.327329 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729059d2-914d-4620-af9d-4753eea9e68b admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:38.358674 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 867/1756] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:13:38 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:13:38.361747 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cb856b-9aff-4287-87cd-bfad14a42f5f None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:38.362289 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cb856b-9aff-4287-87cd-bfad14a42f5f None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:38.362707 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cb856b-9aff-4287-87cd-bfad14a42f5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:38.405329 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-8d825713-dc47-4db4-9446-96d07a2e0ad3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4dda782150f3457e8576ecf7a091292b'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:38.420743 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-55cb856b-9aff-4287-87cd-bfad14a42f5f None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:13:38.422030 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-55cb856b-9aff-4287-87cd-bfad14a42f5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:38.422247 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-8d825713-dc47-4db4-9446-96d07a2e0ad3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4dda782150f3457e8576ecf7a091292b'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:38.446408 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-8d825713-dc47-4db4-9446-96d07a2e0ad3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4dda782150f3457e8576ecf7a091292b'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:38.448069 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-8d825713-dc47-4db4-9446-96d07a2e0ad3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4dda782150f3457e8576ecf7a091292b'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:38.454538 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 868/1757] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:13:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:13:38.458090 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cb856b-9aff-4287-87cd-bfad14a42f5f None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:38.478210 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-8d825713-dc47-4db4-9446-96d07a2e0ad3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4dda782150f3457e8576ecf7a091292b'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:38.493213 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 890/1758] 10.222.0.79 () {58 vars in 1224 bytes} [Tue Aug 30 01:13:38 2022] DELETE /identity/v3/users/4dda782150f3457e8576ecf7a091292b => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:13:38.493213 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a98894-7428-4ad2-9654-65a99e472688 None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:38.493213 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a98894-7428-4ad2-9654-65a99e472688 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:38.493970 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a98894-7428-4ad2-9654-65a99e472688 None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:38.496513 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cb856b-9aff-4287-87cd-bfad14a42f5f None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:38.498018 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 891/1759] 10.222.0.79 () {54 vars in 921 bytes} [Tue Aug 30 01:13:38 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:13:38.500537 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a98894-7428-4ad2-9654-65a99e472688 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:38.505448 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-61a98894-7428-4ad2-9654-65a99e472688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:38.563309 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:13:38.610604 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb59229c-5e59-4b5c-9537-d2ede045cbc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:38.611776 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb59229c-5e59-4b5c-9537-d2ede045cbc1 admin admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:38.612331 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb59229c-5e59-4b5c-9537-d2ede045cbc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:38.612956 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb59229c-5e59-4b5c-9537-d2ede045cbc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:38.614858 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb59229c-5e59-4b5c-9537-d2ede045cbc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:38.617925 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb59229c-5e59-4b5c-9537-d2ede045cbc1 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:38.630448 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 869/1760] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:13:38 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:13:38.637981 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb59229c-5e59-4b5c-9537-d2ede045cbc1 admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:38.648369 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-fb59229c-5e59-4b5c-9537-d2ede045cbc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:38.662260 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a98894-7428-4ad2-9654-65a99e472688 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:38.667251 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb59229c-5e59-4b5c-9537-d2ede045cbc1 admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:38.678052 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e157c03-e971-4dc9-8c64-11bbb972f5f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:38.681444 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e157c03-e971-4dc9-8c64-11bbb972f5f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:38.682100 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e157c03-e971-4dc9-8c64-11bbb972f5f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:38.682566 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e157c03-e971-4dc9-8c64-11bbb972f5f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:38.684749 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e157c03-e971-4dc9-8c64-11bbb972f5f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:13:38.685598 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ad7439-7708-455b-b89d-efb4e11de845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:38.686220 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e157c03-e971-4dc9-8c64-11bbb972f5f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:38.686489 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ad7439-7708-455b-b89d-efb4e11de845 admin admin] REQUEST_METHOD: `PUT` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:38.687004 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ad7439-7708-455b-b89d-efb4e11de845 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:38.687396 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ad7439-7708-455b-b89d-efb4e11de845 admin admin] PATH_INFO: `/v3/projects/500e3b2e7e7c4632962e4d51fe6f119b/users/3bc9caad44e841e395a532c1cbd1c6fc/roles/c37945a17623465f899d4f217e7af593` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:38.693888 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e157c03-e971-4dc9-8c64-11bbb972f5f2 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:38.739702 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ad7439-7708-455b-b89d-efb4e11de845 admin admin] RBAC: Authorizing `identity:create_grant(project_id=500e3b2e7e7c4632962e4d51fe6f119b, user_id=3bc9caad44e841e395a532c1cbd1c6fc, role_id=c37945a17623465f899d4f217e7af593)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:38.742700 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ad7439-7708-455b-b89d-efb4e11de845 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:38.770913 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 870/1761] 10.222.0.79 () {60 vars in 1483 bytes} [Tue Aug 30 01:13:38 2022] PUT /identity/v3/projects/500e3b2e7e7c4632962e4d51fe6f119b/users/3bc9caad44e841e395a532c1cbd1c6fc/roles/c37945a17623465f899d4f217e7af593 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:13:38.799973 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 892/1762] 10.222.0.79 () {58 vars in 1153 bytes} [Tue Aug 30 01:13:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:13:38.800282 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5686d38-2107-4991-a579-9a44bf69e20c None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:38.800282 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5686d38-2107-4991-a579-9a44bf69e20c None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:38.800282 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5686d38-2107-4991-a579-9a44bf69e20c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:38.803978 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e157c03-e971-4dc9-8c64-11bbb972f5f2 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:38.831806 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e157c03-e971-4dc9-8c64-11bbb972f5f2 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:38.871738 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:13:38.891466 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-e5686d38-2107-4991-a579-9a44bf69e20c None None] MFA Rules not processed for user `3bc9caad44e841e395a532c1cbd1c6fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:13:38.898504 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-e5686d38-2107-4991-a579-9a44bf69e20c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:39.135886 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 871/1763] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:13:38 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 338 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:13:39.140407 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d157a6-6fcb-4d4a-8141-a5674f909787 None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:39.140766 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d157a6-6fcb-4d4a-8141-a5674f909787 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:39.141873 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d157a6-6fcb-4d4a-8141-a5674f909787 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:39.152136 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d652077c-9be7-4c72-a659-c3bdd4e052df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:39.154484 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d652077c-9be7-4c72-a659-c3bdd4e052df admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:39.155259 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d652077c-9be7-4c72-a659-c3bdd4e052df admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:39.157177 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d652077c-9be7-4c72-a659-c3bdd4e052df admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:39.159322 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d652077c-9be7-4c72-a659-c3bdd4e052df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:39.162819 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d652077c-9be7-4c72-a659-c3bdd4e052df admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:39.201953 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-96d157a6-6fcb-4d4a-8141-a5674f909787 None None] MFA Rules not processed for user `6480b2f14c37474c89df9fba48f7cd91`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:13:39.203259 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-96d157a6-6fcb-4d4a-8141-a5674f909787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:39.299048 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 893/1764] 10.222.0.79 () {60 vars in 1153 bytes} [Tue Aug 30 01:13:38 2022] POST /identity/v3/projects => generated 407 bytes in 497 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:13:39.301713 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d652077c-9be7-4c72-a659-c3bdd4e052df admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:39.414948 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 872/1765] 10.222.0.79 () {58 vars in 1018 bytes} [Tue Aug 30 01:13:39 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:13:39.415730 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d157a6-6fcb-4d4a-8141-a5674f909787 None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:39.441247 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d157a6-6fcb-4d4a-8141-a5674f909787 None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:39.560269 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d652077c-9be7-4c72-a659-c3bdd4e052df admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:39.578704 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad57f5d6-a83c-496c-9cc5-f433ee91c11a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:39.579510 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad57f5d6-a83c-496c-9cc5-f433ee91c11a admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:39.579817 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad57f5d6-a83c-496c-9cc5-f433ee91c11a admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:39.580166 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad57f5d6-a83c-496c-9cc5-f433ee91c11a admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:39.582537 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad57f5d6-a83c-496c-9cc5-f433ee91c11a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:39.585338 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e16cb0-5eab-430c-a77d-40afe8f5d65b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:39.588992 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e16cb0-5eab-430c-a77d-40afe8f5d65b admin admin] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:39.589365 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e16cb0-5eab-430c-a77d-40afe8f5d65b admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:39.589754 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e16cb0-5eab-430c-a77d-40afe8f5d65b admin admin] PATH_INFO: `/v3/users` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:39.593063 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad57f5d6-a83c-496c-9cc5-f433ee91c11a admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:39.595359 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e16cb0-5eab-430c-a77d-40afe8f5d65b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:39.632125 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e16cb0-5eab-430c-a77d-40afe8f5d65b admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:39.662447 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 894/1766] 10.222.0.79 () {60 vars in 1153 bytes} [Tue Aug 30 01:13:39 2022] POST /identity/v3/projects => generated 379 bytes in 362 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:13:39.665468 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad57f5d6-a83c-496c-9cc5-f433ee91c11a admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:39.712275 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 873/1767] 10.222.0.79 () {60 vars in 1144 bytes} [Tue Aug 30 01:13:39 2022] POST /identity/v3/users => generated 304 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:13:39.719883 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e16cb0-5eab-430c-a77d-40afe8f5d65b admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:39.741531 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e16cb0-5eab-430c-a77d-40afe8f5d65b admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:39.786909 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:13:39.791183 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:13:39.860749 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad57f5d6-a83c-496c-9cc5-f433ee91c11a admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:39.876617 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffcea0a-86de-40c8-9702-2755d5cdeadc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:39.881542 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffcea0a-86de-40c8-9702-2755d5cdeadc admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:39.881846 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffcea0a-86de-40c8-9702-2755d5cdeadc admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:39.882201 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffcea0a-86de-40c8-9702-2755d5cdeadc admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:39.882854 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffcea0a-86de-40c8-9702-2755d5cdeadc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:39.884953 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffcea0a-86de-40c8-9702-2755d5cdeadc admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:39.932374 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa991d1-b89c-4dcf-8777-7a2e264a15ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:39.933137 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa991d1-b89c-4dcf-8777-7a2e264a15ed admin admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:39.933472 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa991d1-b89c-4dcf-8777-7a2e264a15ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:39.933753 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa991d1-b89c-4dcf-8777-7a2e264a15ed admin admin] PATH_INFO: `/v3/roles` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:39.934597 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa991d1-b89c-4dcf-8777-7a2e264a15ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:39.936424 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa991d1-b89c-4dcf-8777-7a2e264a15ed admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:39.966365 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 895/1768] 10.222.0.79 () {60 vars in 1144 bytes} [Tue Aug 30 01:13:39 2022] POST /identity/v3/users => generated 296 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:13:39.967516 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffcea0a-86de-40c8-9702-2755d5cdeadc admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:39.984585 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-0ffcea0a-86de-40c8-9702-2755d5cdeadc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:39.994776 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 874/1769] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:13:39 2022] GET /identity/v3/roles => generated 1420 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:13:39.994776 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa991d1-b89c-4dcf-8777-7a2e264a15ed admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:40.051472 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa991d1-b89c-4dcf-8777-7a2e264a15ed admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:40.069124 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2578fb4-b981-4941-8d3c-476bc1ed1157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:40.069749 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2578fb4-b981-4941-8d3c-476bc1ed1157 admin admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:40.070024 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2578fb4-b981-4941-8d3c-476bc1ed1157 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:40.070354 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2578fb4-b981-4941-8d3c-476bc1ed1157 admin admin] PATH_INFO: `/v3/roles` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:40.071017 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2578fb4-b981-4941-8d3c-476bc1ed1157 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:40.081076 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2578fb4-b981-4941-8d3c-476bc1ed1157 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:40.117567 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 875/1770] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:13:39 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:13:40.119357 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2578fb4-b981-4941-8d3c-476bc1ed1157 admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:40.147496 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2578fb4-b981-4941-8d3c-476bc1ed1157 admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:40.184361 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de898cc9-0bff-4bca-92b4-2cc9cd575b8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:40.185042 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de898cc9-0bff-4bca-92b4-2cc9cd575b8f admin admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:40.185231 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de898cc9-0bff-4bca-92b4-2cc9cd575b8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:40.185497 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de898cc9-0bff-4bca-92b4-2cc9cd575b8f admin admin] PATH_INFO: `/v3/roles` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:40.186135 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de898cc9-0bff-4bca-92b4-2cc9cd575b8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:40.187967 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de898cc9-0bff-4bca-92b4-2cc9cd575b8f admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:40.211635 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 876/1771] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:13:40 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:13:40.212758 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de898cc9-0bff-4bca-92b4-2cc9cd575b8f admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:40.222011 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffcea0a-86de-40c8-9702-2755d5cdeadc admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:40.233197 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669b9196-b1ee-4df8-b0af-053d8560b3ff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6480b2f14c37474c89df9fba48f7cd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:40.234268 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669b9196-b1ee-4df8-b0af-053d8560b3ff service nova] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:40.234754 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669b9196-b1ee-4df8-b0af-053d8560b3ff service nova] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:40.235460 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669b9196-b1ee-4df8-b0af-053d8560b3ff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:40.249430 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669b9196-b1ee-4df8-b0af-053d8560b3ff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:40.251930 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669b9196-b1ee-4df8-b0af-053d8560b3ff service nova] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:40.254180 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de898cc9-0bff-4bca-92b4-2cc9cd575b8f admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:40.260635 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48352830-c8b2-4652-961f-12c6c4e86b31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:40.261307 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48352830-c8b2-4652-961f-12c6c4e86b31 admin admin] REQUEST_METHOD: `PUT` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:40.261643 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48352830-c8b2-4652-961f-12c6c4e86b31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:40.261921 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48352830-c8b2-4652-961f-12c6c4e86b31 admin admin] PATH_INFO: `/v3/projects/23421d856b0948c087a8594c276ea937/users/c18a5849c5684bb7a35646578914f3fc/roles/d14c3070c9184d76a7b23df69bd3db07` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:40.275667 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 896/1772] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:13:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:13:40.277157 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669b9196-b1ee-4df8-b0af-053d8560b3ff service nova] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:40.294831 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669b9196-b1ee-4df8-b0af-053d8560b3ff service nova] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:40.298952 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48352830-c8b2-4652-961f-12c6c4e86b31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23421d856b0948c087a8594c276ea937, user_id=c18a5849c5684bb7a35646578914f3fc, role_id=d14c3070c9184d76a7b23df69bd3db07)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:40.304458 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48352830-c8b2-4652-961f-12c6c4e86b31 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:40.334481 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5229c2a6-6934-4f5a-a148-969c65cde17e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:40.337932 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5229c2a6-6934-4f5a-a148-969c65cde17e admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:40.339609 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5229c2a6-6934-4f5a-a148-969c65cde17e admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:40.342220 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5229c2a6-6934-4f5a-a148-969c65cde17e admin admin] PATH_INFO: `/v3/projects/a131f3547dd74971b52aa59043e52bb1/users/5e4f3e754d6c465ca8b73af5ff148b66/roles/c37945a17623465f899d4f217e7af593` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:40.355970 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 877/1773] 10.222.0.79 () {60 vars in 1483 bytes} [Tue Aug 30 01:13:40 2022] PUT /identity/v3/projects/23421d856b0948c087a8594c276ea937/users/c18a5849c5684bb7a35646578914f3fc/roles/d14c3070c9184d76a7b23df69bd3db07 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:13:40.359825 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48352830-c8b2-4652-961f-12c6c4e86b31 admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:40.454275 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5229c2a6-6934-4f5a-a148-969c65cde17e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a131f3547dd74971b52aa59043e52bb1, user_id=5e4f3e754d6c465ca8b73af5ff148b66, role_id=c37945a17623465f899d4f217e7af593)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:40.483377 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5229c2a6-6934-4f5a-a148-969c65cde17e admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:40.528520 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 897/1774] 10.222.0.79 () {60 vars in 1483 bytes} [Tue Aug 30 01:13:40 2022] PUT /identity/v3/projects/a131f3547dd74971b52aa59043e52bb1/users/5e4f3e754d6c465ca8b73af5ff148b66/roles/c37945a17623465f899d4f217e7af593 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:13:40.538982 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4fbd08-7b8a-4fa9-8571-c56433ac370f None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:40.539641 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4fbd08-7b8a-4fa9-8571-c56433ac370f None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:40.540154 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4fbd08-7b8a-4fa9-8571-c56433ac370f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:40.622922 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-fa4fbd08-7b8a-4fa9-8571-c56433ac370f None None] MFA Rules not processed for user `5e4f3e754d6c465ca8b73af5ff148b66`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:13:40.624500 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-fa4fbd08-7b8a-4fa9-8571-c56433ac370f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:40.628506 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48352830-c8b2-4652-961f-12c6c4e86b31 admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:40.737364 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf57d72-83ee-4d9a-bcf1-ff99173c15d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:40.737966 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf57d72-83ee-4d9a-bcf1-ff99173c15d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:40.739045 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf57d72-83ee-4d9a-bcf1-ff99173c15d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:40.739597 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf57d72-83ee-4d9a-bcf1-ff99173c15d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:40.739846 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf57d72-83ee-4d9a-bcf1-ff99173c15d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:40.742243 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf57d72-83ee-4d9a-bcf1-ff99173c15d6 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:40.756812 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 878/1775] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:13:40 2022] GET /identity/v3/roles => generated 1420 bytes in 397 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:13:40.761988 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf57d72-83ee-4d9a-bcf1-ff99173c15d6 admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:40.789045 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf57d72-83ee-4d9a-bcf1-ff99173c15d6 admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:40.796165 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355cb21c-ea6f-401a-b557-7326e96d6fff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:40.796983 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355cb21c-ea6f-401a-b557-7326e96d6fff admin admin] REQUEST_METHOD: `PUT` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:40.797325 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355cb21c-ea6f-401a-b557-7326e96d6fff admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:40.797661 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355cb21c-ea6f-401a-b557-7326e96d6fff admin admin] PATH_INFO: `/v3/projects/23421d856b0948c087a8594c276ea937/users/c18a5849c5684bb7a35646578914f3fc/roles/d14c3070c9184d76a7b23df69bd3db07` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:40.801485 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355cb21c-ea6f-401a-b557-7326e96d6fff admin admin] RBAC: Authorizing `identity:create_grant(project_id=23421d856b0948c087a8594c276ea937, user_id=c18a5849c5684bb7a35646578914f3fc, role_id=d14c3070c9184d76a7b23df69bd3db07)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:40.804899 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355cb21c-ea6f-401a-b557-7326e96d6fff admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:40.827895 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 898/1776] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:13:40 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:13:40.828125 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 879/1777] 10.222.0.79 () {60 vars in 1483 bytes} [Tue Aug 30 01:13:40 2022] PUT /identity/v3/projects/23421d856b0948c087a8594c276ea937/users/c18a5849c5684bb7a35646578914f3fc/roles/d14c3070c9184d76a7b23df69bd3db07 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:13:40.844909 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4fbd08-7b8a-4fa9-8571-c56433ac370f None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:40.847383 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f48498-3c8f-4731-8eab-665c9d2e9118 None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:40.847863 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f48498-3c8f-4731-8eab-665c9d2e9118 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:40.848365 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f48498-3c8f-4731-8eab-665c9d2e9118 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:40.860036 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4fbd08-7b8a-4fa9-8571-c56433ac370f None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:40.860511 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:13:40.874834 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:13:40.927606 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-a6f48498-3c8f-4731-8eab-665c9d2e9118 None None] MFA Rules not processed for user `c18a5849c5684bb7a35646578914f3fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:13:40.928903 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-a6f48498-3c8f-4731-8eab-665c9d2e9118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:40.936714 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b57f09-4b9a-4829-851a-dadfad416707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:40.937413 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b57f09-4b9a-4829-851a-dadfad416707 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:40.937749 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b57f09-4b9a-4829-851a-dadfad416707 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:40.938201 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b57f09-4b9a-4829-851a-dadfad416707 admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:40.939032 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b57f09-4b9a-4829-851a-dadfad416707 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:40.956884 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b57f09-4b9a-4829-851a-dadfad416707 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:41.001528 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 899/1778] 10.222.0.79 () {60 vars in 1153 bytes} [Tue Aug 30 01:13:40 2022] POST /identity/v3/projects => generated 405 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:13:41.003193 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b08f751-7b80-4b46-a684-2844eeb547b6 None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:41.004773 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b08f751-7b80-4b46-a684-2844eeb547b6 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:41.005380 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b08f751-7b80-4b46-a684-2844eeb547b6 None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:41.007655 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 900/1779] 10.222.0.79 () {54 vars in 921 bytes} [Tue Aug 30 01:13:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:13:41.008560 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b08f751-7b80-4b46-a684-2844eeb547b6 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:41.135054 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 880/1780] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:13:40 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:13:41.148008 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f48498-3c8f-4731-8eab-665c9d2e9118 None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:41.149790 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-a6f48498-3c8f-4731-8eab-665c9d2e9118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:41.167226 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b08f751-7b80-4b46-a684-2844eeb547b6 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:41.184346 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932a7bb6-9a9c-47cb-b772-76907961fe03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:41.184974 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932a7bb6-9a9c-47cb-b772-76907961fe03 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:41.185366 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932a7bb6-9a9c-47cb-b772-76907961fe03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:41.185643 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932a7bb6-9a9c-47cb-b772-76907961fe03 admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:41.186288 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932a7bb6-9a9c-47cb-b772-76907961fe03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:41.188897 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932a7bb6-9a9c-47cb-b772-76907961fe03 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:41.240021 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 901/1781] 10.222.0.79 () {60 vars in 1144 bytes} [Tue Aug 30 01:13:41 2022] POST /identity/v3/users => generated 309 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:13:41.244073 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932a7bb6-9a9c-47cb-b772-76907961fe03 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:41.256216 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932a7bb6-9a9c-47cb-b772-76907961fe03 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:41.283051 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8344cc6a-002e-4901-9b47-c5f7f60cc6f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:41.286082 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8344cc6a-002e-4901-9b47-c5f7f60cc6f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:41.286330 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8344cc6a-002e-4901-9b47-c5f7f60cc6f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:41.286804 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8344cc6a-002e-4901-9b47-c5f7f60cc6f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:41.287876 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8344cc6a-002e-4901-9b47-c5f7f60cc6f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:41.290383 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8344cc6a-002e-4901-9b47-c5f7f60cc6f5 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:41.319946 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f48498-3c8f-4731-8eab-665c9d2e9118 None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:41.334594 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 902/1782] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:13:41 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 01:13:41.339278 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8344cc6a-002e-4901-9b47-c5f7f60cc6f5 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:41.368862 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8344cc6a-002e-4901-9b47-c5f7f60cc6f5 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:41.385777 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8c4529-4361-40d6-b846-42f1a21bd790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:41.388474 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8c4529-4361-40d6-b846-42f1a21bd790 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:41.388829 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8c4529-4361-40d6-b846-42f1a21bd790 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:41.389941 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8c4529-4361-40d6-b846-42f1a21bd790 admin admin] PATH_INFO: `/v3/projects/c0dca63736e547fc8547055137f4a3d0/users/b01f56fff7594624a92f426455c0680f/roles/d14c3070c9184d76a7b23df69bd3db07` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:41.439396 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65707957-db9d-4e26-9e42-75fb4f7b017d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f827c7670b74d938ffe066ced88d1c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:41.440173 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65707957-db9d-4e26-9e42-75fb4f7b017d service cinder] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:41.440529 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65707957-db9d-4e26-9e42-75fb4f7b017d service cinder] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:41.440820 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65707957-db9d-4e26-9e42-75fb4f7b017d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:41.453819 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8c4529-4361-40d6-b846-42f1a21bd790 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0dca63736e547fc8547055137f4a3d0, user_id=b01f56fff7594624a92f426455c0680f, role_id=d14c3070c9184d76a7b23df69bd3db07)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:41.463102 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8c4529-4361-40d6-b846-42f1a21bd790 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:41.490442 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 903/1783] 10.222.0.79 () {60 vars in 1483 bytes} [Tue Aug 30 01:13:41 2022] PUT /identity/v3/projects/c0dca63736e547fc8547055137f4a3d0/users/b01f56fff7594624a92f426455c0680f/roles/d14c3070c9184d76a7b23df69bd3db07 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:13:41.491987 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0edab2-c137-444e-9fc1-a8799f21f4e6 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:41.492376 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0edab2-c137-444e-9fc1-a8799f21f4e6 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:41.494398 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0edab2-c137-444e-9fc1-a8799f21f4e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:41.530613 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-1c0edab2-c137-444e-9fc1-a8799f21f4e6 None None] MFA Rules not processed for user `6480b2f14c37474c89df9fba48f7cd91`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:13:41.532051 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-1c0edab2-c137-444e-9fc1-a8799f21f4e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:41.613545 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:13:41.632609 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:13:41.638485 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65707957-db9d-4e26-9e42-75fb4f7b017d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:41.640450 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65707957-db9d-4e26-9e42-75fb4f7b017d service cinder] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:41.704577 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 881/1784] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:13:41 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 556 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 01:13:41.705835 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65707957-db9d-4e26-9e42-75fb4f7b017d service cinder] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:41.727330 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 904/1785] 10.222.0.79 () {58 vars in 1018 bytes} [Tue Aug 30 01:13:41 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:13:41.755813 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65707957-db9d-4e26-9e42-75fb4f7b017d service cinder] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:41.811525 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0edab2-c137-444e-9fc1-a8799f21f4e6 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:41.922667 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea1a7a1-26ab-4b9a-90bd-8e4f6b8b76cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:41.924410 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea1a7a1-26ab-4b9a-90bd-8e4f6b8b76cc admin admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:41.924410 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea1a7a1-26ab-4b9a-90bd-8e4f6b8b76cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:41.924410 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea1a7a1-26ab-4b9a-90bd-8e4f6b8b76cc admin admin] PATH_INFO: `/v3/roles` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:41.926684 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea1a7a1-26ab-4b9a-90bd-8e4f6b8b76cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:41.932659 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea1a7a1-26ab-4b9a-90bd-8e4f6b8b76cc admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:41.996300 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 882/1786] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:13:41 2022] GET /identity/v3/roles => generated 1420 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:13:41.998082 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea1a7a1-26ab-4b9a-90bd-8e4f6b8b76cc admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:42.032867 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0edab2-c137-444e-9fc1-a8799f21f4e6 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:42.039519 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea1a7a1-26ab-4b9a-90bd-8e4f6b8b76cc admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:42.053370 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61abca9-32a8-4885-9ea7-a53d9b58c32d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f827c7670b74d938ffe066ced88d1c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:42.054010 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61abca9-32a8-4885-9ea7-a53d9b58c32d service cinder] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:42.058343 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61abca9-32a8-4885-9ea7-a53d9b58c32d service cinder] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:42.058648 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61abca9-32a8-4885-9ea7-a53d9b58c32d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:42.065515 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-e61abca9-32a8-4885-9ea7-a53d9b58c32d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:42.069802 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28bb6f8-a689-4c56-9ef5-a7e82e4fbdb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:42.070569 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28bb6f8-a689-4c56-9ef5-a7e82e4fbdb6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:42.070851 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28bb6f8-a689-4c56-9ef5-a7e82e4fbdb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:42.073728 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28bb6f8-a689-4c56-9ef5-a7e82e4fbdb6 admin admin] PATH_INFO: `/v3/projects/c0dca63736e547fc8547055137f4a3d0/users/b01f56fff7594624a92f426455c0680f/roles/d14c3070c9184d76a7b23df69bd3db07` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:42.079110 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28bb6f8-a689-4c56-9ef5-a7e82e4fbdb6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0dca63736e547fc8547055137f4a3d0, user_id=b01f56fff7594624a92f426455c0680f, role_id=d14c3070c9184d76a7b23df69bd3db07)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:42.085708 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28bb6f8-a689-4c56-9ef5-a7e82e4fbdb6 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:42.135356 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 883/1787] 10.222.0.79 () {60 vars in 1483 bytes} [Tue Aug 30 01:13:41 2022] PUT /identity/v3/projects/c0dca63736e547fc8547055137f4a3d0/users/b01f56fff7594624a92f426455c0680f/roles/d14c3070c9184d76a7b23df69bd3db07 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:13:42.136286 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28bb6f8-a689-4c56-9ef5-a7e82e4fbdb6 admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:42.144915 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-a28bb6f8-a689-4c56-9ef5-a7e82e4fbdb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:42.253001 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61abca9-32a8-4885-9ea7-a53d9b58c32d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:42.257792 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61abca9-32a8-4885-9ea7-a53d9b58c32d service cinder] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:42.294158 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 905/1788] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:13:41 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 483 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 01:13:42.296860 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22473d52-8b1f-4f65-8449-806dda284c53 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:42.299099 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22473d52-8b1f-4f65-8449-806dda284c53 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:42.301070 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22473d52-8b1f-4f65-8449-806dda284c53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:42.360481 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28bb6f8-a689-4c56-9ef5-a7e82e4fbdb6 admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:42.390099 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125ad22f-8a82-4aa3-9bbb-bce7e93e102c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:42.390929 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125ad22f-8a82-4aa3-9bbb-bce7e93e102c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:42.391353 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125ad22f-8a82-4aa3-9bbb-bce7e93e102c admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:42.391633 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125ad22f-8a82-4aa3-9bbb-bce7e93e102c admin admin] PATH_INFO: `/v3/projects/479e083d4cb94f4c964fac9016f69644` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:42.393140 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125ad22f-8a82-4aa3-9bbb-bce7e93e102c admin admin] RBAC: Authorizing `identity:delete_project(project_id=479e083d4cb94f4c964fac9016f69644)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:42.396996 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125ad22f-8a82-4aa3-9bbb-bce7e93e102c admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:42.406907 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-22473d52-8b1f-4f65-8449-806dda284c53 None None] MFA Rules not processed for user `b01f56fff7594624a92f426455c0680f`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:13:42.407686 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-22473d52-8b1f-4f65-8449-806dda284c53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:42.508583 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-125ad22f-8a82-4aa3-9bbb-bce7e93e102c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '479e083d4cb94f4c964fac9016f69644', 'request_id': 'req-125ad22f-8a82-4aa3-9bbb-bce7e93e102c'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:42.523850 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-125ad22f-8a82-4aa3-9bbb-bce7e93e102c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '479e083d4cb94f4c964fac9016f69644', 'request_id': 'req-125ad22f-8a82-4aa3-9bbb-bce7e93e102c'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:42.542429 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-125ad22f-8a82-4aa3-9bbb-bce7e93e102c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '479e083d4cb94f4c964fac9016f69644', 'request_id': 'req-125ad22f-8a82-4aa3-9bbb-bce7e93e102c'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:42.567968 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-125ad22f-8a82-4aa3-9bbb-bce7e93e102c admin admin] The token cache is being invalidate because project 479e083d4cb94f4c964fac9016f69644 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81998) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:13:42.568268 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-125ad22f-8a82-4aa3-9bbb-bce7e93e102c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:42.569448 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-125ad22f-8a82-4aa3-9bbb-bce7e93e102c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:42.578457 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 884/1789] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 30 01:13:42 2022] DELETE /identity/v3/projects/479e083d4cb94f4c964fac9016f69644 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:13:42.579493 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125ad22f-8a82-4aa3-9bbb-bce7e93e102c admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:42.583067 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-125ad22f-8a82-4aa3-9bbb-bce7e93e102c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:42.642204 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:13:42.642338 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 906/1790] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:13:42 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 343 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:13:42.642338 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17068e5-dfc2-48d8-a3f9-ef3646be27f9 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:42.642338 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17068e5-dfc2-48d8-a3f9-ef3646be27f9 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:42.642338 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17068e5-dfc2-48d8-a3f9-ef3646be27f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:42.701668 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-f17068e5-dfc2-48d8-a3f9-ef3646be27f9 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:13:42.702880 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-f17068e5-dfc2-48d8-a3f9-ef3646be27f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:42.727473 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:13:42.820673 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 907/1791] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:13:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:13:42.820673 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17068e5-dfc2-48d8-a3f9-ef3646be27f9 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:42.820673 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-f17068e5-dfc2-48d8-a3f9-ef3646be27f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:42.821177 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125ad22f-8a82-4aa3-9bbb-bce7e93e102c admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:42.844457 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1498a323-548a-4ea3-b7d6-d3859bf7abe1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6480b2f14c37474c89df9fba48f7cd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:42.845096 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1498a323-548a-4ea3-b7d6-d3859bf7abe1 service nova] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:42.845445 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1498a323-548a-4ea3-b7d6-d3859bf7abe1 service nova] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:42.845723 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1498a323-548a-4ea3-b7d6-d3859bf7abe1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:42.850786 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-1498a323-548a-4ea3-b7d6-d3859bf7abe1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:42.879510 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1498a323-548a-4ea3-b7d6-d3859bf7abe1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:42.880879 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1498a323-548a-4ea3-b7d6-d3859bf7abe1 service nova] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:42.907563 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 885/1792] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:13:42 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:13:42.918447 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b11e01-7ff8-49c6-8d5c-50cd82afa3d9 None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:42.918447 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b11e01-7ff8-49c6-8d5c-50cd82afa3d9 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:42.918612 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b11e01-7ff8-49c6-8d5c-50cd82afa3d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:42.956095 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17068e5-dfc2-48d8-a3f9-ef3646be27f9 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:42.965129 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce5e330-6496-4e78-82bf-dcc63a72cb3c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f827c7670b74d938ffe066ced88d1c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:42.970198 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce5e330-6496-4e78-82bf-dcc63a72cb3c service cinder] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:42.973656 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-d2b11e01-7ff8-49c6-8d5c-50cd82afa3d9 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:13:42.975111 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-d2b11e01-7ff8-49c6-8d5c-50cd82afa3d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:42.986277 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce5e330-6496-4e78-82bf-dcc63a72cb3c service cinder] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:42.987285 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce5e330-6496-4e78-82bf-dcc63a72cb3c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:42.999561 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 886/1793] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:13:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:13:43.001957 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b11e01-7ff8-49c6-8d5c-50cd82afa3d9 None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:43.015423 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b11e01-7ff8-49c6-8d5c-50cd82afa3d9 None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:43.022205 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a541904b-8750-4dd9-b107-ea1e88756a20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:43.022871 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a541904b-8750-4dd9-b107-ea1e88756a20 admin admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:43.023188 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a541904b-8750-4dd9-b107-ea1e88756a20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:43.023467 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a541904b-8750-4dd9-b107-ea1e88756a20 admin admin] PATH_INFO: `/v3/domains` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:43.024292 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a541904b-8750-4dd9-b107-ea1e88756a20 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:13:43.024604 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a541904b-8750-4dd9-b107-ea1e88756a20 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:43.026466 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a541904b-8750-4dd9-b107-ea1e88756a20 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:43.048997 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 887/1794] 10.222.0.79 () {58 vars in 1153 bytes} [Tue Aug 30 01:13:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:13:43.049932 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a541904b-8750-4dd9-b107-ea1e88756a20 admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:43.065362 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a541904b-8750-4dd9-b107-ea1e88756a20 admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:43.072316 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a28526b-04c4-4106-a09e-8464b9530e79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:43.073158 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a28526b-04c4-4106-a09e-8464b9530e79 admin admin] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:43.073450 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a28526b-04c4-4106-a09e-8464b9530e79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:43.073762 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a28526b-04c4-4106-a09e-8464b9530e79 admin admin] PATH_INFO: `/v3/projects` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:43.075021 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a28526b-04c4-4106-a09e-8464b9530e79 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:43.077583 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a28526b-04c4-4106-a09e-8464b9530e79 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:43.122905 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 888/1795] 10.222.0.79 () {60 vars in 1153 bytes} [Tue Aug 30 01:13:43 2022] POST /identity/v3/projects => generated 365 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:13:43.125694 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a28526b-04c4-4106-a09e-8464b9530e79 admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:43.142618 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce5e330-6496-4e78-82bf-dcc63a72cb3c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:43.146445 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce5e330-6496-4e78-82bf-dcc63a72cb3c service cinder] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:43.185370 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 908/1796] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:13:42 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:13:43.217398 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce5e330-6496-4e78-82bf-dcc63a72cb3c service cinder] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:43.218979 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-cce5e330-6496-4e78-82bf-dcc63a72cb3c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:43.249225 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a28526b-04c4-4106-a09e-8464b9530e79 admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:43.264764 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce5e330-6496-4e78-82bf-dcc63a72cb3c service cinder] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:43.265660 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d69fb5-3c67-4d17-b879-0c53f4f02edc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:43.266292 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d69fb5-3c67-4d17-b879-0c53f4f02edc admin admin] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:43.267295 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d69fb5-3c67-4d17-b879-0c53f4f02edc admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:43.267582 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d69fb5-3c67-4d17-b879-0c53f4f02edc admin admin] PATH_INFO: `/v3/users` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:43.268567 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d69fb5-3c67-4d17-b879-0c53f4f02edc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:43.276586 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d69fb5-3c67-4d17-b879-0c53f4f02edc admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:43.276744 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b7985e-1a31-4816-bd28-dced722028ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:43.277215 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b7985e-1a31-4816-bd28-dced722028ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:43.277488 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b7985e-1a31-4816-bd28-dced722028ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:43.277787 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b7985e-1a31-4816-bd28-dced722028ad admin admin] PATH_INFO: `/v3/users/e7986fc5b8d2451e8e39be9455d44f55` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:43.279273 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b7985e-1a31-4816-bd28-dced722028ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7986fc5b8d2451e8e39be9455d44f55)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:43.289696 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b7985e-1a31-4816-bd28-dced722028ad admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:43.335108 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 889/1797] 10.222.0.79 () {60 vars in 1144 bytes} [Tue Aug 30 01:13:43 2022] POST /identity/v3/users => generated 283 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:13:43.339845 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d69fb5-3c67-4d17-b879-0c53f4f02edc admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:43.355473 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d69fb5-3c67-4d17-b879-0c53f4f02edc admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:43.370824 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128eb224-3443-49c7-92f0-9eb838a42fa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:43.371545 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128eb224-3443-49c7-92f0-9eb838a42fa3 admin admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:43.371899 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128eb224-3443-49c7-92f0-9eb838a42fa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:43.372269 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128eb224-3443-49c7-92f0-9eb838a42fa3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:43.373361 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128eb224-3443-49c7-92f0-9eb838a42fa3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:43.374929 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128eb224-3443-49c7-92f0-9eb838a42fa3 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:43.388642 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 890/1798] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:13:43 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:13:43.392751 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128eb224-3443-49c7-92f0-9eb838a42fa3 admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:43.409073 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-60b7985e-1a31-4816-bd28-dced722028ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7986fc5b8d2451e8e39be9455d44f55'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:43.421336 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-60b7985e-1a31-4816-bd28-dced722028ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7986fc5b8d2451e8e39be9455d44f55'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:43.433561 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-60b7985e-1a31-4816-bd28-dced722028ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7986fc5b8d2451e8e39be9455d44f55'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:43.433561 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-60b7985e-1a31-4816-bd28-dced722028ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7986fc5b8d2451e8e39be9455d44f55'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:43.433932 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128eb224-3443-49c7-92f0-9eb838a42fa3 admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:43.442349 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:13:43.448275 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c8abca-3193-4829-8358-b26755d3bd9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:43.450711 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c8abca-3193-4829-8358-b26755d3bd9b admin admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:43.452086 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-60b7985e-1a31-4816-bd28-dced722028ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7986fc5b8d2451e8e39be9455d44f55'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:43.453109 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c8abca-3193-4829-8358-b26755d3bd9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:43.453429 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c8abca-3193-4829-8358-b26755d3bd9b admin admin] PATH_INFO: `/v3/roles` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:43.456408 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c8abca-3193-4829-8358-b26755d3bd9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:43.462706 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c8abca-3193-4829-8358-b26755d3bd9b admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:43.464058 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 909/1799] 10.222.0.79 () {58 vars in 1224 bytes} [Tue Aug 30 01:13:43 2022] DELETE /identity/v3/users/e7986fc5b8d2451e8e39be9455d44f55 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:13:43.468444 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f10e728-b503-40b1-9ad7-68db45a28a65 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:43.469251 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f10e728-b503-40b1-9ad7-68db45a28a65 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:43.469612 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f10e728-b503-40b1-9ad7-68db45a28a65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:43.492549 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 891/1800] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:13:43 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:13:43.493749 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c8abca-3193-4829-8358-b26755d3bd9b admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:43.495197 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-3f10e728-b503-40b1-9ad7-68db45a28a65 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:13:43.496456 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-f1c8abca-3193-4829-8358-b26755d3bd9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:43.496652 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-3f10e728-b503-40b1-9ad7-68db45a28a65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:43.515612 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c8abca-3193-4829-8358-b26755d3bd9b admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:43.554705 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:13:43.619271 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 910/1801] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:13:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:13:43.620759 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f10e728-b503-40b1-9ad7-68db45a28a65 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:43.624756 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-3f10e728-b503-40b1-9ad7-68db45a28a65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:43.637047 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81c6b95-7701-4edc-907f-7818a4cf372c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:43.637370 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81c6b95-7701-4edc-907f-7818a4cf372c admin admin] REQUEST_METHOD: `PUT` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:43.637646 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81c6b95-7701-4edc-907f-7818a4cf372c admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:43.638039 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81c6b95-7701-4edc-907f-7818a4cf372c admin admin] PATH_INFO: `/v3/projects/79c722880ce5445db0de2861c532cbdd/users/f76ec2d85b5f4398a7889d3658013b7c/roles/c37945a17623465f899d4f217e7af593` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:43.664352 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81c6b95-7701-4edc-907f-7818a4cf372c admin admin] RBAC: Authorizing `identity:create_grant(project_id=79c722880ce5445db0de2861c532cbdd, user_id=f76ec2d85b5f4398a7889d3658013b7c, role_id=c37945a17623465f899d4f217e7af593)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:43.667807 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81c6b95-7701-4edc-907f-7818a4cf372c admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:43.689186 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 892/1802] 10.222.0.79 () {60 vars in 1483 bytes} [Tue Aug 30 01:13:43 2022] PUT /identity/v3/projects/79c722880ce5445db0de2861c532cbdd/users/f76ec2d85b5f4398a7889d3658013b7c/roles/c37945a17623465f899d4f217e7af593 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:13:43.690362 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81c6b95-7701-4edc-907f-7818a4cf372c admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:43.693819 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-e81c6b95-7701-4edc-907f-7818a4cf372c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:43.714587 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f10e728-b503-40b1-9ad7-68db45a28a65 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:43.770321 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81c6b95-7701-4edc-907f-7818a4cf372c admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:43.778057 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380f6abc-1c53-46e4-8314-a2adb813a454 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16e6a0ca26fc4ef892c188ad89a1e132', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:43.779080 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380f6abc-1c53-46e4-8314-a2adb813a454 service neutron] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:43.779872 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acba3a05-8e36-4071-84fa-9058ce150ca6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f827c7670b74d938ffe066ced88d1c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:43.780583 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380f6abc-1c53-46e4-8314-a2adb813a454 service neutron] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:43.780855 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380f6abc-1c53-46e4-8314-a2adb813a454 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:43.781747 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acba3a05-8e36-4071-84fa-9058ce150ca6 service cinder] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:43.782026 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acba3a05-8e36-4071-84fa-9058ce150ca6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:43.782292 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acba3a05-8e36-4071-84fa-9058ce150ca6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:43.784718 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-acba3a05-8e36-4071-84fa-9058ce150ca6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:43.891362 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acba3a05-8e36-4071-84fa-9058ce150ca6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:43.891945 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380f6abc-1c53-46e4-8314-a2adb813a454 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:43.893473 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380f6abc-1c53-46e4-8314-a2adb813a454 service neutron] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:43.894387 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acba3a05-8e36-4071-84fa-9058ce150ca6 service cinder] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:43.903060 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:13:43.907800 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 893/1803] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:13:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:13:43.909506 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281ff690-9cdd-4ac2-9d20-7bac071cb56c None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:43.909958 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281ff690-9cdd-4ac2-9d20-7bac071cb56c None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:43.910293 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281ff690-9cdd-4ac2-9d20-7bac071cb56c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:43.929152 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 911/1804] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:13:43 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:13:43.969228 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-281ff690-9cdd-4ac2-9d20-7bac071cb56c None None] MFA Rules not processed for user `f76ec2d85b5f4398a7889d3658013b7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:13:43.971108 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-281ff690-9cdd-4ac2-9d20-7bac071cb56c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:44.028435 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:13:44.074624 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 894/1805] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:13:43 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:13:44.076052 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acba3a05-8e36-4071-84fa-9058ce150ca6 service cinder] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:44.094003 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acba3a05-8e36-4071-84fa-9058ce150ca6 service cinder] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:44.104235 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c567e37-8310-4f81-ae1b-58b3ee308943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:44.105329 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c567e37-8310-4f81-ae1b-58b3ee308943 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:44.105978 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c567e37-8310-4f81-ae1b-58b3ee308943 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:44.106454 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c567e37-8310-4f81-ae1b-58b3ee308943 admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:44.108282 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c567e37-8310-4f81-ae1b-58b3ee308943 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:44.111760 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c567e37-8310-4f81-ae1b-58b3ee308943 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:44.160914 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 912/1806] 10.222.0.79 () {60 vars in 1153 bytes} [Tue Aug 30 01:13:44 2022] POST /identity/v3/projects => generated 363 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:13:44.162886 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281ff690-9cdd-4ac2-9d20-7bac071cb56c None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:44.176941 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281ff690-9cdd-4ac2-9d20-7bac071cb56c None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:44.283209 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62223f01-03de-4091-9e80-4943378cccac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:44.285856 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62223f01-03de-4091-9e80-4943378cccac admin admin] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:44.286504 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62223f01-03de-4091-9e80-4943378cccac admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:44.288434 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62223f01-03de-4091-9e80-4943378cccac admin admin] PATH_INFO: `/v3/users` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:44.289116 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62223f01-03de-4091-9e80-4943378cccac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:44.294931 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62223f01-03de-4091-9e80-4943378cccac admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:44.375231 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 895/1807] 10.222.0.79 () {60 vars in 1144 bytes} [Tue Aug 30 01:13:44 2022] POST /identity/v3/users => generated 288 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:13:44.378701 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c567e37-8310-4f81-ae1b-58b3ee308943 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:44.399473 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c567e37-8310-4f81-ae1b-58b3ee308943 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:44.405014 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1a61e1-8e04-46f9-aff3-f50b6d9c5cfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:44.417135 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1a61e1-8e04-46f9-aff3-f50b6d9c5cfb admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:44.417135 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1a61e1-8e04-46f9-aff3-f50b6d9c5cfb admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:44.417135 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1a61e1-8e04-46f9-aff3-f50b6d9c5cfb admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:44.417135 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1a61e1-8e04-46f9-aff3-f50b6d9c5cfb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:44.417135 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1a61e1-8e04-46f9-aff3-f50b6d9c5cfb admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:44.427865 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62223f01-03de-4091-9e80-4943378cccac admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:44.428368 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 913/1808] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:13:44 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:13:44.439692 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62223f01-03de-4091-9e80-4943378cccac admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:44.446979 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c06da8-41b1-4452-9d8f-960aa1d65200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:44.448957 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c06da8-41b1-4452-9d8f-960aa1d65200 admin admin] REQUEST_METHOD: `PUT` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:44.449313 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c06da8-41b1-4452-9d8f-960aa1d65200 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:44.449655 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c06da8-41b1-4452-9d8f-960aa1d65200 admin admin] PATH_INFO: `/v3/projects/e6bdf633a4bc4e499bdfccb3596cc4dc/users/d322d14cb4bf447c82ee8ee743ff53ed/roles/d14c3070c9184d76a7b23df69bd3db07` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:44.487362 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c06da8-41b1-4452-9d8f-960aa1d65200 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6bdf633a4bc4e499bdfccb3596cc4dc, user_id=d322d14cb4bf447c82ee8ee743ff53ed, role_id=d14c3070c9184d76a7b23df69bd3db07)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:44.490263 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c06da8-41b1-4452-9d8f-960aa1d65200 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:44.510713 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 896/1809] 10.222.0.79 () {60 vars in 1483 bytes} [Tue Aug 30 01:13:44 2022] PUT /identity/v3/projects/e6bdf633a4bc4e499bdfccb3596cc4dc/users/d322d14cb4bf447c82ee8ee743ff53ed/roles/d14c3070c9184d76a7b23df69bd3db07 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:13:44.515736 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1a61e1-8e04-46f9-aff3-f50b6d9c5cfb admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:44.527000 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1a61e1-8e04-46f9-aff3-f50b6d9c5cfb admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:44.627084 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbe052c-deec-4eaa-b12f-c99bf641e606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:44.627850 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbe052c-deec-4eaa-b12f-c99bf641e606 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:44.628140 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbe052c-deec-4eaa-b12f-c99bf641e606 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:44.628459 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbe052c-deec-4eaa-b12f-c99bf641e606 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:44.629196 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbe052c-deec-4eaa-b12f-c99bf641e606 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:44.641154 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbe052c-deec-4eaa-b12f-c99bf641e606 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:44.673263 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 914/1810] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:13:44 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:13:44.679844 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c06da8-41b1-4452-9d8f-960aa1d65200 admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:44.704430 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c06da8-41b1-4452-9d8f-960aa1d65200 admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:44.710231 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dd7ebd-5d6b-4c2e-ad85-f59c8b88777b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:44.710906 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dd7ebd-5d6b-4c2e-ad85-f59c8b88777b admin admin] REQUEST_METHOD: `PUT` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:44.711213 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dd7ebd-5d6b-4c2e-ad85-f59c8b88777b admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:44.711816 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dd7ebd-5d6b-4c2e-ad85-f59c8b88777b admin admin] PATH_INFO: `/v3/projects/e6bdf633a4bc4e499bdfccb3596cc4dc/users/d322d14cb4bf447c82ee8ee743ff53ed/roles/d14c3070c9184d76a7b23df69bd3db07` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:44.714162 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5dd7ebd-5d6b-4c2e-ad85-f59c8b88777b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6bdf633a4bc4e499bdfccb3596cc4dc, user_id=d322d14cb4bf447c82ee8ee743ff53ed, role_id=d14c3070c9184d76a7b23df69bd3db07)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:44.716832 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5dd7ebd-5d6b-4c2e-ad85-f59c8b88777b admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:44.734975 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 897/1811] 10.222.0.79 () {60 vars in 1483 bytes} [Tue Aug 30 01:13:44 2022] PUT /identity/v3/projects/e6bdf633a4bc4e499bdfccb3596cc4dc/users/d322d14cb4bf447c82ee8ee743ff53ed/roles/d14c3070c9184d76a7b23df69bd3db07 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:13:44.745458 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b12a0fd-afa9-43c0-8b39-fd489d054589 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:44.745744 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b12a0fd-afa9-43c0-8b39-fd489d054589 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:44.746022 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b12a0fd-afa9-43c0-8b39-fd489d054589 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:44.790428 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-8b12a0fd-afa9-43c0-8b39-fd489d054589 None None] MFA Rules not processed for user `d322d14cb4bf447c82ee8ee743ff53ed`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:13:44.792534 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-8b12a0fd-afa9-43c0-8b39-fd489d054589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:44.924399 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 915/1812] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:13:44 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:13:44.937290 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dd7ebd-5d6b-4c2e-ad85-f59c8b88777b admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:44.944138 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-b5dd7ebd-5d6b-4c2e-ad85-f59c8b88777b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:45.061865 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dd7ebd-5d6b-4c2e-ad85-f59c8b88777b admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:45.070021 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db860803-946d-4a5e-ac36-3de70dbc0d51 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f827c7670b74d938ffe066ced88d1c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:45.070690 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db860803-946d-4a5e-ac36-3de70dbc0d51 service cinder] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:45.070971 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db860803-946d-4a5e-ac36-3de70dbc0d51 service cinder] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:45.071627 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db860803-946d-4a5e-ac36-3de70dbc0d51 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:45.082764 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db860803-946d-4a5e-ac36-3de70dbc0d51 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:45.084517 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db860803-946d-4a5e-ac36-3de70dbc0d51 service cinder] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:45.097124 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 898/1813] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:13:44 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:13:45.139423 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b12a0fd-afa9-43c0-8b39-fd489d054589 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:45.141222 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-8b12a0fd-afa9-43c0-8b39-fd489d054589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:45.215990 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db860803-946d-4a5e-ac36-3de70dbc0d51 service cinder] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:45.225778 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db860803-946d-4a5e-ac36-3de70dbc0d51 service cinder] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:45.237496 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22fcf20-a6f0-4176-a7d3-458af6d0755e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f827c7670b74d938ffe066ced88d1c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:45.239446 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22fcf20-a6f0-4176-a7d3-458af6d0755e service cinder] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:45.239715 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22fcf20-a6f0-4176-a7d3-458af6d0755e service cinder] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:45.240057 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22fcf20-a6f0-4176-a7d3-458af6d0755e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:45.262601 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:13:45.281408 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b12a0fd-afa9-43c0-8b39-fd489d054589 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:45.286470 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:13:45.287311 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a0a390-b753-4493-83ae-fa61345e9642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:45.287999 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a0a390-b753-4493-83ae-fa61345e9642 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:45.288263 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a0a390-b753-4493-83ae-fa61345e9642 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:45.288532 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a0a390-b753-4493-83ae-fa61345e9642 admin admin] PATH_INFO: `/v3/projects/fd9b65be36144db4829529c35e942a02` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:45.289859 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a0a390-b753-4493-83ae-fa61345e9642 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd9b65be36144db4829529c35e942a02)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:45.291900 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a0a390-b753-4493-83ae-fa61345e9642 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:45.313568 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22fcf20-a6f0-4176-a7d3-458af6d0755e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:45.315044 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22fcf20-a6f0-4176-a7d3-458af6d0755e service cinder] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:45.326460 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 899/1814] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:13:45 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 01:13:45.341480 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-61a0a390-b753-4493-83ae-fa61345e9642 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd9b65be36144db4829529c35e942a02', 'request_id': 'req-61a0a390-b753-4493-83ae-fa61345e9642'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:45.350714 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-61a0a390-b753-4493-83ae-fa61345e9642 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd9b65be36144db4829529c35e942a02', 'request_id': 'req-61a0a390-b753-4493-83ae-fa61345e9642'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:45.358978 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-61a0a390-b753-4493-83ae-fa61345e9642 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd9b65be36144db4829529c35e942a02', 'request_id': 'req-61a0a390-b753-4493-83ae-fa61345e9642'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:45.371538 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-61a0a390-b753-4493-83ae-fa61345e9642 admin admin] The token cache is being invalidate because project fd9b65be36144db4829529c35e942a02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:13:45.371924 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-61a0a390-b753-4493-83ae-fa61345e9642 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:45.372560 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-61a0a390-b753-4493-83ae-fa61345e9642 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:45.374844 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 916/1815] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 30 01:13:45 2022] DELETE /identity/v3/projects/fd9b65be36144db4829529c35e942a02 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:13:45.379529 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22fcf20-a6f0-4176-a7d3-458af6d0755e service cinder] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:45.390930 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22fcf20-a6f0-4176-a7d3-458af6d0755e service cinder] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:45.485092 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e193d416-eb0c-4a69-ba6f-1553bf63146d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:45.485632 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e193d416-eb0c-4a69-ba6f-1553bf63146d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:45.486040 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e193d416-eb0c-4a69-ba6f-1553bf63146d admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:45.486318 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e193d416-eb0c-4a69-ba6f-1553bf63146d admin admin] PATH_INFO: `/v3/users/068d54a76cdd4232807eb857ec4d75ff` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:45.488880 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e193d416-eb0c-4a69-ba6f-1553bf63146d admin admin] RBAC: Authorizing `identity:delete_user(user_id=068d54a76cdd4232807eb857ec4d75ff)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:45.490818 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e193d416-eb0c-4a69-ba6f-1553bf63146d admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:45.597013 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-e193d416-eb0c-4a69-ba6f-1553bf63146d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '068d54a76cdd4232807eb857ec4d75ff'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:45.614405 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-e193d416-eb0c-4a69-ba6f-1553bf63146d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '068d54a76cdd4232807eb857ec4d75ff'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:45.634808 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-e193d416-eb0c-4a69-ba6f-1553bf63146d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '068d54a76cdd4232807eb857ec4d75ff'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:45.636584 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-e193d416-eb0c-4a69-ba6f-1553bf63146d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '068d54a76cdd4232807eb857ec4d75ff'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:45.648162 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-e193d416-eb0c-4a69-ba6f-1553bf63146d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '068d54a76cdd4232807eb857ec4d75ff'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:45.661593 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 900/1816] 10.222.0.79 () {58 vars in 1224 bytes} [Tue Aug 30 01:13:45 2022] DELETE /identity/v3/users/068d54a76cdd4232807eb857ec4d75ff => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:13:46.196137 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a0a390-b753-4493-83ae-fa61345e9642 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:46.197582 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-61a0a390-b753-4493-83ae-fa61345e9642 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:46.219799 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a0a390-b753-4493-83ae-fa61345e9642 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:46.308048 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd26133-470a-41c4-8155-f5498c3b53ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:46.309274 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd26133-470a-41c4-8155-f5498c3b53ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:46.309639 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd26133-470a-41c4-8155-f5498c3b53ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:46.309974 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd26133-470a-41c4-8155-f5498c3b53ce admin admin] PATH_INFO: `/v3/users/99913754bd0941cd927f7f1f74772e7b` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:46.311425 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd26133-470a-41c4-8155-f5498c3b53ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=99913754bd0941cd927f7f1f74772e7b)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:46.313416 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd26133-470a-41c4-8155-f5498c3b53ce admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:46.365778 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-0cd26133-470a-41c4-8155-f5498c3b53ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99913754bd0941cd927f7f1f74772e7b'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:46.373994 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-0cd26133-470a-41c4-8155-f5498c3b53ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99913754bd0941cd927f7f1f74772e7b'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:46.385921 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-0cd26133-470a-41c4-8155-f5498c3b53ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99913754bd0941cd927f7f1f74772e7b'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:46.386847 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-0cd26133-470a-41c4-8155-f5498c3b53ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99913754bd0941cd927f7f1f74772e7b'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:46.403810 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-0cd26133-470a-41c4-8155-f5498c3b53ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99913754bd0941cd927f7f1f74772e7b'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:46.406215 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:13:46.417915 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 917/1817] 10.222.0.79 () {58 vars in 1224 bytes} [Tue Aug 30 01:13:46 2022] DELETE /identity/v3/users/99913754bd0941cd927f7f1f74772e7b => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:13:46.422825 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13ee757-eaf9-4694-94ab-b566878abeac None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:46.423796 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13ee757-eaf9-4694-94ab-b566878abeac None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:46.424546 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13ee757-eaf9-4694-94ab-b566878abeac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:46.447350 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-f13ee757-eaf9-4694-94ab-b566878abeac None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:13:46.449128 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-f13ee757-eaf9-4694-94ab-b566878abeac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:46.527825 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:13:46.545910 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 901/1818] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:13:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:13:46.588379 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd26133-470a-41c4-8155-f5498c3b53ce admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:46.590076 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-0cd26133-470a-41c4-8155-f5498c3b53ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:46.706413 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd26133-470a-41c4-8155-f5498c3b53ce admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:46.718208 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93055c98-d071-42b2-a991-6df9aa9818de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16e6a0ca26fc4ef892c188ad89a1e132', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:46.719277 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93055c98-d071-42b2-a991-6df9aa9818de service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:46.719277 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93055c98-d071-42b2-a991-6df9aa9818de service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:46.721579 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93055c98-d071-42b2-a991-6df9aa9818de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:46.746408 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93055c98-d071-42b2-a991-6df9aa9818de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:46.749750 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93055c98-d071-42b2-a991-6df9aa9818de service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:46.776046 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 918/1819] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:13:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:13:46.961487 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13ee757-eaf9-4694-94ab-b566878abeac None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:46.963572 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-f13ee757-eaf9-4694-94ab-b566878abeac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:47.011754 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13ee757-eaf9-4694-94ab-b566878abeac None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:47.019746 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290cc5d8-df17-4f59-9f36-72aa90f6bd9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:47.020821 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290cc5d8-df17-4f59-9f36-72aa90f6bd9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:47.021318 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290cc5d8-df17-4f59-9f36-72aa90f6bd9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:47.022076 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290cc5d8-df17-4f59-9f36-72aa90f6bd9f admin admin] PATH_INFO: `/v3/projects/d652190d15eb4301ab0ec408d493c7aa` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:47.024592 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290cc5d8-df17-4f59-9f36-72aa90f6bd9f admin admin] RBAC: Authorizing `identity:delete_project(project_id=d652190d15eb4301ab0ec408d493c7aa)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:47.027360 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290cc5d8-df17-4f59-9f36-72aa90f6bd9f admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:47.098425 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-290cc5d8-df17-4f59-9f36-72aa90f6bd9f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd652190d15eb4301ab0ec408d493c7aa', 'request_id': 'req-290cc5d8-df17-4f59-9f36-72aa90f6bd9f'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:47.111321 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-290cc5d8-df17-4f59-9f36-72aa90f6bd9f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd652190d15eb4301ab0ec408d493c7aa', 'request_id': 'req-290cc5d8-df17-4f59-9f36-72aa90f6bd9f'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:47.121270 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-290cc5d8-df17-4f59-9f36-72aa90f6bd9f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd652190d15eb4301ab0ec408d493c7aa', 'request_id': 'req-290cc5d8-df17-4f59-9f36-72aa90f6bd9f'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:47.139544 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-290cc5d8-df17-4f59-9f36-72aa90f6bd9f admin admin] The token cache is being invalidate because project d652190d15eb4301ab0ec408d493c7aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81998) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:13:47.140441 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-290cc5d8-df17-4f59-9f36-72aa90f6bd9f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:47.141952 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-290cc5d8-df17-4f59-9f36-72aa90f6bd9f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:47.145141 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 902/1820] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 30 01:13:46 2022] DELETE /identity/v3/projects/d652190d15eb4301ab0ec408d493c7aa => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:13:47.150682 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4e282e-f914-4e54-bef0-f14293eef14c None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:47.150956 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4e282e-f914-4e54-bef0-f14293eef14c None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:47.151266 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4e282e-f914-4e54-bef0-f14293eef14c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:47.202512 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-3f4e282e-f914-4e54-bef0-f14293eef14c None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:13:47.203785 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-3f4e282e-f914-4e54-bef0-f14293eef14c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:47.357536 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 919/1821] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:13:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:13:47.382024 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41fcc7f-e2a8-4085-a814-2e30a75694e1 None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:47.382581 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41fcc7f-e2a8-4085-a814-2e30a75694e1 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:47.382859 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41fcc7f-e2a8-4085-a814-2e30a75694e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:47.433202 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-e41fcc7f-e2a8-4085-a814-2e30a75694e1 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:13:47.438009 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-e41fcc7f-e2a8-4085-a814-2e30a75694e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:47.455473 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 903/1822] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:13:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:13:47.458976 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4e282e-f914-4e54-bef0-f14293eef14c None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:47.474263 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4e282e-f914-4e54-bef0-f14293eef14c None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:47.484071 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f21b5e-b6e1-44bb-9cb3-8ae7a9cc38ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:47.484960 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f21b5e-b6e1-44bb-9cb3-8ae7a9cc38ce admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:47.485285 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f21b5e-b6e1-44bb-9cb3-8ae7a9cc38ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:47.485659 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f21b5e-b6e1-44bb-9cb3-8ae7a9cc38ce admin admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:47.486471 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f21b5e-b6e1-44bb-9cb3-8ae7a9cc38ce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:13:47.486858 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f21b5e-b6e1-44bb-9cb3-8ae7a9cc38ce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:47.490387 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f21b5e-b6e1-44bb-9cb3-8ae7a9cc38ce admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:47.513755 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 920/1823] 10.222.0.79 () {58 vars in 1153 bytes} [Tue Aug 30 01:13:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:13:47.514682 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41fcc7f-e2a8-4085-a814-2e30a75694e1 None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:47.527414 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41fcc7f-e2a8-4085-a814-2e30a75694e1 None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:47.533250 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb48269a-1fee-41e5-9b3d-ba7ee8c87dc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:47.534055 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb48269a-1fee-41e5-9b3d-ba7ee8c87dc2 admin admin] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:47.534172 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb48269a-1fee-41e5-9b3d-ba7ee8c87dc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:47.534432 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb48269a-1fee-41e5-9b3d-ba7ee8c87dc2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:47.535221 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb48269a-1fee-41e5-9b3d-ba7ee8c87dc2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:47.537115 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb48269a-1fee-41e5-9b3d-ba7ee8c87dc2 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:47.587174 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 904/1824] 10.222.0.79 () {60 vars in 1153 bytes} [Tue Aug 30 01:13:47 2022] POST /identity/v3/projects => generated 381 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:13:47.589671 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f21b5e-b6e1-44bb-9cb3-8ae7a9cc38ce admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:47.614687 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f21b5e-b6e1-44bb-9cb3-8ae7a9cc38ce admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:47.623883 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb48269a-1fee-41e5-9b3d-ba7ee8c87dc2 admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:47.626162 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-fb48269a-1fee-41e5-9b3d-ba7ee8c87dc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:47.762041 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb48269a-1fee-41e5-9b3d-ba7ee8c87dc2 admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:47.770120 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9b047b-719b-412e-8b95-d41680548019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:47.772887 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9b047b-719b-412e-8b95-d41680548019 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:47.773490 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9b047b-719b-412e-8b95-d41680548019 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:47.774422 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9b047b-719b-412e-8b95-d41680548019 admin admin] PATH_INFO: `/v3/projects/7f78950d0e444251b60155a9961f9c25` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:47.786531 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9b047b-719b-412e-8b95-d41680548019 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f78950d0e444251b60155a9961f9c25)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:47.791723 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801e096c-2a39-4cdc-9886-3f908bb93bc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:47.791723 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801e096c-2a39-4cdc-9886-3f908bb93bc7 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:47.791723 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801e096c-2a39-4cdc-9886-3f908bb93bc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:47.791723 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801e096c-2a39-4cdc-9886-3f908bb93bc7 admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:47.792750 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801e096c-2a39-4cdc-9886-3f908bb93bc7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:47.792750 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801e096c-2a39-4cdc-9886-3f908bb93bc7 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:47.792917 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9b047b-719b-412e-8b95-d41680548019 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:47.910386 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 921/1825] 10.222.0.79 () {60 vars in 1144 bytes} [Tue Aug 30 01:13:47 2022] POST /identity/v3/users => generated 291 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:13:47.914348 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801e096c-2a39-4cdc-9886-3f908bb93bc7 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:47.945977 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801e096c-2a39-4cdc-9886-3f908bb93bc7 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:47.961048 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-ef9b047b-719b-412e-8b95-d41680548019 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f78950d0e444251b60155a9961f9c25', 'request_id': 'req-ef9b047b-719b-412e-8b95-d41680548019'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:47.963651 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:13:47.969777 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:13:47.973780 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-ef9b047b-719b-412e-8b95-d41680548019 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f78950d0e444251b60155a9961f9c25', 'request_id': 'req-ef9b047b-719b-412e-8b95-d41680548019'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:47.984038 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-ef9b047b-719b-412e-8b95-d41680548019 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f78950d0e444251b60155a9961f9c25', 'request_id': 'req-ef9b047b-719b-412e-8b95-d41680548019'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:47.998560 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-ef9b047b-719b-412e-8b95-d41680548019 admin admin] The token cache is being invalidate because project 7f78950d0e444251b60155a9961f9c25 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81998) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:13:47.998903 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-ef9b047b-719b-412e-8b95-d41680548019 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:47.999584 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-ef9b047b-719b-412e-8b95-d41680548019 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:48.001276 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 905/1826] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 30 01:13:47 2022] DELETE /identity/v3/projects/7f78950d0e444251b60155a9961f9c25 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:13:48.005737 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9b047b-719b-412e-8b95-d41680548019 admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:48.007210 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-ef9b047b-719b-412e-8b95-d41680548019 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:48.062451 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7dbf9e-ed39-45dc-8d91-09b1504002bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:48.063812 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7dbf9e-ed39-45dc-8d91-09b1504002bb admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:48.064100 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7dbf9e-ed39-45dc-8d91-09b1504002bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:48.064423 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7dbf9e-ed39-45dc-8d91-09b1504002bb admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:48.065083 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7dbf9e-ed39-45dc-8d91-09b1504002bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:48.066829 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7dbf9e-ed39-45dc-8d91-09b1504002bb admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:48.086039 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 922/1827] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:13:47 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:13:48.090302 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7dbf9e-ed39-45dc-8d91-09b1504002bb admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:48.094114 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-6f7dbf9e-ed39-45dc-8d91-09b1504002bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:48.114092 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7dbf9e-ed39-45dc-8d91-09b1504002bb admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:48.119455 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9b047b-719b-412e-8b95-d41680548019 admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:48.124367 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b3247d-79fb-49cd-96bd-92eb4b4038ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:48.125001 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b3247d-79fb-49cd-96bd-92eb4b4038ba admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:48.125281 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b3247d-79fb-49cd-96bd-92eb4b4038ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:48.125556 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b3247d-79fb-49cd-96bd-92eb4b4038ba admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:48.126207 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b3247d-79fb-49cd-96bd-92eb4b4038ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:48.127903 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b3247d-79fb-49cd-96bd-92eb4b4038ba admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:48.131794 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3570674-8b71-4c3d-bb3d-7c1d6b812eef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:48.132620 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3570674-8b71-4c3d-bb3d-7c1d6b812eef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:48.133064 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3570674-8b71-4c3d-bb3d-7c1d6b812eef admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:48.133435 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3570674-8b71-4c3d-bb3d-7c1d6b812eef admin admin] PATH_INFO: `/v3/users/3bc9caad44e841e395a532c1cbd1c6fc` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:48.135080 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3570674-8b71-4c3d-bb3d-7c1d6b812eef admin admin] RBAC: Authorizing `identity:delete_user(user_id=3bc9caad44e841e395a532c1cbd1c6fc)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:48.137321 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3570674-8b71-4c3d-bb3d-7c1d6b812eef admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:48.146787 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 923/1828] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:13:48 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:13:48.147964 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b3247d-79fb-49cd-96bd-92eb4b4038ba admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:48.158646 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b3247d-79fb-49cd-96bd-92eb4b4038ba admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:48.169166 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498ca0b4-d6f5-4060-b213-3878228ed255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:48.170077 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498ca0b4-d6f5-4060-b213-3878228ed255 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:48.170457 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498ca0b4-d6f5-4060-b213-3878228ed255 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:48.170832 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498ca0b4-d6f5-4060-b213-3878228ed255 admin admin] PATH_INFO: `/v3/projects/5755536af15b48e39ec9c64136eaa8d0/users/0588a3a3400049fd96b9fda3502aacb8/roles/c37945a17623465f899d4f217e7af593` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:48.224140 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498ca0b4-d6f5-4060-b213-3878228ed255 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5755536af15b48e39ec9c64136eaa8d0, user_id=0588a3a3400049fd96b9fda3502aacb8, role_id=c37945a17623465f899d4f217e7af593)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:48.228120 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498ca0b4-d6f5-4060-b213-3878228ed255 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:48.236216 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-c3570674-8b71-4c3d-bb3d-7c1d6b812eef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3bc9caad44e841e395a532c1cbd1c6fc'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:48.254181 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-c3570674-8b71-4c3d-bb3d-7c1d6b812eef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3bc9caad44e841e395a532c1cbd1c6fc'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:48.267533 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 924/1829] 10.222.0.79 () {60 vars in 1483 bytes} [Tue Aug 30 01:13:48 2022] PUT /identity/v3/projects/5755536af15b48e39ec9c64136eaa8d0/users/0588a3a3400049fd96b9fda3502aacb8/roles/c37945a17623465f899d4f217e7af593 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:13:48.278470 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fd6de9-7bb3-45fe-bda6-8bdfa5d4c023 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:48.279092 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fd6de9-7bb3-45fe-bda6-8bdfa5d4c023 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:48.279572 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fd6de9-7bb3-45fe-bda6-8bdfa5d4c023 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:48.292549 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-c3570674-8b71-4c3d-bb3d-7c1d6b812eef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3bc9caad44e841e395a532c1cbd1c6fc'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:48.293509 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-c3570674-8b71-4c3d-bb3d-7c1d6b812eef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3bc9caad44e841e395a532c1cbd1c6fc'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:48.310548 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-c3570674-8b71-4c3d-bb3d-7c1d6b812eef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3bc9caad44e841e395a532c1cbd1c6fc'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:48.325435 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 906/1830] 10.222.0.79 () {58 vars in 1224 bytes} [Tue Aug 30 01:13:48 2022] DELETE /identity/v3/users/3bc9caad44e841e395a532c1cbd1c6fc => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:13:48.331013 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-45fd6de9-7bb3-45fe-bda6-8bdfa5d4c023 None None] MFA Rules not processed for user `0588a3a3400049fd96b9fda3502aacb8`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:13:48.332677 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-45fd6de9-7bb3-45fe-bda6-8bdfa5d4c023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:48.421753 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 925/1831] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:13:48 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:13:48.426953 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3570674-8b71-4c3d-bb3d-7c1d6b812eef admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:48.428546 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-c3570674-8b71-4c3d-bb3d-7c1d6b812eef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:48.517493 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:INSERT=2,keystone:DELETE=13,keystone:SELECT=85 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:13:48.525723 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3570674-8b71-4c3d-bb3d-7c1d6b812eef admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:48.533968 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9067c87-d12b-4e78-b33e-10ac21249587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:48.534788 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9067c87-d12b-4e78-b33e-10ac21249587 admin admin] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:48.536002 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9067c87-d12b-4e78-b33e-10ac21249587 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:48.536619 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9067c87-d12b-4e78-b33e-10ac21249587 admin admin] PATH_INFO: `/v3/projects` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:48.537468 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9067c87-d12b-4e78-b33e-10ac21249587 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:48.540468 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9067c87-d12b-4e78-b33e-10ac21249587 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:48.598783 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 907/1832] 10.222.0.79 () {60 vars in 1153 bytes} [Tue Aug 30 01:13:48 2022] POST /identity/v3/projects => generated 381 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:13:48.602379 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fd6de9-7bb3-45fe-bda6-8bdfa5d4c023 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:48.616892 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fd6de9-7bb3-45fe-bda6-8bdfa5d4c023 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:48.619573 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fb212c-6b98-45cc-bcaa-48a013960460 None None] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:48.619904 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fb212c-6b98-45cc-bcaa-48a013960460 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:48.620226 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fb212c-6b98-45cc-bcaa-48a013960460 None None] PATH_INFO: `/` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:48.622222 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 908/1833] 10.222.0.79 () {54 vars in 921 bytes} [Tue Aug 30 01:13:48 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 01:13:48.645240 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165c3cce-2c45-49ab-8ae7-1ccddc193fc3 None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:48.645778 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165c3cce-2c45-49ab-8ae7-1ccddc193fc3 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:48.646207 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165c3cce-2c45-49ab-8ae7-1ccddc193fc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:48.702549 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-165c3cce-2c45-49ab-8ae7-1ccddc193fc3 None None] MFA Rules not processed for user `6480b2f14c37474c89df9fba48f7cd91`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:13:48.709627 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-165c3cce-2c45-49ab-8ae7-1ccddc193fc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:48.760092 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aec1b15-308f-477f-a8f3-8e65b82c8c1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:48.760729 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aec1b15-308f-477f-a8f3-8e65b82c8c1d admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:48.761011 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aec1b15-308f-477f-a8f3-8e65b82c8c1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:48.761281 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aec1b15-308f-477f-a8f3-8e65b82c8c1d admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:48.761938 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aec1b15-308f-477f-a8f3-8e65b82c8c1d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:48.770597 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aec1b15-308f-477f-a8f3-8e65b82c8c1d admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:48.817709 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:13:48.840431 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 926/1834] 10.222.0.79 () {60 vars in 1144 bytes} [Tue Aug 30 01:13:48 2022] POST /identity/v3/users => generated 297 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:13:48.842816 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aec1b15-308f-477f-a8f3-8e65b82c8c1d admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:48.879282 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aec1b15-308f-477f-a8f3-8e65b82c8c1d admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:48.895635 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecb9ff5-f398-4de0-b938-a8021ae6eb4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:48.896277 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecb9ff5-f398-4de0-b938-a8021ae6eb4d admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:48.897957 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecb9ff5-f398-4de0-b938-a8021ae6eb4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:48.898245 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecb9ff5-f398-4de0-b938-a8021ae6eb4d admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:48.898918 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecb9ff5-f398-4de0-b938-a8021ae6eb4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:48.900671 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecb9ff5-f398-4de0-b938-a8021ae6eb4d admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:48.965747 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 927/1835] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:13:48 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:13:48.970316 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecb9ff5-f398-4de0-b938-a8021ae6eb4d admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:48.971932 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 909/1836] 10.222.0.79 () {58 vars in 1018 bytes} [Tue Aug 30 01:13:48 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:13:49.006174 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecb9ff5-f398-4de0-b938-a8021ae6eb4d admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:49.013266 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b2e22b-3c2a-46e9-8125-6fb0d037180b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:49.014303 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b2e22b-3c2a-46e9-8125-6fb0d037180b admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:49.014974 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b2e22b-3c2a-46e9-8125-6fb0d037180b admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:49.015779 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b2e22b-3c2a-46e9-8125-6fb0d037180b admin admin] PATH_INFO: `/v3/projects/ea63814f6e9243a5b2d9ad3d72881a4d/users/b192004bc52a4ae48a6ed4853fe69068/roles/d14c3070c9184d76a7b23df69bd3db07` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:49.055787 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b2e22b-3c2a-46e9-8125-6fb0d037180b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea63814f6e9243a5b2d9ad3d72881a4d, user_id=b192004bc52a4ae48a6ed4853fe69068, role_id=d14c3070c9184d76a7b23df69bd3db07)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:49.059866 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b2e22b-3c2a-46e9-8125-6fb0d037180b admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:49.103898 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 928/1837] 10.222.0.79 () {60 vars in 1483 bytes} [Tue Aug 30 01:13:48 2022] PUT /identity/v3/projects/ea63814f6e9243a5b2d9ad3d72881a4d/users/b192004bc52a4ae48a6ed4853fe69068/roles/d14c3070c9184d76a7b23df69bd3db07 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:13:49.104376 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165c3cce-2c45-49ab-8ae7-1ccddc193fc3 None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:49.119747 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165c3cce-2c45-49ab-8ae7-1ccddc193fc3 None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:49.152091 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b2e22b-3c2a-46e9-8125-6fb0d037180b admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:49.154022 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-94b2e22b-3c2a-46e9-8125-6fb0d037180b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:49.231290 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc52d33-801e-444e-b439-50003b5e4c52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:49.232640 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc52d33-801e-444e-b439-50003b5e4c52 admin admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:49.232985 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc52d33-801e-444e-b439-50003b5e4c52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:49.233323 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc52d33-801e-444e-b439-50003b5e4c52 admin admin] PATH_INFO: `/v3/roles` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:49.234334 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc52d33-801e-444e-b439-50003b5e4c52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:49.236597 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc52d33-801e-444e-b439-50003b5e4c52 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:49.255298 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 910/1838] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:13:49 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 01:13:49.257018 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc52d33-801e-444e-b439-50003b5e4c52 admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:49.274809 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b2e22b-3c2a-46e9-8125-6fb0d037180b admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:49.278747 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc52d33-801e-444e-b439-50003b5e4c52 admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:49.281667 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0f0e0c-4370-4944-88cd-178c7dd97a9a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6480b2f14c37474c89df9fba48f7cd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:49.282851 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0f0e0c-4370-4944-88cd-178c7dd97a9a service nova] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:49.282851 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0f0e0c-4370-4944-88cd-178c7dd97a9a service nova] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:49.283034 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0f0e0c-4370-4944-88cd-178c7dd97a9a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:49.284099 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcb9283-2b04-46e3-a244-5346a129d2d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:49.285383 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcb9283-2b04-46e3-a244-5346a129d2d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:49.285704 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcb9283-2b04-46e3-a244-5346a129d2d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:49.285994 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcb9283-2b04-46e3-a244-5346a129d2d9 admin admin] PATH_INFO: `/v3/projects/ea63814f6e9243a5b2d9ad3d72881a4d/users/b192004bc52a4ae48a6ed4853fe69068/roles/d14c3070c9184d76a7b23df69bd3db07` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:49.288247 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcb9283-2b04-46e3-a244-5346a129d2d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea63814f6e9243a5b2d9ad3d72881a4d, user_id=b192004bc52a4ae48a6ed4853fe69068, role_id=d14c3070c9184d76a7b23df69bd3db07)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:49.292212 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcb9283-2b04-46e3-a244-5346a129d2d9 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:49.295098 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0f0e0c-4370-4944-88cd-178c7dd97a9a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:49.297750 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0f0e0c-4370-4944-88cd-178c7dd97a9a service nova] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:49.307212 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 911/1839] 10.222.0.79 () {60 vars in 1483 bytes} [Tue Aug 30 01:13:49 2022] PUT /identity/v3/projects/ea63814f6e9243a5b2d9ad3d72881a4d/users/b192004bc52a4ae48a6ed4853fe69068/roles/d14c3070c9184d76a7b23df69bd3db07 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:13:49.317263 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384c64d1-9cb6-4cec-90e7-6470f091ad7e None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:49.317678 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384c64d1-9cb6-4cec-90e7-6470f091ad7e None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:49.317831 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384c64d1-9cb6-4cec-90e7-6470f091ad7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:49.339560 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 929/1840] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:13:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 01:13:49.354185 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-384c64d1-9cb6-4cec-90e7-6470f091ad7e None None] MFA Rules not processed for user `b192004bc52a4ae48a6ed4853fe69068`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:13:49.356355 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-384c64d1-9cb6-4cec-90e7-6470f091ad7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:49.417217 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:13:49.464251 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 912/1841] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:13:49 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:13:49.476783 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0f0e0c-4370-4944-88cd-178c7dd97a9a service nova] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:49.478321 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-3f0f0e0c-4370-4944-88cd-178c7dd97a9a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:49.585459 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0f0e0c-4370-4944-88cd-178c7dd97a9a service nova] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:49.682077 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3dfd43-bf5c-4057-bf4f-f3b10ad3622d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f827c7670b74d938ffe066ced88d1c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:49.684318 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3dfd43-bf5c-4057-bf4f-f3b10ad3622d service cinder] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:49.684592 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3dfd43-bf5c-4057-bf4f-f3b10ad3622d service cinder] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:49.684877 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3dfd43-bf5c-4057-bf4f-f3b10ad3622d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:49.703764 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3dfd43-bf5c-4057-bf4f-f3b10ad3622d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:49.704360 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3dfd43-bf5c-4057-bf4f-f3b10ad3622d service cinder] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:49.724130 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 930/1842] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:13:49 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:13:49.759089 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384c64d1-9cb6-4cec-90e7-6470f091ad7e None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:49.760680 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-384c64d1-9cb6-4cec-90e7-6470f091ad7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:49.882558 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3dfd43-bf5c-4057-bf4f-f3b10ad3622d service cinder] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:49.885172 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384c64d1-9cb6-4cec-90e7-6470f091ad7e None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:49.896506 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002fb8b8-08b3-457c-af19-4349134b9754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:49.897282 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002fb8b8-08b3-457c-af19-4349134b9754 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:49.897557 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002fb8b8-08b3-457c-af19-4349134b9754 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:49.897826 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002fb8b8-08b3-457c-af19-4349134b9754 admin admin] PATH_INFO: `/v3/projects/500e3b2e7e7c4632962e4d51fe6f119b` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:49.903075 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002fb8b8-08b3-457c-af19-4349134b9754 admin admin] RBAC: Authorizing `identity:delete_project(project_id=500e3b2e7e7c4632962e4d51fe6f119b)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:49.905051 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3dfd43-bf5c-4057-bf4f-f3b10ad3622d service cinder] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:49.905196 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002fb8b8-08b3-457c-af19-4349134b9754 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:49.918008 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d83b64d-4bd6-4af9-b11c-6854f10067d5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f827c7670b74d938ffe066ced88d1c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:49.920366 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d83b64d-4bd6-4af9-b11c-6854f10067d5 service cinder] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:49.922027 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d83b64d-4bd6-4af9-b11c-6854f10067d5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:49.922970 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d83b64d-4bd6-4af9-b11c-6854f10067d5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:49.934639 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:13:50.007364 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-002fb8b8-08b3-457c-af19-4349134b9754 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '500e3b2e7e7c4632962e4d51fe6f119b', 'request_id': 'req-002fb8b8-08b3-457c-af19-4349134b9754'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:50.041822 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-002fb8b8-08b3-457c-af19-4349134b9754 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '500e3b2e7e7c4632962e4d51fe6f119b', 'request_id': 'req-002fb8b8-08b3-457c-af19-4349134b9754'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:50.052162 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d83b64d-4bd6-4af9-b11c-6854f10067d5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:50.054538 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d83b64d-4bd6-4af9-b11c-6854f10067d5 service cinder] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:50.060423 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-002fb8b8-08b3-457c-af19-4349134b9754 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '500e3b2e7e7c4632962e4d51fe6f119b', 'request_id': 'req-002fb8b8-08b3-457c-af19-4349134b9754'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:50.066464 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 931/1843] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:13:49 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:13:50.078547 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-002fb8b8-08b3-457c-af19-4349134b9754 admin admin] The token cache is being invalidate because project 500e3b2e7e7c4632962e4d51fe6f119b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81998) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:13:50.078973 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-002fb8b8-08b3-457c-af19-4349134b9754 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:50.080046 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-002fb8b8-08b3-457c-af19-4349134b9754 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:50.085278 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 913/1844] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 30 01:13:49 2022] DELETE /identity/v3/projects/500e3b2e7e7c4632962e4d51fe6f119b => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:13:50.087664 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d83b64d-4bd6-4af9-b11c-6854f10067d5 service cinder] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:50.104304 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d83b64d-4bd6-4af9-b11c-6854f10067d5 service cinder] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:50.212145 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2951151-f544-4d4f-9f0e-778361d49365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:50.213234 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2951151-f544-4d4f-9f0e-778361d49365 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:50.213613 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2951151-f544-4d4f-9f0e-778361d49365 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:50.214016 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2951151-f544-4d4f-9f0e-778361d49365 admin admin] PATH_INFO: `/v3/users/c18a5849c5684bb7a35646578914f3fc` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:50.216198 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2951151-f544-4d4f-9f0e-778361d49365 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c18a5849c5684bb7a35646578914f3fc)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:50.218875 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2951151-f544-4d4f-9f0e-778361d49365 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:50.338558 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-f2951151-f544-4d4f-9f0e-778361d49365 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c18a5849c5684bb7a35646578914f3fc'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:50.358235 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-f2951151-f544-4d4f-9f0e-778361d49365 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c18a5849c5684bb7a35646578914f3fc'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:50.368742 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-f2951151-f544-4d4f-9f0e-778361d49365 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c18a5849c5684bb7a35646578914f3fc'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:50.369614 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-f2951151-f544-4d4f-9f0e-778361d49365 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c18a5849c5684bb7a35646578914f3fc'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:50.420173 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-f2951151-f544-4d4f-9f0e-778361d49365 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c18a5849c5684bb7a35646578914f3fc'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:50.452738 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 932/1845] 10.222.0.79 () {58 vars in 1224 bytes} [Tue Aug 30 01:13:50 2022] DELETE /identity/v3/users/c18a5849c5684bb7a35646578914f3fc => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:13:50.630272 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002fb8b8-08b3-457c-af19-4349134b9754 admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:50.631859 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-002fb8b8-08b3-457c-af19-4349134b9754 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:50.647677 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002fb8b8-08b3-457c-af19-4349134b9754 admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:50.734328 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4b6d15-4c75-4bb1-a64e-10b26b3e71bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:50.735591 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4b6d15-4c75-4bb1-a64e-10b26b3e71bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:50.735876 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4b6d15-4c75-4bb1-a64e-10b26b3e71bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:50.736146 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4b6d15-4c75-4bb1-a64e-10b26b3e71bf admin admin] PATH_INFO: `/v3/users/5e4f3e754d6c465ca8b73af5ff148b66` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:50.737323 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4b6d15-4c75-4bb1-a64e-10b26b3e71bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e4f3e754d6c465ca8b73af5ff148b66)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:50.740209 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4b6d15-4c75-4bb1-a64e-10b26b3e71bf admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:50.757522 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:13:50.804832 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-ad4b6d15-4c75-4bb1-a64e-10b26b3e71bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e4f3e754d6c465ca8b73af5ff148b66'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:50.813637 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-ad4b6d15-4c75-4bb1-a64e-10b26b3e71bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e4f3e754d6c465ca8b73af5ff148b66'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:50.817016 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2951151-f544-4d4f-9f0e-778361d49365 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:50.818938 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-f2951151-f544-4d4f-9f0e-778361d49365 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:50.834047 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-ad4b6d15-4c75-4bb1-a64e-10b26b3e71bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e4f3e754d6c465ca8b73af5ff148b66'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:50.834915 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-ad4b6d15-4c75-4bb1-a64e-10b26b3e71bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e4f3e754d6c465ca8b73af5ff148b66'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:50.844301 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-ad4b6d15-4c75-4bb1-a64e-10b26b3e71bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e4f3e754d6c465ca8b73af5ff148b66'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:50.852240 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 914/1846] 10.222.0.79 () {58 vars in 1224 bytes} [Tue Aug 30 01:13:50 2022] DELETE /identity/v3/users/5e4f3e754d6c465ca8b73af5ff148b66 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:13:50.855872 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2951151-f544-4d4f-9f0e-778361d49365 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:50.856809 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cfbeda-5816-49bf-91f7-a8f81c22f76a None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:50.857298 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cfbeda-5816-49bf-91f7-a8f81c22f76a None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:50.857574 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cfbeda-5816-49bf-91f7-a8f81c22f76a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:50.883995 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-71cfbeda-5816-49bf-91f7-a8f81c22f76a None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:13:50.884734 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:13:50.885475 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-71cfbeda-5816-49bf-91f7-a8f81c22f76a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:50.949977 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e899ff11-a211-4c57-a521-0d71f35b7889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:50.950784 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e899ff11-a211-4c57-a521-0d71f35b7889 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:50.951277 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e899ff11-a211-4c57-a521-0d71f35b7889 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:50.951650 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e899ff11-a211-4c57-a521-0d71f35b7889 admin admin] PATH_INFO: `/v3/projects/23421d856b0948c087a8594c276ea937` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:50.961953 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e899ff11-a211-4c57-a521-0d71f35b7889 admin admin] RBAC: Authorizing `identity:delete_project(project_id=23421d856b0948c087a8594c276ea937)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:50.964046 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e899ff11-a211-4c57-a521-0d71f35b7889 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:51.017111 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 915/1847] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:13:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:13:51.031690 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cfbeda-5816-49bf-91f7-a8f81c22f76a None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:51.033202 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-71cfbeda-5816-49bf-91f7-a8f81c22f76a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:51.069074 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-e899ff11-a211-4c57-a521-0d71f35b7889 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23421d856b0948c087a8594c276ea937', 'request_id': 'req-e899ff11-a211-4c57-a521-0d71f35b7889'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:51.078157 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-e899ff11-a211-4c57-a521-0d71f35b7889 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23421d856b0948c087a8594c276ea937', 'request_id': 'req-e899ff11-a211-4c57-a521-0d71f35b7889'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:51.088524 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-e899ff11-a211-4c57-a521-0d71f35b7889 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23421d856b0948c087a8594c276ea937', 'request_id': 'req-e899ff11-a211-4c57-a521-0d71f35b7889'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:51.126670 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-e899ff11-a211-4c57-a521-0d71f35b7889 admin admin] The token cache is being invalidate because project 23421d856b0948c087a8594c276ea937 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:13:51.127087 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-e899ff11-a211-4c57-a521-0d71f35b7889 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:51.127745 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-e899ff11-a211-4c57-a521-0d71f35b7889 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:51.129420 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cfbeda-5816-49bf-91f7-a8f81c22f76a None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:51.130045 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 933/1848] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 30 01:13:50 2022] DELETE /identity/v3/projects/23421d856b0948c087a8594c276ea937 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:13:51.136280 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd736a5-dd00-4e91-ab98-027e4f7553c1 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:51.136683 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd736a5-dd00-4e91-ab98-027e4f7553c1 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:51.137032 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd736a5-dd00-4e91-ab98-027e4f7553c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:51.158233 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-ebd736a5-dd00-4e91-ab98-027e4f7553c1 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:13:51.160183 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-ebd736a5-dd00-4e91-ab98-027e4f7553c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:51.200600 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:13:51.209304 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b338ad-4a86-4b0e-a153-a5d8a3ce98b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16e6a0ca26fc4ef892c188ad89a1e132', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:51.211220 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b338ad-4a86-4b0e-a153-a5d8a3ce98b3 service neutron] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:51.211807 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b338ad-4a86-4b0e-a153-a5d8a3ce98b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:51.212643 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b338ad-4a86-4b0e-a153-a5d8a3ce98b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:51.214766 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-f9b338ad-4a86-4b0e-a153-a5d8a3ce98b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:51.242760 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 934/1849] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:13:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:13:51.252186 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8d9632-015e-48e1-855b-fed906b44e5d None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:51.252478 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8d9632-015e-48e1-855b-fed906b44e5d None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:51.252772 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8d9632-015e-48e1-855b-fed906b44e5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:51.275442 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-db8d9632-015e-48e1-855b-fed906b44e5d None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:13:51.277152 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-db8d9632-015e-48e1-855b-fed906b44e5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:51.291502 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 935/1850] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:13:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:13:51.296194 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8d9632-015e-48e1-855b-fed906b44e5d None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:51.306466 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8d9632-015e-48e1-855b-fed906b44e5d None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:51.311713 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6699619c-6ae0-4a38-92eb-4ca552d5b5a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:51.312335 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6699619c-6ae0-4a38-92eb-4ca552d5b5a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:51.312617 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6699619c-6ae0-4a38-92eb-4ca552d5b5a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:51.312890 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6699619c-6ae0-4a38-92eb-4ca552d5b5a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:51.313555 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6699619c-6ae0-4a38-92eb-4ca552d5b5a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:13:51.313864 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6699619c-6ae0-4a38-92eb-4ca552d5b5a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:51.315499 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6699619c-6ae0-4a38-92eb-4ca552d5b5a9 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:51.327019 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b338ad-4a86-4b0e-a153-a5d8a3ce98b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:51.328530 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 936/1851] 10.222.0.79 () {58 vars in 1153 bytes} [Tue Aug 30 01:13:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:13:51.329710 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b338ad-4a86-4b0e-a153-a5d8a3ce98b3 service neutron] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:51.333520 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6699619c-6ae0-4a38-92eb-4ca552d5b5a9 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:51.346310 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6699619c-6ae0-4a38-92eb-4ca552d5b5a9 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:51.348389 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 916/1852] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:13:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:13:51.353291 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1228124f-98b5-4af3-b081-708dcb724799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:51.353963 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1228124f-98b5-4af3-b081-708dcb724799 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:51.354203 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1228124f-98b5-4af3-b081-708dcb724799 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:51.354582 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1228124f-98b5-4af3-b081-708dcb724799 admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:51.355571 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1228124f-98b5-4af3-b081-708dcb724799 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:51.357982 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1228124f-98b5-4af3-b081-708dcb724799 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:51.391256 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 937/1853] 10.222.0.79 () {60 vars in 1153 bytes} [Tue Aug 30 01:13:51 2022] POST /identity/v3/projects => generated 383 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:13:51.396064 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b338ad-4a86-4b0e-a153-a5d8a3ce98b3 service neutron] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:51.407718 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b338ad-4a86-4b0e-a153-a5d8a3ce98b3 service neutron] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:51.491470 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f8d56a-2a09-4725-8144-9779be9cef42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:51.492091 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f8d56a-2a09-4725-8144-9779be9cef42 admin admin] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:51.492367 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f8d56a-2a09-4725-8144-9779be9cef42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:51.492638 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f8d56a-2a09-4725-8144-9779be9cef42 admin admin] PATH_INFO: `/v3/users` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:51.493335 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f8d56a-2a09-4725-8144-9779be9cef42 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:51.495234 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f8d56a-2a09-4725-8144-9779be9cef42 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:51.528784 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 917/1854] 10.222.0.79 () {60 vars in 1144 bytes} [Tue Aug 30 01:13:51 2022] POST /identity/v3/users => generated 292 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:13:51.529516 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1228124f-98b5-4af3-b081-708dcb724799 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:51.543354 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1228124f-98b5-4af3-b081-708dcb724799 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:51.549538 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92264470-187d-4b77-8f11-f2a1c5b393c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:51.550510 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92264470-187d-4b77-8f11-f2a1c5b393c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:51.550894 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92264470-187d-4b77-8f11-f2a1c5b393c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:51.551273 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92264470-187d-4b77-8f11-f2a1c5b393c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:51.551995 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92264470-187d-4b77-8f11-f2a1c5b393c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:51.553681 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92264470-187d-4b77-8f11-f2a1c5b393c2 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:51.571266 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 938/1855] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:13:51 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:13:51.574487 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f8d56a-2a09-4725-8144-9779be9cef42 admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:51.585441 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f8d56a-2a09-4725-8144-9779be9cef42 admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:51.591404 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5b14c5-3a1b-44fe-b15e-d3948ee6f77c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:51.592083 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5b14c5-3a1b-44fe-b15e-d3948ee6f77c admin admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:51.592363 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5b14c5-3a1b-44fe-b15e-d3948ee6f77c admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:51.592631 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5b14c5-3a1b-44fe-b15e-d3948ee6f77c admin admin] PATH_INFO: `/v3/roles` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:51.593311 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5b14c5-3a1b-44fe-b15e-d3948ee6f77c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:51.594940 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5b14c5-3a1b-44fe-b15e-d3948ee6f77c admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:51.615739 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 918/1856] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:13:51 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:13:51.620667 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92264470-187d-4b77-8f11-f2a1c5b393c2 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:51.631400 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:13:51.672222 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92264470-187d-4b77-8f11-f2a1c5b393c2 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:51.682379 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436b56a7-5735-4f2f-afec-ca2de4348593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:51.683359 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436b56a7-5735-4f2f-afec-ca2de4348593 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:51.684468 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436b56a7-5735-4f2f-afec-ca2de4348593 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:51.684944 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436b56a7-5735-4f2f-afec-ca2de4348593 admin admin] PATH_INFO: `/v3/projects/0cc4e29b7b43438f819352c1cb28347e/users/9b76fd153f374bd78f193081e68fa4ef/roles/c37945a17623465f899d4f217e7af593` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:51.712075 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436b56a7-5735-4f2f-afec-ca2de4348593 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0cc4e29b7b43438f819352c1cb28347e, user_id=9b76fd153f374bd78f193081e68fa4ef, role_id=c37945a17623465f899d4f217e7af593)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:51.714944 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436b56a7-5735-4f2f-afec-ca2de4348593 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:51.755994 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ba9a3b-f044-4c08-a4d9-063ca2ac4906 None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:51.756617 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ba9a3b-f044-4c08-a4d9-063ca2ac4906 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:51.757155 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ba9a3b-f044-4c08-a4d9-063ca2ac4906 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:51.757774 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 939/1857] 10.222.0.79 () {60 vars in 1483 bytes} [Tue Aug 30 01:13:51 2022] PUT /identity/v3/projects/0cc4e29b7b43438f819352c1cb28347e/users/9b76fd153f374bd78f193081e68fa4ef/roles/c37945a17623465f899d4f217e7af593 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:13:51.830831 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-b6ba9a3b-f044-4c08-a4d9-063ca2ac4906 None None] MFA Rules not processed for user `9b76fd153f374bd78f193081e68fa4ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:13:51.832803 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-b6ba9a3b-f044-4c08-a4d9-063ca2ac4906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:51.845365 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436b56a7-5735-4f2f-afec-ca2de4348593 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:51.849419 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-436b56a7-5735-4f2f-afec-ca2de4348593 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:51.975433 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 919/1858] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:13:51 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:13:51.980350 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ba9a3b-f044-4c08-a4d9-063ca2ac4906 None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:51.990483 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:13:52.001186 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436b56a7-5735-4f2f-afec-ca2de4348593 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:52.007399 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16002044-016d-4d1b-8555-8ab626145f2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:52.007932 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16002044-016d-4d1b-8555-8ab626145f2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:52.008204 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16002044-016d-4d1b-8555-8ab626145f2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:52.008470 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16002044-016d-4d1b-8555-8ab626145f2d admin admin] PATH_INFO: `/v3/projects/a131f3547dd74971b52aa59043e52bb1` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:52.009618 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16002044-016d-4d1b-8555-8ab626145f2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=a131f3547dd74971b52aa59043e52bb1)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:52.011687 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16002044-016d-4d1b-8555-8ab626145f2d admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:52.090579 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ba9a3b-f044-4c08-a4d9-063ca2ac4906 None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:52.103333 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-16002044-016d-4d1b-8555-8ab626145f2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a131f3547dd74971b52aa59043e52bb1', 'request_id': 'req-16002044-016d-4d1b-8555-8ab626145f2d'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:52.118889 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-16002044-016d-4d1b-8555-8ab626145f2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a131f3547dd74971b52aa59043e52bb1', 'request_id': 'req-16002044-016d-4d1b-8555-8ab626145f2d'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:52.129508 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-16002044-016d-4d1b-8555-8ab626145f2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a131f3547dd74971b52aa59043e52bb1', 'request_id': 'req-16002044-016d-4d1b-8555-8ab626145f2d'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:52.146951 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-16002044-016d-4d1b-8555-8ab626145f2d admin admin] The token cache is being invalidate because project a131f3547dd74971b52aa59043e52bb1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:13:52.147420 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-16002044-016d-4d1b-8555-8ab626145f2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:52.148698 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-16002044-016d-4d1b-8555-8ab626145f2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:52.152956 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 940/1859] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 30 01:13:51 2022] DELETE /identity/v3/projects/a131f3547dd74971b52aa59043e52bb1 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:13:52.164424 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16002044-016d-4d1b-8555-8ab626145f2d admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:52.169236 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-16002044-016d-4d1b-8555-8ab626145f2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:52.254766 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16002044-016d-4d1b-8555-8ab626145f2d admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:52.258988 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b90699-0cf5-46fc-aaf8-541a0a069178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:52.260130 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b90699-0cf5-46fc-aaf8-541a0a069178 admin admin] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:52.260420 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b90699-0cf5-46fc-aaf8-541a0a069178 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:52.260801 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b90699-0cf5-46fc-aaf8-541a0a069178 admin admin] PATH_INFO: `/v3/projects` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:52.261453 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b90699-0cf5-46fc-aaf8-541a0a069178 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:52.263036 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90260099-381b-4539-a761-2bdfbc8ade55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:52.263933 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90260099-381b-4539-a761-2bdfbc8ade55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:52.264326 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90260099-381b-4539-a761-2bdfbc8ade55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:52.264706 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90260099-381b-4539-a761-2bdfbc8ade55 admin admin] PATH_INFO: `/v3/users/b01f56fff7594624a92f426455c0680f` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:52.265373 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b90699-0cf5-46fc-aaf8-541a0a069178 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:52.266211 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90260099-381b-4539-a761-2bdfbc8ade55 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b01f56fff7594624a92f426455c0680f)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:52.269932 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90260099-381b-4539-a761-2bdfbc8ade55 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:52.287325 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:13:52.319639 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 920/1860] 10.222.0.79 () {60 vars in 1153 bytes} [Tue Aug 30 01:13:51 2022] POST /identity/v3/projects => generated 383 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:13:52.322098 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b90699-0cf5-46fc-aaf8-541a0a069178 admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:52.323334 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-59b90699-0cf5-46fc-aaf8-541a0a069178 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:52.362692 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-90260099-381b-4539-a761-2bdfbc8ade55 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b01f56fff7594624a92f426455c0680f'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:52.377303 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-90260099-381b-4539-a761-2bdfbc8ade55 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b01f56fff7594624a92f426455c0680f'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:52.392174 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-90260099-381b-4539-a761-2bdfbc8ade55 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b01f56fff7594624a92f426455c0680f'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:52.393079 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-90260099-381b-4539-a761-2bdfbc8ade55 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b01f56fff7594624a92f426455c0680f'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:52.419559 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-90260099-381b-4539-a761-2bdfbc8ade55 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b01f56fff7594624a92f426455c0680f'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:52.432412 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b90699-0cf5-46fc-aaf8-541a0a069178 admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:52.435633 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 941/1861] 10.222.0.79 () {58 vars in 1224 bytes} [Tue Aug 30 01:13:52 2022] DELETE /identity/v3/users/b01f56fff7594624a92f426455c0680f => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:13:52.561257 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:13:52.588971 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b295fcc-1d03-47fd-a4bd-6d9100011969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:52.589900 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b295fcc-1d03-47fd-a4bd-6d9100011969 admin admin] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:52.590321 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b295fcc-1d03-47fd-a4bd-6d9100011969 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:52.590834 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b295fcc-1d03-47fd-a4bd-6d9100011969 admin admin] PATH_INFO: `/v3/users` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:52.592188 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b295fcc-1d03-47fd-a4bd-6d9100011969 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:52.595712 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b295fcc-1d03-47fd-a4bd-6d9100011969 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:52.638957 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 921/1862] 10.222.0.79 () {60 vars in 1144 bytes} [Tue Aug 30 01:13:52 2022] POST /identity/v3/users => generated 298 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:13:52.642876 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90260099-381b-4539-a761-2bdfbc8ade55 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:52.645727 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-90260099-381b-4539-a761-2bdfbc8ade55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:52.662919 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90260099-381b-4539-a761-2bdfbc8ade55 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:52.670533 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c63b68-ef70-4b99-b523-74be10297029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:52.671397 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c63b68-ef70-4b99-b523-74be10297029 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:52.671961 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c63b68-ef70-4b99-b523-74be10297029 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:52.672394 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c63b68-ef70-4b99-b523-74be10297029 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:52.673881 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c63b68-ef70-4b99-b523-74be10297029 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:52.676398 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c63b68-ef70-4b99-b523-74be10297029 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:52.701455 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 942/1863] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:13:52 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 01:13:52.706662 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b295fcc-1d03-47fd-a4bd-6d9100011969 admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:52.719778 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b295fcc-1d03-47fd-a4bd-6d9100011969 admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:52.728893 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cc5cc2-729d-44f4-83d2-e549ceffbc4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:52.729821 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cc5cc2-729d-44f4-83d2-e549ceffbc4b admin admin] REQUEST_METHOD: `PUT` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:52.730137 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cc5cc2-729d-44f4-83d2-e549ceffbc4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:52.730412 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cc5cc2-729d-44f4-83d2-e549ceffbc4b admin admin] PATH_INFO: `/v3/projects/87126804ec6d4516be245397e204ac32/users/7ceb88e30d6542f9b99bdd069ee5490c/roles/d14c3070c9184d76a7b23df69bd3db07` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:52.759930 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cc5cc2-729d-44f4-83d2-e549ceffbc4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=87126804ec6d4516be245397e204ac32, user_id=7ceb88e30d6542f9b99bdd069ee5490c, role_id=d14c3070c9184d76a7b23df69bd3db07)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:52.763072 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cc5cc2-729d-44f4-83d2-e549ceffbc4b admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:52.790508 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c63b68-ef70-4b99-b523-74be10297029 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:52.791308 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 922/1864] 10.222.0.79 () {60 vars in 1483 bytes} [Tue Aug 30 01:13:52 2022] PUT /identity/v3/projects/87126804ec6d4516be245397e204ac32/users/7ceb88e30d6542f9b99bdd069ee5490c/roles/d14c3070c9184d76a7b23df69bd3db07 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:13:52.805562 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c63b68-ef70-4b99-b523-74be10297029 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:52.896284 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a109392-8808-45c1-aed0-932660e1573d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:52.896962 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a109392-8808-45c1-aed0-932660e1573d admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:52.897268 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a109392-8808-45c1-aed0-932660e1573d admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:52.897537 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a109392-8808-45c1-aed0-932660e1573d admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:52.898211 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a109392-8808-45c1-aed0-932660e1573d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:52.901526 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a109392-8808-45c1-aed0-932660e1573d admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:52.915274 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 943/1865] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:13:52 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:13:52.919523 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cc5cc2-729d-44f4-83d2-e549ceffbc4b admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:52.931924 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cc5cc2-729d-44f4-83d2-e549ceffbc4b admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:52.940486 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83de53ee-51f5-49d5-9365-90afd63c3f42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:52.942048 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83de53ee-51f5-49d5-9365-90afd63c3f42 admin admin] REQUEST_METHOD: `PUT` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:52.942392 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83de53ee-51f5-49d5-9365-90afd63c3f42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:52.942734 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83de53ee-51f5-49d5-9365-90afd63c3f42 admin admin] PATH_INFO: `/v3/projects/87126804ec6d4516be245397e204ac32/users/7ceb88e30d6542f9b99bdd069ee5490c/roles/d14c3070c9184d76a7b23df69bd3db07` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:52.945269 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83de53ee-51f5-49d5-9365-90afd63c3f42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87126804ec6d4516be245397e204ac32, user_id=7ceb88e30d6542f9b99bdd069ee5490c, role_id=d14c3070c9184d76a7b23df69bd3db07)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:52.949280 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83de53ee-51f5-49d5-9365-90afd63c3f42 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:52.971205 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 923/1866] 10.222.0.79 () {60 vars in 1483 bytes} [Tue Aug 30 01:13:52 2022] PUT /identity/v3/projects/87126804ec6d4516be245397e204ac32/users/7ceb88e30d6542f9b99bdd069ee5490c/roles/d14c3070c9184d76a7b23df69bd3db07 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:13:52.973843 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8338b973-6f7a-4ecc-89f0-8f0bd49a71f3 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:52.973972 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8338b973-6f7a-4ecc-89f0-8f0bd49a71f3 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:52.974245 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8338b973-6f7a-4ecc-89f0-8f0bd49a71f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:53.019707 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-8338b973-6f7a-4ecc-89f0-8f0bd49a71f3 None None] MFA Rules not processed for user `7ceb88e30d6542f9b99bdd069ee5490c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:13:53.021198 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-8338b973-6f7a-4ecc-89f0-8f0bd49a71f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:53.045184 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83de53ee-51f5-49d5-9365-90afd63c3f42 admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:53.047486 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-83de53ee-51f5-49d5-9365-90afd63c3f42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:53.117677 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:13:53.126495 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 944/1867] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:13:52 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:13:53.188828 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8338b973-6f7a-4ecc-89f0-8f0bd49a71f3 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:53.190490 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-8338b973-6f7a-4ecc-89f0-8f0bd49a71f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:53.247896 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83de53ee-51f5-49d5-9365-90afd63c3f42 admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:53.257190 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9827f1-557e-429f-97ad-3cbc5dd450bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:53.260116 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9827f1-557e-429f-97ad-3cbc5dd450bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:53.260675 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9827f1-557e-429f-97ad-3cbc5dd450bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:53.261335 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9827f1-557e-429f-97ad-3cbc5dd450bc admin admin] PATH_INFO: `/v3/projects/c0dca63736e547fc8547055137f4a3d0` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:53.263178 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9827f1-557e-429f-97ad-3cbc5dd450bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0dca63736e547fc8547055137f4a3d0)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:53.267023 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9827f1-557e-429f-97ad-3cbc5dd450bc admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:53.316073 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8338b973-6f7a-4ecc-89f0-8f0bd49a71f3 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:53.323424 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5780ccd0-59e6-4b2b-abda-cddbd3070e5e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f827c7670b74d938ffe066ced88d1c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:53.325041 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5780ccd0-59e6-4b2b-abda-cddbd3070e5e service cinder] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:53.325578 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5780ccd0-59e6-4b2b-abda-cddbd3070e5e service cinder] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:53.325860 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5780ccd0-59e6-4b2b-abda-cddbd3070e5e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:53.337903 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5780ccd0-59e6-4b2b-abda-cddbd3070e5e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:53.339409 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5780ccd0-59e6-4b2b-abda-cddbd3070e5e service cinder] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:53.352008 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 945/1868] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:13:53 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 01:13:53.354578 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-3c9827f1-557e-429f-97ad-3cbc5dd450bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0dca63736e547fc8547055137f4a3d0', 'request_id': 'req-3c9827f1-557e-429f-97ad-3cbc5dd450bc'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:53.366232 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-3c9827f1-557e-429f-97ad-3cbc5dd450bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0dca63736e547fc8547055137f4a3d0', 'request_id': 'req-3c9827f1-557e-429f-97ad-3cbc5dd450bc'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:53.375551 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-3c9827f1-557e-429f-97ad-3cbc5dd450bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0dca63736e547fc8547055137f4a3d0', 'request_id': 'req-3c9827f1-557e-429f-97ad-3cbc5dd450bc'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:53.389324 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-3c9827f1-557e-429f-97ad-3cbc5dd450bc admin admin] The token cache is being invalidate because project c0dca63736e547fc8547055137f4a3d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81998) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:13:53.390137 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-3c9827f1-557e-429f-97ad-3cbc5dd450bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:53.390711 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-3c9827f1-557e-429f-97ad-3cbc5dd450bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:53.392392 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 924/1869] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 30 01:13:53 2022] DELETE /identity/v3/projects/c0dca63736e547fc8547055137f4a3d0 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:13:53.397560 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fec8ba-3350-40b7-a796-d3dee1f7499f None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:53.398102 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fec8ba-3350-40b7-a796-d3dee1f7499f None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:53.398102 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fec8ba-3350-40b7-a796-d3dee1f7499f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:53.440911 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-79fec8ba-3350-40b7-a796-d3dee1f7499f None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:13:53.442153 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-79fec8ba-3350-40b7-a796-d3dee1f7499f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:53.480408 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9827f1-557e-429f-97ad-3cbc5dd450bc admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:53.481848 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-3c9827f1-557e-429f-97ad-3cbc5dd450bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:53.525742 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=87,keystone:INSERT=6,keystone:DELETE=7 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:13:53.531277 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 946/1870] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:13:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:13:53.538027 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931c42c3-12d2-41ff-aa95-bc1513793381 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:53.538326 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931c42c3-12d2-41ff-aa95-bc1513793381 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:53.538592 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931c42c3-12d2-41ff-aa95-bc1513793381 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:53.568516 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9827f1-557e-429f-97ad-3cbc5dd450bc admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:53.573016 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-931c42c3-12d2-41ff-aa95-bc1513793381 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:13:53.573232 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fab472a-8d82-4ac6-ac71-e285509e8335 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f827c7670b74d938ffe066ced88d1c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:53.573988 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fab472a-8d82-4ac6-ac71-e285509e8335 service cinder] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:53.574399 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fab472a-8d82-4ac6-ac71-e285509e8335 service cinder] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:53.574847 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fab472a-8d82-4ac6-ac71-e285509e8335 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:53.576421 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-931c42c3-12d2-41ff-aa95-bc1513793381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:53.577658 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-1fab472a-8d82-4ac6-ac71-e285509e8335 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:53.587891 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 947/1871] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:13:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:13:53.592356 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931c42c3-12d2-41ff-aa95-bc1513793381 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:53.613748 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931c42c3-12d2-41ff-aa95-bc1513793381 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:53.629333 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4041433-06e3-460a-b928-4e6915f70ca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:53.629971 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4041433-06e3-460a-b928-4e6915f70ca3 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:53.630248 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4041433-06e3-460a-b928-4e6915f70ca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:53.630552 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4041433-06e3-460a-b928-4e6915f70ca3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:53.631327 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4041433-06e3-460a-b928-4e6915f70ca3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:13:53.631634 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4041433-06e3-460a-b928-4e6915f70ca3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:53.633887 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4041433-06e3-460a-b928-4e6915f70ca3 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:53.655287 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 948/1872] 10.222.0.79 () {58 vars in 1153 bytes} [Tue Aug 30 01:13:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:13:53.655287 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4041433-06e3-460a-b928-4e6915f70ca3 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:53.655287 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-d4041433-06e3-460a-b928-4e6915f70ca3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:53.669186 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4041433-06e3-460a-b928-4e6915f70ca3 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:53.674814 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdeca5a-42d3-4f9c-8df6-0d66f371fc34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:53.676003 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fab472a-8d82-4ac6-ac71-e285509e8335 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:53.676206 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdeca5a-42d3-4f9c-8df6-0d66f371fc34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:53.676507 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdeca5a-42d3-4f9c-8df6-0d66f371fc34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:53.676727 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdeca5a-42d3-4f9c-8df6-0d66f371fc34 admin admin] PATH_INFO: `/v3/users/f76ec2d85b5f4398a7889d3658013b7c` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:53.677737 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fab472a-8d82-4ac6-ac71-e285509e8335 service cinder] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:53.678377 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdeca5a-42d3-4f9c-8df6-0d66f371fc34 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f76ec2d85b5f4398a7889d3658013b7c)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:53.680515 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdeca5a-42d3-4f9c-8df6-0d66f371fc34 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:53.703307 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 925/1873] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:13:53 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 01:13:53.706516 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fab472a-8d82-4ac6-ac71-e285509e8335 service cinder] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:53.732104 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fab472a-8d82-4ac6-ac71-e285509e8335 service cinder] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:53.752800 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d495a90-d8a6-49d0-9a63-1ceeef000d10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:53.755490 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d495a90-d8a6-49d0-9a63-1ceeef000d10 admin admin] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:53.757944 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d495a90-d8a6-49d0-9a63-1ceeef000d10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:53.758844 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d495a90-d8a6-49d0-9a63-1ceeef000d10 admin admin] PATH_INFO: `/v3/projects` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:53.760353 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d495a90-d8a6-49d0-9a63-1ceeef000d10 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:53.764989 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d495a90-d8a6-49d0-9a63-1ceeef000d10 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:53.769602 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-fbdeca5a-42d3-4f9c-8df6-0d66f371fc34 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f76ec2d85b5f4398a7889d3658013b7c'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:53.803821 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-fbdeca5a-42d3-4f9c-8df6-0d66f371fc34 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f76ec2d85b5f4398a7889d3658013b7c'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:53.818689 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-fbdeca5a-42d3-4f9c-8df6-0d66f371fc34 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f76ec2d85b5f4398a7889d3658013b7c'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:53.819539 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-fbdeca5a-42d3-4f9c-8df6-0d66f371fc34 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f76ec2d85b5f4398a7889d3658013b7c'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:53.822391 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 926/1874] 10.222.0.79 () {60 vars in 1153 bytes} [Tue Aug 30 01:13:53 2022] POST /identity/v3/projects => generated 367 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:13:53.826614 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d495a90-d8a6-49d0-9a63-1ceeef000d10 admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:53.828729 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-0d495a90-d8a6-49d0-9a63-1ceeef000d10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:53.836491 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-fbdeca5a-42d3-4f9c-8df6-0d66f371fc34 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f76ec2d85b5f4398a7889d3658013b7c'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:53.843680 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:13:53.850701 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 949/1875] 10.222.0.79 () {58 vars in 1224 bytes} [Tue Aug 30 01:13:53 2022] DELETE /identity/v3/users/f76ec2d85b5f4398a7889d3658013b7c => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:13:53.855198 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250b7bb6-33be-4051-9fef-ad20f89ccf78 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:53.855501 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250b7bb6-33be-4051-9fef-ad20f89ccf78 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:53.856285 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250b7bb6-33be-4051-9fef-ad20f89ccf78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:53.889256 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-250b7bb6-33be-4051-9fef-ad20f89ccf78 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:13:53.892344 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-250b7bb6-33be-4051-9fef-ad20f89ccf78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:53.944026 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d495a90-d8a6-49d0-9a63-1ceeef000d10 admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:54.012475 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 950/1876] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:13:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:13:54.026741 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250b7bb6-33be-4051-9fef-ad20f89ccf78 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:54.028247 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-250b7bb6-33be-4051-9fef-ad20f89ccf78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:54.069055 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1283743-9e9b-4c33-95f6-d26743abb75d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:54.069808 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1283743-9e9b-4c33-95f6-d26743abb75d admin admin] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:54.074157 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1283743-9e9b-4c33-95f6-d26743abb75d admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:54.074478 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1283743-9e9b-4c33-95f6-d26743abb75d admin admin] PATH_INFO: `/v3/users` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:54.075300 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1283743-9e9b-4c33-95f6-d26743abb75d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:54.077374 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1283743-9e9b-4c33-95f6-d26743abb75d admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:54.114639 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:13:54.132358 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 927/1877] 10.222.0.79 () {60 vars in 1144 bytes} [Tue Aug 30 01:13:53 2022] POST /identity/v3/users => generated 284 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:13:54.133579 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1283743-9e9b-4c33-95f6-d26743abb75d admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:54.156296 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1283743-9e9b-4c33-95f6-d26743abb75d admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:54.160366 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250b7bb6-33be-4051-9fef-ad20f89ccf78 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:54.167794 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4b90bf-aba3-4f14-a2ff-b087b452d9b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:54.169374 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2f3b19-cb32-4571-82b6-7dd46c28d6ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16e6a0ca26fc4ef892c188ad89a1e132', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:54.170915 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2f3b19-cb32-4571-82b6-7dd46c28d6ac service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:54.171187 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4b90bf-aba3-4f14-a2ff-b087b452d9b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:54.171655 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4b90bf-aba3-4f14-a2ff-b087b452d9b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:54.172027 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2f3b19-cb32-4571-82b6-7dd46c28d6ac service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:54.172401 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4b90bf-aba3-4f14-a2ff-b087b452d9b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:54.172820 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2f3b19-cb32-4571-82b6-7dd46c28d6ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:54.173622 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4b90bf-aba3-4f14-a2ff-b087b452d9b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:54.178479 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4b90bf-aba3-4f14-a2ff-b087b452d9b7 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:54.216156 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2f3b19-cb32-4571-82b6-7dd46c28d6ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:54.217840 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2f3b19-cb32-4571-82b6-7dd46c28d6ac service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:54.228641 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 928/1878] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:13:54 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:13:54.237145 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 951/1879] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:13:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 01:13:54.243297 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2f3b19-cb32-4571-82b6-7dd46c28d6ac service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:54.252017 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4b90bf-aba3-4f14-a2ff-b087b452d9b7 admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:54.256734 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2f3b19-cb32-4571-82b6-7dd46c28d6ac service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:54.260484 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-dd4b90bf-aba3-4f14-a2ff-b087b452d9b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:54.263496 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00714e2d-0fc3-4859-973d-96612cfdfef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:54.264247 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00714e2d-0fc3-4859-973d-96612cfdfef1 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:54.264588 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00714e2d-0fc3-4859-973d-96612cfdfef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:54.265062 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00714e2d-0fc3-4859-973d-96612cfdfef1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:54.265746 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00714e2d-0fc3-4859-973d-96612cfdfef1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:54.267911 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00714e2d-0fc3-4859-973d-96612cfdfef1 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:54.282519 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 952/1880] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:13:54 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:13:54.283775 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00714e2d-0fc3-4859-973d-96612cfdfef1 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:54.301909 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00714e2d-0fc3-4859-973d-96612cfdfef1 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:54.307578 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aab7bff-90a7-401b-a84b-29a9aa7f5115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:54.308325 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aab7bff-90a7-401b-a84b-29a9aa7f5115 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:54.308704 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aab7bff-90a7-401b-a84b-29a9aa7f5115 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:54.309122 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aab7bff-90a7-401b-a84b-29a9aa7f5115 admin admin] PATH_INFO: `/v3/projects/795e8c8207d54e278b0b7f0bbd2a4cce/users/ee003da4d9aa4918ba44fa04baf7e8b5/roles/c37945a17623465f899d4f217e7af593` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:54.326147 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4b90bf-aba3-4f14-a2ff-b087b452d9b7 admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:54.341222 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9efa2ce-f121-4f3f-8fa2-d3b25a9bd6ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:54.342096 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9efa2ce-f121-4f3f-8fa2-d3b25a9bd6ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:54.342552 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9efa2ce-f121-4f3f-8fa2-d3b25a9bd6ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:54.342839 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9efa2ce-f121-4f3f-8fa2-d3b25a9bd6ea admin admin] PATH_INFO: `/v3/users/9b76fd153f374bd78f193081e68fa4ef` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:54.344104 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9efa2ce-f121-4f3f-8fa2-d3b25a9bd6ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b76fd153f374bd78f193081e68fa4ef)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:54.346690 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9efa2ce-f121-4f3f-8fa2-d3b25a9bd6ea admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:54.346789 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aab7bff-90a7-401b-a84b-29a9aa7f5115 admin admin] RBAC: Authorizing `identity:create_grant(project_id=795e8c8207d54e278b0b7f0bbd2a4cce, user_id=ee003da4d9aa4918ba44fa04baf7e8b5, role_id=c37945a17623465f899d4f217e7af593)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:54.349522 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aab7bff-90a7-401b-a84b-29a9aa7f5115 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:54.382620 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 953/1881] 10.222.0.79 () {60 vars in 1483 bytes} [Tue Aug 30 01:13:54 2022] PUT /identity/v3/projects/795e8c8207d54e278b0b7f0bbd2a4cce/users/ee003da4d9aa4918ba44fa04baf7e8b5/roles/c37945a17623465f899d4f217e7af593 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:13:54.393134 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e3584a-ef68-486c-9c42-f39f57fd2977 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:54.393479 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e3584a-ef68-486c-9c42-f39f57fd2977 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:54.393709 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e3584a-ef68-486c-9c42-f39f57fd2977 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:54.436951 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-e9efa2ce-f121-4f3f-8fa2-d3b25a9bd6ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b76fd153f374bd78f193081e68fa4ef'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:54.450496 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-e9efa2ce-f121-4f3f-8fa2-d3b25a9bd6ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b76fd153f374bd78f193081e68fa4ef'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:54.454002 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-c7e3584a-ef68-486c-9c42-f39f57fd2977 None None] MFA Rules not processed for user `ee003da4d9aa4918ba44fa04baf7e8b5`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:13:54.455280 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-c7e3584a-ef68-486c-9c42-f39f57fd2977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:54.471177 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-e9efa2ce-f121-4f3f-8fa2-d3b25a9bd6ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b76fd153f374bd78f193081e68fa4ef'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:54.473157 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-e9efa2ce-f121-4f3f-8fa2-d3b25a9bd6ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b76fd153f374bd78f193081e68fa4ef'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:54.488284 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-e9efa2ce-f121-4f3f-8fa2-d3b25a9bd6ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b76fd153f374bd78f193081e68fa4ef'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:54.498576 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 929/1882] 10.222.0.79 () {58 vars in 1224 bytes} [Tue Aug 30 01:13:54 2022] DELETE /identity/v3/users/9b76fd153f374bd78f193081e68fa4ef => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:13:54.504606 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eb91ba-174e-40bb-9256-f78ee79fd1b3 None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:54.504989 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eb91ba-174e-40bb-9256-f78ee79fd1b3 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:54.505438 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eb91ba-174e-40bb-9256-f78ee79fd1b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:54.548714 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-59eb91ba-174e-40bb-9256-f78ee79fd1b3 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:13:54.552070 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-59eb91ba-174e-40bb-9256-f78ee79fd1b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:54.555819 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:DELETE=1,keystone:SELECT=98,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:13:54.644601 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 954/1883] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:13:54 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:13:54.648980 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e3584a-ef68-486c-9c42-f39f57fd2977 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:54.655038 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-c7e3584a-ef68-486c-9c42-f39f57fd2977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:54.663382 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 930/1884] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:13:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:13:54.698881 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59eb91ba-174e-40bb-9256-f78ee79fd1b3 None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:54.700326 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-59eb91ba-174e-40bb-9256-f78ee79fd1b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:54.830280 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e3584a-ef68-486c-9c42-f39f57fd2977 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:54.846281 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1f1645-384f-4b13-9a1e-148d37a90432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:54.848423 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1f1645-384f-4b13-9a1e-148d37a90432 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:54.849844 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1f1645-384f-4b13-9a1e-148d37a90432 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:54.850131 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1f1645-384f-4b13-9a1e-148d37a90432 admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:54.851470 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1f1645-384f-4b13-9a1e-148d37a90432 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:54.856744 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1f1645-384f-4b13-9a1e-148d37a90432 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:54.858730 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59eb91ba-174e-40bb-9256-f78ee79fd1b3 None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:54.867670 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cda8f2b-b158-41bb-9f27-2532a73f0396 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16e6a0ca26fc4ef892c188ad89a1e132', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:54.875312 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cda8f2b-b158-41bb-9f27-2532a73f0396 service neutron] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:54.875312 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cda8f2b-b158-41bb-9f27-2532a73f0396 service neutron] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:54.875312 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cda8f2b-b158-41bb-9f27-2532a73f0396 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:54.880454 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cda8f2b-b158-41bb-9f27-2532a73f0396 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:54.882077 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cda8f2b-b158-41bb-9f27-2532a73f0396 service neutron] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:54.894803 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 931/1885] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:13:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:13:54.958783 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 955/1886] 10.222.0.79 () {60 vars in 1153 bytes} [Tue Aug 30 01:13:54 2022] POST /identity/v3/projects => generated 365 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:13:54.964416 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cda8f2b-b158-41bb-9f27-2532a73f0396 service neutron] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:54.964957 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1f1645-384f-4b13-9a1e-148d37a90432 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:54.966315 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-4cda8f2b-b158-41bb-9f27-2532a73f0396 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:54.981638 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:13:54.995980 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cda8f2b-b158-41bb-9f27-2532a73f0396 service neutron] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:55.092524 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbfe62d-aa88-4d69-b135-767f369e9261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:55.093238 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbfe62d-aa88-4d69-b135-767f369e9261 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:55.093614 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbfe62d-aa88-4d69-b135-767f369e9261 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:55.093955 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbfe62d-aa88-4d69-b135-767f369e9261 admin admin] PATH_INFO: `/v3/projects/79c722880ce5445db0de2861c532cbdd` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:55.096696 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbfe62d-aa88-4d69-b135-767f369e9261 admin admin] RBAC: Authorizing `identity:delete_project(project_id=79c722880ce5445db0de2861c532cbdd)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:55.111513 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbfe62d-aa88-4d69-b135-767f369e9261 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:55.137685 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1f1645-384f-4b13-9a1e-148d37a90432 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:55.153825 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fc4b83-2566-45ef-9728-15d7daaf0f0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:55.155111 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fc4b83-2566-45ef-9728-15d7daaf0f0b admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:55.155413 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fc4b83-2566-45ef-9728-15d7daaf0f0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:55.155689 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fc4b83-2566-45ef-9728-15d7daaf0f0b admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:55.156585 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fc4b83-2566-45ef-9728-15d7daaf0f0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:55.176811 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fc4b83-2566-45ef-9728-15d7daaf0f0b admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:55.242242 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-8bbfe62d-aa88-4d69-b135-767f369e9261 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79c722880ce5445db0de2861c532cbdd', 'request_id': 'req-8bbfe62d-aa88-4d69-b135-767f369e9261'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:55.257375 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-8bbfe62d-aa88-4d69-b135-767f369e9261 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79c722880ce5445db0de2861c532cbdd', 'request_id': 'req-8bbfe62d-aa88-4d69-b135-767f369e9261'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:55.262722 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 956/1887] 10.222.0.79 () {60 vars in 1144 bytes} [Tue Aug 30 01:13:54 2022] POST /identity/v3/users => generated 289 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:13:55.269215 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fc4b83-2566-45ef-9728-15d7daaf0f0b admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:55.276281 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-8bbfe62d-aa88-4d69-b135-767f369e9261 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79c722880ce5445db0de2861c532cbdd', 'request_id': 'req-8bbfe62d-aa88-4d69-b135-767f369e9261'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:55.289279 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fc4b83-2566-45ef-9728-15d7daaf0f0b admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:55.298729 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-8bbfe62d-aa88-4d69-b135-767f369e9261 admin admin] The token cache is being invalidate because project 79c722880ce5445db0de2861c532cbdd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81998) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:13:55.299253 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-8bbfe62d-aa88-4d69-b135-767f369e9261 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:55.300030 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-8bbfe62d-aa88-4d69-b135-767f369e9261 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:55.304841 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 932/1888] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 30 01:13:54 2022] DELETE /identity/v3/projects/79c722880ce5445db0de2861c532cbdd => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:13:55.309516 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbfe62d-aa88-4d69-b135-767f369e9261 admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:55.316970 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-8bbfe62d-aa88-4d69-b135-767f369e9261 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:55.383264 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7534dbb3-7b7a-4c2c-b1c8-563c461b13af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:55.383946 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7534dbb3-7b7a-4c2c-b1c8-563c461b13af admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:55.384099 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7534dbb3-7b7a-4c2c-b1c8-563c461b13af admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:55.384415 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7534dbb3-7b7a-4c2c-b1c8-563c461b13af admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:55.385071 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7534dbb3-7b7a-4c2c-b1c8-563c461b13af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:55.387108 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7534dbb3-7b7a-4c2c-b1c8-563c461b13af admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:55.422507 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 957/1889] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:13:55 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 01:13:55.426860 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7534dbb3-7b7a-4c2c-b1c8-563c461b13af admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:55.430719 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-7534dbb3-7b7a-4c2c-b1c8-563c461b13af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:55.461081 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:13:55.476264 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7534dbb3-7b7a-4c2c-b1c8-563c461b13af admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:55.488872 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5167097-09be-48ce-8cb3-797dbb1b9e4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:55.490960 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5167097-09be-48ce-8cb3-797dbb1b9e4b admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:55.491424 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5167097-09be-48ce-8cb3-797dbb1b9e4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:55.492633 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5167097-09be-48ce-8cb3-797dbb1b9e4b admin admin] PATH_INFO: `/v3/projects/8dbc5ddce7994fc5a4413e89e43b9138/users/70df62d5ebdf4d0a951a0fcda52f5ee8/roles/d14c3070c9184d76a7b23df69bd3db07` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:55.492964 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbfe62d-aa88-4d69-b135-767f369e9261 admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:55.506057 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5060fa6-105b-40b8-9863-36c80c6abf27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:55.508311 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5060fa6-105b-40b8-9863-36c80c6abf27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:55.508758 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5060fa6-105b-40b8-9863-36c80c6abf27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:55.509510 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5060fa6-105b-40b8-9863-36c80c6abf27 admin admin] PATH_INFO: `/v3/users/d322d14cb4bf447c82ee8ee743ff53ed` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:55.527787 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5167097-09be-48ce-8cb3-797dbb1b9e4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8dbc5ddce7994fc5a4413e89e43b9138, user_id=70df62d5ebdf4d0a951a0fcda52f5ee8, role_id=d14c3070c9184d76a7b23df69bd3db07)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:55.528041 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5060fa6-105b-40b8-9863-36c80c6abf27 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d322d14cb4bf447c82ee8ee743ff53ed)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:55.530851 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5060fa6-105b-40b8-9863-36c80c6abf27 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:55.531218 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5167097-09be-48ce-8cb3-797dbb1b9e4b admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:55.556916 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 958/1890] 10.222.0.79 () {60 vars in 1483 bytes} [Tue Aug 30 01:13:55 2022] PUT /identity/v3/projects/8dbc5ddce7994fc5a4413e89e43b9138/users/70df62d5ebdf4d0a951a0fcda52f5ee8/roles/d14c3070c9184d76a7b23df69bd3db07 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:13:55.561644 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5167097-09be-48ce-8cb3-797dbb1b9e4b admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:55.604576 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:13:55.625112 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-b5060fa6-105b-40b8-9863-36c80c6abf27 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd322d14cb4bf447c82ee8ee743ff53ed'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:55.641056 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-b5060fa6-105b-40b8-9863-36c80c6abf27 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd322d14cb4bf447c82ee8ee743ff53ed'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:55.661220 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-b5060fa6-105b-40b8-9863-36c80c6abf27 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd322d14cb4bf447c82ee8ee743ff53ed'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:55.662359 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-b5060fa6-105b-40b8-9863-36c80c6abf27 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd322d14cb4bf447c82ee8ee743ff53ed'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:55.672195 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5167097-09be-48ce-8cb3-797dbb1b9e4b admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:55.673262 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-b5060fa6-105b-40b8-9863-36c80c6abf27 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd322d14cb4bf447c82ee8ee743ff53ed'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:55.678901 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc2b044-4b90-408a-b841-afec0b71975c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:55.679645 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc2b044-4b90-408a-b841-afec0b71975c admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:55.679980 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc2b044-4b90-408a-b841-afec0b71975c admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:55.681514 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc2b044-4b90-408a-b841-afec0b71975c admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:55.682646 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc2b044-4b90-408a-b841-afec0b71975c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:55.684363 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 933/1891] 10.222.0.79 () {58 vars in 1224 bytes} [Tue Aug 30 01:13:55 2022] DELETE /identity/v3/users/d322d14cb4bf447c82ee8ee743ff53ed => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:13:55.684904 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc2b044-4b90-408a-b841-afec0b71975c admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:55.700233 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 959/1892] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:13:55 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:13:55.704370 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5060fa6-105b-40b8-9863-36c80c6abf27 admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:55.706230 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-b5060fa6-105b-40b8-9863-36c80c6abf27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:55.823438 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5060fa6-105b-40b8-9863-36c80c6abf27 admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:55.842068 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff16e26-8439-4222-afd3-a96e6d05aee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:55.842068 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff16e26-8439-4222-afd3-a96e6d05aee4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:55.842068 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff16e26-8439-4222-afd3-a96e6d05aee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:55.842068 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff16e26-8439-4222-afd3-a96e6d05aee4 admin admin] PATH_INFO: `/v3/projects/8dbc5ddce7994fc5a4413e89e43b9138/users/70df62d5ebdf4d0a951a0fcda52f5ee8/roles/d14c3070c9184d76a7b23df69bd3db07` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:55.842591 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff16e26-8439-4222-afd3-a96e6d05aee4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8dbc5ddce7994fc5a4413e89e43b9138, user_id=70df62d5ebdf4d0a951a0fcda52f5ee8, role_id=d14c3070c9184d76a7b23df69bd3db07)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:55.845710 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff16e26-8439-4222-afd3-a96e6d05aee4 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:55.865112 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc2b044-4b90-408a-b841-afec0b71975c admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:55.875291 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 934/1893] 10.222.0.79 () {60 vars in 1483 bytes} [Tue Aug 30 01:13:55 2022] PUT /identity/v3/projects/8dbc5ddce7994fc5a4413e89e43b9138/users/70df62d5ebdf4d0a951a0fcda52f5ee8/roles/d14c3070c9184d76a7b23df69bd3db07 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:13:55.875817 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-8fc2b044-4b90-408a-b841-afec0b71975c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:55.878777 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ded4ab4-c05a-4cb3-b1ee-124e124fb859 None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:55.879916 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ded4ab4-c05a-4cb3-b1ee-124e124fb859 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:55.880651 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ded4ab4-c05a-4cb3-b1ee-124e124fb859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:55.888806 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc2b044-4b90-408a-b841-afec0b71975c admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:55.920946 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-3ded4ab4-c05a-4cb3-b1ee-124e124fb859 None None] MFA Rules not processed for user `70df62d5ebdf4d0a951a0fcda52f5ee8`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:13:55.922197 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-3ded4ab4-c05a-4cb3-b1ee-124e124fb859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:55.976781 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fd4e4e-77cf-4262-8989-349501a69473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:55.977704 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fd4e4e-77cf-4262-8989-349501a69473 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:55.977983 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fd4e4e-77cf-4262-8989-349501a69473 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:55.979240 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fd4e4e-77cf-4262-8989-349501a69473 admin admin] PATH_INFO: `/v3/projects/0cc4e29b7b43438f819352c1cb28347e` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:55.980695 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fd4e4e-77cf-4262-8989-349501a69473 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0cc4e29b7b43438f819352c1cb28347e)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:55.982718 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fd4e4e-77cf-4262-8989-349501a69473 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:56.013969 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 935/1894] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:13:55 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:13:56.028949 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ded4ab4-c05a-4cb3-b1ee-124e124fb859 None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:56.030635 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-3ded4ab4-c05a-4cb3-b1ee-124e124fb859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:56.050830 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-66fd4e4e-77cf-4262-8989-349501a69473 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0cc4e29b7b43438f819352c1cb28347e', 'request_id': 'req-66fd4e4e-77cf-4262-8989-349501a69473'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:56.061439 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-66fd4e4e-77cf-4262-8989-349501a69473 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0cc4e29b7b43438f819352c1cb28347e', 'request_id': 'req-66fd4e4e-77cf-4262-8989-349501a69473'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:56.069155 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:13:56.070095 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-66fd4e4e-77cf-4262-8989-349501a69473 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0cc4e29b7b43438f819352c1cb28347e', 'request_id': 'req-66fd4e4e-77cf-4262-8989-349501a69473'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:56.084745 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-66fd4e4e-77cf-4262-8989-349501a69473 admin admin] The token cache is being invalidate because project 0cc4e29b7b43438f819352c1cb28347e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:13:56.085149 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-66fd4e4e-77cf-4262-8989-349501a69473 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:56.086057 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-66fd4e4e-77cf-4262-8989-349501a69473 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:56.088512 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 960/1895] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 30 01:13:55 2022] DELETE /identity/v3/projects/0cc4e29b7b43438f819352c1cb28347e => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:13:56.093273 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fd4e4e-77cf-4262-8989-349501a69473 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:56.095946 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ded4ab4-c05a-4cb3-b1ee-124e124fb859 None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:56.096072 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-66fd4e4e-77cf-4262-8989-349501a69473 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:56.104938 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:13:56.155067 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88743c0a-f023-4c03-af52-011f65bdbea5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f827c7670b74d938ffe066ced88d1c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:56.156181 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88743c0a-f023-4c03-af52-011f65bdbea5 service cinder] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:56.156606 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88743c0a-f023-4c03-af52-011f65bdbea5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:56.157139 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88743c0a-f023-4c03-af52-011f65bdbea5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:56.158962 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-88743c0a-f023-4c03-af52-011f65bdbea5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:56.174242 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fd4e4e-77cf-4262-8989-349501a69473 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:56.179592 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4114630-ded7-49f1-87cc-80773c361c66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:56.180467 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4114630-ded7-49f1-87cc-80773c361c66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:56.180747 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4114630-ded7-49f1-87cc-80773c361c66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:56.181019 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4114630-ded7-49f1-87cc-80773c361c66 admin admin] PATH_INFO: `/v3/users/7ceb88e30d6542f9b99bdd069ee5490c` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:56.182175 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4114630-ded7-49f1-87cc-80773c361c66 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ceb88e30d6542f9b99bdd069ee5490c)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:56.184825 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4114630-ded7-49f1-87cc-80773c361c66 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:56.272688 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88743c0a-f023-4c03-af52-011f65bdbea5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:56.273758 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b4114630-ded7-49f1-87cc-80773c361c66 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ceb88e30d6542f9b99bdd069ee5490c'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:56.274438 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88743c0a-f023-4c03-af52-011f65bdbea5 service cinder] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:56.286501 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b4114630-ded7-49f1-87cc-80773c361c66 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ceb88e30d6542f9b99bdd069ee5490c'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:56.288451 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 936/1896] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:13:56 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:13:56.302665 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b4114630-ded7-49f1-87cc-80773c361c66 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ceb88e30d6542f9b99bdd069ee5490c'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:56.303934 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b4114630-ded7-49f1-87cc-80773c361c66 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ceb88e30d6542f9b99bdd069ee5490c'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:56.320752 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b4114630-ded7-49f1-87cc-80773c361c66 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ceb88e30d6542f9b99bdd069ee5490c'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:56.333652 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 961/1897] 10.222.0.79 () {58 vars in 1224 bytes} [Tue Aug 30 01:13:56 2022] DELETE /identity/v3/users/7ceb88e30d6542f9b99bdd069ee5490c => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:13:56.464297 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88743c0a-f023-4c03-af52-011f65bdbea5 service cinder] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:56.466013 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-88743c0a-f023-4c03-af52-011f65bdbea5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:56.480053 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88743c0a-f023-4c03-af52-011f65bdbea5 service cinder] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:56.524955 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4114630-ded7-49f1-87cc-80773c361c66 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:56.529417 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-b4114630-ded7-49f1-87cc-80773c361c66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:56.566666 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b2b362-2cd0-4de6-bb89-c22359b65c85 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f827c7670b74d938ffe066ced88d1c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:56.567259 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b2b362-2cd0-4de6-bb89-c22359b65c85 service cinder] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:56.568062 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b2b362-2cd0-4de6-bb89-c22359b65c85 service cinder] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:56.568591 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b2b362-2cd0-4de6-bb89-c22359b65c85 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:56.571401 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-05b2b362-2cd0-4de6-bb89-c22359b65c85 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:56.668011 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:13:56.686317 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4114630-ded7-49f1-87cc-80773c361c66 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:56.694039 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b2b362-2cd0-4de6-bb89-c22359b65c85 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:56.695766 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b2b362-2cd0-4de6-bb89-c22359b65c85 service cinder] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:56.696056 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1438973-129a-4e69-9570-b4241757d6a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:56.696819 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1438973-129a-4e69-9570-b4241757d6a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:56.697189 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1438973-129a-4e69-9570-b4241757d6a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:56.697546 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1438973-129a-4e69-9570-b4241757d6a8 admin admin] PATH_INFO: `/v3/projects/e6bdf633a4bc4e499bdfccb3596cc4dc` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:56.699204 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1438973-129a-4e69-9570-b4241757d6a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6bdf633a4bc4e499bdfccb3596cc4dc)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:56.701509 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1438973-129a-4e69-9570-b4241757d6a8 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:56.733528 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 937/1898] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:13:56 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:13:56.779522 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:13:56.820596 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-c1438973-129a-4e69-9570-b4241757d6a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6bdf633a4bc4e499bdfccb3596cc4dc', 'request_id': 'req-c1438973-129a-4e69-9570-b4241757d6a8'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:56.839978 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-c1438973-129a-4e69-9570-b4241757d6a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6bdf633a4bc4e499bdfccb3596cc4dc', 'request_id': 'req-c1438973-129a-4e69-9570-b4241757d6a8'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:56.862341 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-c1438973-129a-4e69-9570-b4241757d6a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6bdf633a4bc4e499bdfccb3596cc4dc', 'request_id': 'req-c1438973-129a-4e69-9570-b4241757d6a8'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:56.897343 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-c1438973-129a-4e69-9570-b4241757d6a8 admin admin] The token cache is being invalidate because project e6bdf633a4bc4e499bdfccb3596cc4dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:13:56.897638 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-c1438973-129a-4e69-9570-b4241757d6a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:56.901226 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-c1438973-129a-4e69-9570-b4241757d6a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:56.906767 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 962/1899] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 30 01:13:56 2022] DELETE /identity/v3/projects/e6bdf633a4bc4e499bdfccb3596cc4dc => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:13:56.910658 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b2b362-2cd0-4de6-bb89-c22359b65c85 service cinder] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:56.910658 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-05b2b362-2cd0-4de6-bb89-c22359b65c85 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:56.913915 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cc792c-feb3-44e7-a0b7-cd22e152e156 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:56.914874 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cc792c-feb3-44e7-a0b7-cd22e152e156 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:56.915190 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cc792c-feb3-44e7-a0b7-cd22e152e156 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:56.936527 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b2b362-2cd0-4de6-bb89-c22359b65c85 service cinder] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:56.991165 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-93cc792c-feb3-44e7-a0b7-cd22e152e156 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:13:56.992496 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-93cc792c-feb3-44e7-a0b7-cd22e152e156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:57.063413 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6f8c9d-107a-4d5f-9e7e-53d33e7d651f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:57.065572 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6f8c9d-107a-4d5f-9e7e-53d33e7d651f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:57.066946 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6f8c9d-107a-4d5f-9e7e-53d33e7d651f admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:57.067154 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6f8c9d-107a-4d5f-9e7e-53d33e7d651f admin admin] PATH_INFO: `/v3/projects/87126804ec6d4516be245397e204ac32` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:57.070024 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6f8c9d-107a-4d5f-9e7e-53d33e7d651f admin admin] RBAC: Authorizing `identity:delete_project(project_id=87126804ec6d4516be245397e204ac32)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:57.076037 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6f8c9d-107a-4d5f-9e7e-53d33e7d651f admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:57.142746 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 963/1900] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:13:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:13:57.152056 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cc792c-feb3-44e7-a0b7-cd22e152e156 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:57.154273 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-93cc792c-feb3-44e7-a0b7-cd22e152e156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:57.188000 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cc792c-feb3-44e7-a0b7-cd22e152e156 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:57.194704 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-6e6f8c9d-107a-4d5f-9e7e-53d33e7d651f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87126804ec6d4516be245397e204ac32', 'request_id': 'req-6e6f8c9d-107a-4d5f-9e7e-53d33e7d651f'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:57.206713 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-6e6f8c9d-107a-4d5f-9e7e-53d33e7d651f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87126804ec6d4516be245397e204ac32', 'request_id': 'req-6e6f8c9d-107a-4d5f-9e7e-53d33e7d651f'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:57.223484 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-6e6f8c9d-107a-4d5f-9e7e-53d33e7d651f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87126804ec6d4516be245397e204ac32', 'request_id': 'req-6e6f8c9d-107a-4d5f-9e7e-53d33e7d651f'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:57.253340 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-6e6f8c9d-107a-4d5f-9e7e-53d33e7d651f admin admin] The token cache is being invalidate because project 87126804ec6d4516be245397e204ac32 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81998) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:13:57.253684 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-6e6f8c9d-107a-4d5f-9e7e-53d33e7d651f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:57.254486 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-6e6f8c9d-107a-4d5f-9e7e-53d33e7d651f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:57.256131 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 938/1901] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 30 01:13:56 2022] DELETE /identity/v3/projects/87126804ec6d4516be245397e204ac32 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:13:57.259354 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b87d8c-bcfe-4949-931d-f3523cef016e None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:57.259354 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b87d8c-bcfe-4949-931d-f3523cef016e None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:57.259354 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b87d8c-bcfe-4949-931d-f3523cef016e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:57.290516 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-a7b87d8c-bcfe-4949-931d-f3523cef016e None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:13:57.291827 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-a7b87d8c-bcfe-4949-931d-f3523cef016e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:57.309379 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c5f5ad-e39f-498f-abc4-0c55f9ad85f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:57.310133 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c5f5ad-e39f-498f-abc4-0c55f9ad85f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:57.310529 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c5f5ad-e39f-498f-abc4-0c55f9ad85f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:57.310972 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c5f5ad-e39f-498f-abc4-0c55f9ad85f6 admin admin] PATH_INFO: `/v3/users/0588a3a3400049fd96b9fda3502aacb8` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:57.312321 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c5f5ad-e39f-498f-abc4-0c55f9ad85f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0588a3a3400049fd96b9fda3502aacb8)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:57.314568 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c5f5ad-e39f-498f-abc4-0c55f9ad85f6 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:57.416094 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-70c5f5ad-e39f-498f-abc4-0c55f9ad85f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0588a3a3400049fd96b9fda3502aacb8'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:57.432953 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-70c5f5ad-e39f-498f-abc4-0c55f9ad85f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0588a3a3400049fd96b9fda3502aacb8'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:57.437593 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 939/1902] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:13:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:13:57.437593 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431e2152-d434-409d-8297-355ddd95e487 None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:57.437593 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431e2152-d434-409d-8297-355ddd95e487 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:57.437593 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431e2152-d434-409d-8297-355ddd95e487 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:57.438700 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:13:57.459607 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-70c5f5ad-e39f-498f-abc4-0c55f9ad85f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0588a3a3400049fd96b9fda3502aacb8'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:57.461038 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-70c5f5ad-e39f-498f-abc4-0c55f9ad85f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0588a3a3400049fd96b9fda3502aacb8'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:57.495585 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-70c5f5ad-e39f-498f-abc4-0c55f9ad85f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0588a3a3400049fd96b9fda3502aacb8'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:57.502853 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-431e2152-d434-409d-8297-355ddd95e487 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:13:57.503544 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-431e2152-d434-409d-8297-355ddd95e487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:57.509340 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 964/1903] 10.222.0.79 () {58 vars in 1224 bytes} [Tue Aug 30 01:13:57 2022] DELETE /identity/v3/users/0588a3a3400049fd96b9fda3502aacb8 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:13:57.510940 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c5f5ad-e39f-498f-abc4-0c55f9ad85f6 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:57.513341 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-70c5f5ad-e39f-498f-abc4-0c55f9ad85f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:57.532500 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:13:57.596302 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 940/1904] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:13:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:13:57.597946 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a6eb1b-fc4e-458c-ba66-75e421c3a071 None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:57.598314 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a6eb1b-fc4e-458c-ba66-75e421c3a071 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:57.598592 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a6eb1b-fc4e-458c-ba66-75e421c3a071 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:57.610599 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c5f5ad-e39f-498f-abc4-0c55f9ad85f6 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:57.616291 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfedc1d-95ea-40c0-8683-9c1447bd13a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:57.617034 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfedc1d-95ea-40c0-8683-9c1447bd13a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:57.617411 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfedc1d-95ea-40c0-8683-9c1447bd13a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:57.618110 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfedc1d-95ea-40c0-8683-9c1447bd13a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:57.618560 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfedc1d-95ea-40c0-8683-9c1447bd13a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:13:57.618948 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfedc1d-95ea-40c0-8683-9c1447bd13a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:57.620717 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfedc1d-95ea-40c0-8683-9c1447bd13a7 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:57.624626 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-79a6eb1b-fc4e-458c-ba66-75e421c3a071 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:13:57.625989 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-79a6eb1b-fc4e-458c-ba66-75e421c3a071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:57.635338 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 965/1905] 10.222.0.79 () {58 vars in 1153 bytes} [Tue Aug 30 01:13:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:13:57.637004 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc1659a-1a56-47fa-8134-ae9a31a102a8 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:57.637390 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc1659a-1a56-47fa-8134-ae9a31a102a8 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:57.637767 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc1659a-1a56-47fa-8134-ae9a31a102a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:57.640299 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 941/1906] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:13:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:13:57.640994 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a6eb1b-fc4e-458c-ba66-75e421c3a071 None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:57.660752 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a6eb1b-fc4e-458c-ba66-75e421c3a071 None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:57.662712 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-9dc1659a-1a56-47fa-8134-ae9a31a102a8 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:13:57.663971 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-9dc1659a-1a56-47fa-8134-ae9a31a102a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:57.668353 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb5b23a-4e5f-4ea9-ba22-f584ac6dbc9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:57.669162 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb5b23a-4e5f-4ea9-ba22-f584ac6dbc9a admin admin] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:57.669406 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb5b23a-4e5f-4ea9-ba22-f584ac6dbc9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:57.669696 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb5b23a-4e5f-4ea9-ba22-f584ac6dbc9a admin admin] PATH_INFO: `/v3/projects` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:57.670395 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb5b23a-4e5f-4ea9-ba22-f584ac6dbc9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:57.672607 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb5b23a-4e5f-4ea9-ba22-f584ac6dbc9a admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:57.674243 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 966/1907] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:13:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:13:57.676987 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc1659a-1a56-47fa-8134-ae9a31a102a8 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:57.678509 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-9dc1659a-1a56-47fa-8134-ae9a31a102a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:57.709687 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 942/1908] 10.222.0.79 () {60 vars in 1153 bytes} [Tue Aug 30 01:13:57 2022] POST /identity/v3/projects => generated 365 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:13:57.711261 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb5b23a-4e5f-4ea9-ba22-f584ac6dbc9a admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:57.782912 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc1659a-1a56-47fa-8134-ae9a31a102a8 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:57.808273 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb5b23a-4e5f-4ea9-ba22-f584ac6dbc9a admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:57.815213 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52668e5-5164-4c89-adcb-07a0e065364e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:57.816737 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52668e5-5164-4c89-adcb-07a0e065364e admin admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:57.817214 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52668e5-5164-4c89-adcb-07a0e065364e admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:57.817721 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52668e5-5164-4c89-adcb-07a0e065364e admin admin] PATH_INFO: `/v3/domains` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:57.818979 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52668e5-5164-4c89-adcb-07a0e065364e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:13:57.819627 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52668e5-5164-4c89-adcb-07a0e065364e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:57.822449 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52668e5-5164-4c89-adcb-07a0e065364e admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:57.840659 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 943/1909] 10.222.0.79 () {58 vars in 1153 bytes} [Tue Aug 30 01:13:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:13:57.843049 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52668e5-5164-4c89-adcb-07a0e065364e admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:57.847765 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e1b2a7-310c-408d-b0e7-7c06126437e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16e6a0ca26fc4ef892c188ad89a1e132', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:57.848479 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e1b2a7-310c-408d-b0e7-7c06126437e2 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:57.848761 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e1b2a7-310c-408d-b0e7-7c06126437e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:57.849183 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e1b2a7-310c-408d-b0e7-7c06126437e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:57.857785 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52668e5-5164-4c89-adcb-07a0e065364e admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:57.859636 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e1b2a7-310c-408d-b0e7-7c06126437e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:57.861194 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e1b2a7-310c-408d-b0e7-7c06126437e2 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:57.866523 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef67a03-72d2-4465-9af2-65237374bb5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:57.866679 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef67a03-72d2-4465-9af2-65237374bb5a admin admin] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:57.866839 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef67a03-72d2-4465-9af2-65237374bb5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:57.867112 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef67a03-72d2-4465-9af2-65237374bb5a admin admin] PATH_INFO: `/v3/users` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:57.867835 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef67a03-72d2-4465-9af2-65237374bb5a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:57.869756 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef67a03-72d2-4465-9af2-65237374bb5a admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:57.871863 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 967/1910] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:13:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:13:57.876053 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e1b2a7-310c-408d-b0e7-7c06126437e2 service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:57.894546 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e1b2a7-310c-408d-b0e7-7c06126437e2 service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:57.896914 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 944/1911] 10.222.0.79 () {60 vars in 1144 bytes} [Tue Aug 30 01:13:57 2022] POST /identity/v3/users => generated 283 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:13:57.900947 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef67a03-72d2-4465-9af2-65237374bb5a admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:57.904233 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733538f7-7f4a-4757-836f-98df0da52e44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:57.904556 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733538f7-7f4a-4757-836f-98df0da52e44 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:57.904824 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733538f7-7f4a-4757-836f-98df0da52e44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:57.905103 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733538f7-7f4a-4757-836f-98df0da52e44 admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:57.905750 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733538f7-7f4a-4757-836f-98df0da52e44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:57.908985 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733538f7-7f4a-4757-836f-98df0da52e44 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:57.918465 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef67a03-72d2-4465-9af2-65237374bb5a admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:57.926191 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb17b658-f5e9-4664-9561-133a4e1e6b27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:57.927277 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb17b658-f5e9-4664-9561-133a4e1e6b27 admin admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:57.927554 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb17b658-f5e9-4664-9561-133a4e1e6b27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:57.928298 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb17b658-f5e9-4664-9561-133a4e1e6b27 admin admin] PATH_INFO: `/v3/roles` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:57.928975 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb17b658-f5e9-4664-9561-133a4e1e6b27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:57.932364 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb17b658-f5e9-4664-9561-133a4e1e6b27 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:57.938872 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:INSERT=2,keystone:DELETE=3,keystone:SELECT=95 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:13:57.948585 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 945/1912] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:13:57 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 01:13:57.954635 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb17b658-f5e9-4664-9561-133a4e1e6b27 admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:57.959428 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 968/1913] 10.222.0.79 () {60 vars in 1153 bytes} [Tue Aug 30 01:13:57 2022] POST /identity/v3/projects => generated 373 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:13:57.960752 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733538f7-7f4a-4757-836f-98df0da52e44 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:57.971218 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb17b658-f5e9-4664-9561-133a4e1e6b27 admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:58.042487 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733538f7-7f4a-4757-836f-98df0da52e44 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:58.050203 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bc6bd3-67da-47cc-b401-57c4e1c2f07d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:58.050581 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bc6bd3-67da-47cc-b401-57c4e1c2f07d admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:58.050824 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bc6bd3-67da-47cc-b401-57c4e1c2f07d admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:58.051176 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bc6bd3-67da-47cc-b401-57c4e1c2f07d admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:58.051996 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bc6bd3-67da-47cc-b401-57c4e1c2f07d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:58.056047 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bc6bd3-67da-47cc-b401-57c4e1c2f07d admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:58.100396 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 969/1914] 10.222.0.79 () {60 vars in 1144 bytes} [Tue Aug 30 01:13:57 2022] POST /identity/v3/users => generated 287 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:13:58.106345 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bc6bd3-67da-47cc-b401-57c4e1c2f07d admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:58.126502 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e35fdd-e41c-49dd-b175-adca95dc2067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:58.127441 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e35fdd-e41c-49dd-b175-adca95dc2067 admin admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:58.127829 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e35fdd-e41c-49dd-b175-adca95dc2067 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:58.128248 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e35fdd-e41c-49dd-b175-adca95dc2067 admin admin] PATH_INFO: `/v3/roles` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:58.129147 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e35fdd-e41c-49dd-b175-adca95dc2067 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:58.131254 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e35fdd-e41c-49dd-b175-adca95dc2067 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:58.133052 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:13:58.134860 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bc6bd3-67da-47cc-b401-57c4e1c2f07d admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:58.148426 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a28619f-d048-4b51-a8c3-14acf1344282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:58.150061 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a28619f-d048-4b51-a8c3-14acf1344282 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:58.150356 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a28619f-d048-4b51-a8c3-14acf1344282 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:58.152256 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a28619f-d048-4b51-a8c3-14acf1344282 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:58.152838 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 946/1915] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:13:57 2022] GET /identity/v3/roles => generated 1420 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:13:58.152975 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a28619f-d048-4b51-a8c3-14acf1344282 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:58.157733 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e35fdd-e41c-49dd-b175-adca95dc2067 admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:58.162903 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a28619f-d048-4b51-a8c3-14acf1344282 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:58.178670 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 970/1916] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:13:58 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:13:58.183202 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a28619f-d048-4b51-a8c3-14acf1344282 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:58.196357 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e35fdd-e41c-49dd-b175-adca95dc2067 admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:58.197898 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a28619f-d048-4b51-a8c3-14acf1344282 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:58.208326 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ed28e4-4712-4e4e-a8a4-28aaf7fbbf67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:58.209168 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ed28e4-4712-4e4e-a8a4-28aaf7fbbf67 admin admin] REQUEST_METHOD: `PUT` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:58.209856 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ed28e4-4712-4e4e-a8a4-28aaf7fbbf67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:58.210915 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ed28e4-4712-4e4e-a8a4-28aaf7fbbf67 admin admin] PATH_INFO: `/v3/projects/7e6234c32e344e7c863124461c4e5d61/users/63f050b05b1941859926a160fb9f81be/roles/c37945a17623465f899d4f217e7af593` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:58.211805 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cec562b-ff44-410f-a695-786c3424f121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:58.212524 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cec562b-ff44-410f-a695-786c3424f121 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:58.213706 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cec562b-ff44-410f-a695-786c3424f121 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:58.214982 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cec562b-ff44-410f-a695-786c3424f121 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:58.216872 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cec562b-ff44-410f-a695-786c3424f121 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:58.219040 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cec562b-ff44-410f-a695-786c3424f121 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:58.244096 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 971/1917] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:13:58 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 01:13:58.248293 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cec562b-ff44-410f-a695-786c3424f121 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:58.254318 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ed28e4-4712-4e4e-a8a4-28aaf7fbbf67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e6234c32e344e7c863124461c4e5d61, user_id=63f050b05b1941859926a160fb9f81be, role_id=c37945a17623465f899d4f217e7af593)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:58.257536 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ed28e4-4712-4e4e-a8a4-28aaf7fbbf67 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:58.270664 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cec562b-ff44-410f-a695-786c3424f121 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:58.277483 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892507ab-e8eb-4043-9db3-d24ef053db53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:58.278174 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892507ab-e8eb-4043-9db3-d24ef053db53 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:58.278454 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892507ab-e8eb-4043-9db3-d24ef053db53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:58.278883 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892507ab-e8eb-4043-9db3-d24ef053db53 admin admin] PATH_INFO: `/v3/projects/d4824458069a48a5936444968f778e9d/users/354ddb910da24821ac47ee3b369f1ea5/roles/c37945a17623465f899d4f217e7af593` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:58.287255 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 947/1918] 10.222.0.79 () {60 vars in 1483 bytes} [Tue Aug 30 01:13:58 2022] PUT /identity/v3/projects/7e6234c32e344e7c863124461c4e5d61/users/63f050b05b1941859926a160fb9f81be/roles/c37945a17623465f899d4f217e7af593 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:13:58.298862 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892507ab-e8eb-4043-9db3-d24ef053db53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4824458069a48a5936444968f778e9d, user_id=354ddb910da24821ac47ee3b369f1ea5, role_id=c37945a17623465f899d4f217e7af593)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:58.299359 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92ce93d-2d07-4406-9fd9-93b038c7d6c3 None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:58.299788 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92ce93d-2d07-4406-9fd9-93b038c7d6c3 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:58.300343 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92ce93d-2d07-4406-9fd9-93b038c7d6c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:58.302892 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892507ab-e8eb-4043-9db3-d24ef053db53 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:58.341400 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 972/1919] 10.222.0.79 () {60 vars in 1483 bytes} [Tue Aug 30 01:13:58 2022] PUT /identity/v3/projects/d4824458069a48a5936444968f778e9d/users/354ddb910da24821ac47ee3b369f1ea5/roles/c37945a17623465f899d4f217e7af593 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:13:58.341604 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-d92ce93d-2d07-4406-9fd9-93b038c7d6c3 None None] MFA Rules not processed for user `63f050b05b1941859926a160fb9f81be`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:13:58.341604 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-d92ce93d-2d07-4406-9fd9-93b038c7d6c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:58.343422 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f99359c-e7b7-424f-a8f8-367bc0de3a3d None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:58.343746 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f99359c-e7b7-424f-a8f8-367bc0de3a3d None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:58.343982 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f99359c-e7b7-424f-a8f8-367bc0de3a3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:58.450520 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-9f99359c-e7b7-424f-a8f8-367bc0de3a3d None None] MFA Rules not processed for user `354ddb910da24821ac47ee3b369f1ea5`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:13:58.454894 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-9f99359c-e7b7-424f-a8f8-367bc0de3a3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:58.488982 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 948/1920] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:13:58 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:13:58.491197 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92ce93d-2d07-4406-9fd9-93b038c7d6c3 None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:58.492776 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-d92ce93d-2d07-4406-9fd9-93b038c7d6c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:58.605320 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92ce93d-2d07-4406-9fd9-93b038c7d6c3 None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:58.615584 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 973/1921] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:13:58 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:13:58.615584 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f99359c-e7b7-424f-a8f8-367bc0de3a3d None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:58.620194 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125111b7-571d-4a9e-96cb-48265f9f98fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:58.631169 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125111b7-571d-4a9e-96cb-48265f9f98fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:58.631169 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125111b7-571d-4a9e-96cb-48265f9f98fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:58.631169 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125111b7-571d-4a9e-96cb-48265f9f98fe admin admin] PATH_INFO: `/v3/projects/5755536af15b48e39ec9c64136eaa8d0` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:58.631169 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125111b7-571d-4a9e-96cb-48265f9f98fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=5755536af15b48e39ec9c64136eaa8d0)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:58.636590 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125111b7-571d-4a9e-96cb-48265f9f98fe admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:58.647062 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f99359c-e7b7-424f-a8f8-367bc0de3a3d None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:58.666291 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b82256-68bf-4671-b05b-78eb6e2fafee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:58.666942 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b82256-68bf-4671-b05b-78eb6e2fafee admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:58.667246 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b82256-68bf-4671-b05b-78eb6e2fafee admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:58.667524 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b82256-68bf-4671-b05b-78eb6e2fafee admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:58.668175 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b82256-68bf-4671-b05b-78eb6e2fafee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:58.670097 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b82256-68bf-4671-b05b-78eb6e2fafee admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:58.757636 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 974/1922] 10.222.0.79 () {60 vars in 1153 bytes} [Tue Aug 30 01:13:58 2022] POST /identity/v3/projects => generated 365 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:13:58.757636 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b82256-68bf-4671-b05b-78eb6e2fafee admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:58.764362 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-125111b7-571d-4a9e-96cb-48265f9f98fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5755536af15b48e39ec9c64136eaa8d0', 'request_id': 'req-125111b7-571d-4a9e-96cb-48265f9f98fe'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:58.765887 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-f2b82256-68bf-4671-b05b-78eb6e2fafee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:58.789913 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-125111b7-571d-4a9e-96cb-48265f9f98fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5755536af15b48e39ec9c64136eaa8d0', 'request_id': 'req-125111b7-571d-4a9e-96cb-48265f9f98fe'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:58.806832 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:13:58.817286 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-125111b7-571d-4a9e-96cb-48265f9f98fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5755536af15b48e39ec9c64136eaa8d0', 'request_id': 'req-125111b7-571d-4a9e-96cb-48265f9f98fe'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:58.834771 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:13:58.848386 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-125111b7-571d-4a9e-96cb-48265f9f98fe admin admin] The token cache is being invalidate because project 5755536af15b48e39ec9c64136eaa8d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81998) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:13:58.849215 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-125111b7-571d-4a9e-96cb-48265f9f98fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:58.851025 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-125111b7-571d-4a9e-96cb-48265f9f98fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:58.854831 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 949/1923] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 30 01:13:58 2022] DELETE /identity/v3/projects/5755536af15b48e39ec9c64136eaa8d0 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:13:58.858951 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125111b7-571d-4a9e-96cb-48265f9f98fe admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:58.860513 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-125111b7-571d-4a9e-96cb-48265f9f98fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:58.955743 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b82256-68bf-4671-b05b-78eb6e2fafee admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:58.963098 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7a515c-5dc3-4774-be04-ecbf29f816dc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f827c7670b74d938ffe066ced88d1c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:58.963978 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7a515c-5dc3-4774-be04-ecbf29f816dc service cinder] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:58.964339 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7a515c-5dc3-4774-be04-ecbf29f816dc service cinder] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:58.964681 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7a515c-5dc3-4774-be04-ecbf29f816dc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:58.966615 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-6c7a515c-5dc3-4774-be04-ecbf29f816dc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:59.014944 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125111b7-571d-4a9e-96cb-48265f9f98fe admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:59.107247 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7a515c-5dc3-4774-be04-ecbf29f816dc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:59.110824 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7a515c-5dc3-4774-be04-ecbf29f816dc service cinder] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:59.133430 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 975/1924] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:13:58 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:13:59.134071 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7a515c-5dc3-4774-be04-ecbf29f816dc service cinder] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:59.135869 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-6c7a515c-5dc3-4774-be04-ecbf29f816dc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:59.136508 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65cb7cf-e5d3-4723-9c84-7b5dbe7dc3bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:59.137170 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65cb7cf-e5d3-4723-9c84-7b5dbe7dc3bf admin admin] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:59.137729 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65cb7cf-e5d3-4723-9c84-7b5dbe7dc3bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:59.138141 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65cb7cf-e5d3-4723-9c84-7b5dbe7dc3bf admin admin] PATH_INFO: `/v3/users` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:59.139298 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65cb7cf-e5d3-4723-9c84-7b5dbe7dc3bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:59.144282 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65cb7cf-e5d3-4723-9c84-7b5dbe7dc3bf admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:59.159510 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7a515c-5dc3-4774-be04-ecbf29f816dc service cinder] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:59.163882 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b711e41e-bc66-4c1e-911d-184a31810c6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:59.165667 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b711e41e-bc66-4c1e-911d-184a31810c6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:59.166153 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b711e41e-bc66-4c1e-911d-184a31810c6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:59.167356 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b711e41e-bc66-4c1e-911d-184a31810c6b admin admin] PATH_INFO: `/v3/users/b192004bc52a4ae48a6ed4853fe69068` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:59.169824 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b711e41e-bc66-4c1e-911d-184a31810c6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=b192004bc52a4ae48a6ed4853fe69068)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:59.172773 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b711e41e-bc66-4c1e-911d-184a31810c6b admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:59.214868 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 950/1925] 10.222.0.79 () {60 vars in 1144 bytes} [Tue Aug 30 01:13:58 2022] POST /identity/v3/users => generated 289 bytes in 359 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:13:59.217506 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65cb7cf-e5d3-4723-9c84-7b5dbe7dc3bf admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:59.220985 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-e65cb7cf-e5d3-4723-9c84-7b5dbe7dc3bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:59.263876 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65cb7cf-e5d3-4723-9c84-7b5dbe7dc3bf admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:59.280918 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f30196-82d1-4534-bd00-7e5a180727b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:59.281718 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f30196-82d1-4534-bd00-7e5a180727b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:59.281995 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f30196-82d1-4534-bd00-7e5a180727b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:59.282263 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f30196-82d1-4534-bd00-7e5a180727b3 admin admin] PATH_INFO: `/v3/users/354ddb910da24821ac47ee3b369f1ea5` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:59.284216 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f30196-82d1-4534-bd00-7e5a180727b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=354ddb910da24821ac47ee3b369f1ea5)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:59.286377 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b711e41e-bc66-4c1e-911d-184a31810c6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b192004bc52a4ae48a6ed4853fe69068'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:59.288802 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f30196-82d1-4534-bd00-7e5a180727b3 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:59.305917 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b711e41e-bc66-4c1e-911d-184a31810c6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b192004bc52a4ae48a6ed4853fe69068'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:59.324903 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b711e41e-bc66-4c1e-911d-184a31810c6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b192004bc52a4ae48a6ed4853fe69068'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:59.325787 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b711e41e-bc66-4c1e-911d-184a31810c6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b192004bc52a4ae48a6ed4853fe69068'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:59.347858 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b711e41e-bc66-4c1e-911d-184a31810c6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b192004bc52a4ae48a6ed4853fe69068'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:59.364090 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 976/1926] 10.222.0.79 () {58 vars in 1224 bytes} [Tue Aug 30 01:13:59 2022] DELETE /identity/v3/users/b192004bc52a4ae48a6ed4853fe69068 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:13:59.368173 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b711e41e-bc66-4c1e-911d-184a31810c6b admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:59.370123 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-b711e41e-bc66-4c1e-911d-184a31810c6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:59.379893 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-21f30196-82d1-4534-bd00-7e5a180727b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '354ddb910da24821ac47ee3b369f1ea5'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:59.393686 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-21f30196-82d1-4534-bd00-7e5a180727b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '354ddb910da24821ac47ee3b369f1ea5'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:59.431912 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-21f30196-82d1-4534-bd00-7e5a180727b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '354ddb910da24821ac47ee3b369f1ea5'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:59.432988 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-21f30196-82d1-4534-bd00-7e5a180727b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '354ddb910da24821ac47ee3b369f1ea5'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:59.458744 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:13:59.460274 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-21f30196-82d1-4534-bd00-7e5a180727b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '354ddb910da24821ac47ee3b369f1ea5'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:59.471272 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:13:59.478111 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 951/1927] 10.222.0.79 () {58 vars in 1224 bytes} [Tue Aug 30 01:13:59 2022] DELETE /identity/v3/users/354ddb910da24821ac47ee3b369f1ea5 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:13:59.485114 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af1fe8a-02ee-4cb7-a50d-326bb3d68188 None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:59.485887 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af1fe8a-02ee-4cb7-a50d-326bb3d68188 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:59.486497 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af1fe8a-02ee-4cb7-a50d-326bb3d68188 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:59.499485 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b711e41e-bc66-4c1e-911d-184a31810c6b admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:59.528567 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-6af1fe8a-02ee-4cb7-a50d-326bb3d68188 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:13:59.533838 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-6af1fe8a-02ee-4cb7-a50d-326bb3d68188 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:59.618585 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7cb56e-644a-49f7-a8f3-cb79729f0e64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:59.620214 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7cb56e-644a-49f7-a8f3-cb79729f0e64 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:59.622533 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7cb56e-644a-49f7-a8f3-cb79729f0e64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:59.623030 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7cb56e-644a-49f7-a8f3-cb79729f0e64 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:59.626320 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7cb56e-644a-49f7-a8f3-cb79729f0e64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:59.631161 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7cb56e-644a-49f7-a8f3-cb79729f0e64 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:59.663362 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 977/1928] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:13:59 2022] GET /identity/v3/roles => generated 1420 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:13:59.668472 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7cb56e-644a-49f7-a8f3-cb79729f0e64 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:59.670936 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-3a7cb56e-644a-49f7-a8f3-cb79729f0e64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:59.688508 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 952/1929] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:13:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:13:59.695696 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7cb56e-644a-49f7-a8f3-cb79729f0e64 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:59.702400 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454e33c0-adf3-4d2b-8e7e-7aeb01bad5a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:59.703193 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454e33c0-adf3-4d2b-8e7e-7aeb01bad5a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:59.703597 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454e33c0-adf3-4d2b-8e7e-7aeb01bad5a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:59.703941 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454e33c0-adf3-4d2b-8e7e-7aeb01bad5a3 admin admin] PATH_INFO: `/v3/projects/d7461935c58b44daa48b5e169d96d6b1/users/7cd6139f677c4911a998be9ea16dca1a/roles/d14c3070c9184d76a7b23df69bd3db07` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:59.719723 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af1fe8a-02ee-4cb7-a50d-326bb3d68188 None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:59.721537 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-6af1fe8a-02ee-4cb7-a50d-326bb3d68188 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:59.725215 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454e33c0-adf3-4d2b-8e7e-7aeb01bad5a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7461935c58b44daa48b5e169d96d6b1, user_id=7cd6139f677c4911a998be9ea16dca1a, role_id=d14c3070c9184d76a7b23df69bd3db07)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:59.728540 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454e33c0-adf3-4d2b-8e7e-7aeb01bad5a3 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:59.758156 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 978/1930] 10.222.0.79 () {60 vars in 1483 bytes} [Tue Aug 30 01:13:59 2022] PUT /identity/v3/projects/d7461935c58b44daa48b5e169d96d6b1/users/7cd6139f677c4911a998be9ea16dca1a/roles/d14c3070c9184d76a7b23df69bd3db07 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:13:59.761673 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454e33c0-adf3-4d2b-8e7e-7aeb01bad5a3 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:59.874544 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af1fe8a-02ee-4cb7-a50d-326bb3d68188 None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:59.993191 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454e33c0-adf3-4d2b-8e7e-7aeb01bad5a3 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:00.016931 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9aa8be-2cbe-42a3-a8f8-6fd947560d71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:00.017553 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9aa8be-2cbe-42a3-a8f8-6fd947560d71 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:00.017843 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9aa8be-2cbe-42a3-a8f8-6fd947560d71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:00.018111 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9aa8be-2cbe-42a3-a8f8-6fd947560d71 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:00.018829 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9aa8be-2cbe-42a3-a8f8-6fd947560d71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:00.020755 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9aa8be-2cbe-42a3-a8f8-6fd947560d71 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:00.048071 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 979/1931] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:13:59 2022] GET /identity/v3/roles => generated 1420 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:14:00.056452 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9aa8be-2cbe-42a3-a8f8-6fd947560d71 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:00.057503 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76ed8b0-5c90-48e3-9798-8116efc923de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16e6a0ca26fc4ef892c188ad89a1e132', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:00.058131 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76ed8b0-5c90-48e3-9798-8116efc923de service neutron] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:00.058404 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76ed8b0-5c90-48e3-9798-8116efc923de service neutron] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:00.058670 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76ed8b0-5c90-48e3-9798-8116efc923de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:00.092463 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76ed8b0-5c90-48e3-9798-8116efc923de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:00.095979 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76ed8b0-5c90-48e3-9798-8116efc923de service neutron] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:00.098870 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9aa8be-2cbe-42a3-a8f8-6fd947560d71 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:00.113668 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8904a49-7633-42df-8cd6-2d6e4b7d5541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:00.114555 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8904a49-7633-42df-8cd6-2d6e4b7d5541 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:00.114928 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8904a49-7633-42df-8cd6-2d6e4b7d5541 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:00.115921 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8904a49-7633-42df-8cd6-2d6e4b7d5541 admin admin] PATH_INFO: `/v3/projects/d7461935c58b44daa48b5e169d96d6b1/users/7cd6139f677c4911a998be9ea16dca1a/roles/d14c3070c9184d76a7b23df69bd3db07` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:00.123598 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 953/1932] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:13:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 01:14:00.124863 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8904a49-7633-42df-8cd6-2d6e4b7d5541 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7461935c58b44daa48b5e169d96d6b1, user_id=7cd6139f677c4911a998be9ea16dca1a, role_id=d14c3070c9184d76a7b23df69bd3db07)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:00.130044 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8904a49-7633-42df-8cd6-2d6e4b7d5541 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:00.140107 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76ed8b0-5c90-48e3-9798-8116efc923de service neutron] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:00.142043 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-e76ed8b0-5c90-48e3-9798-8116efc923de service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:00.151434 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 980/1933] 10.222.0.79 () {60 vars in 1483 bytes} [Tue Aug 30 01:14:00 2022] PUT /identity/v3/projects/d7461935c58b44daa48b5e169d96d6b1/users/7cd6139f677c4911a998be9ea16dca1a/roles/d14c3070c9184d76a7b23df69bd3db07 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:14:00.161988 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e164b5e-17be-4330-a9d7-6750528917e2 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:00.162447 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e164b5e-17be-4330-a9d7-6750528917e2 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:00.162830 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e164b5e-17be-4330-a9d7-6750528917e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:00.165953 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76ed8b0-5c90-48e3-9798-8116efc923de service neutron] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:00.257360 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-0e164b5e-17be-4330-a9d7-6750528917e2 None None] MFA Rules not processed for user `7cd6139f677c4911a998be9ea16dca1a`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:14:00.257360 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-0e164b5e-17be-4330-a9d7-6750528917e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:00.363860 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a0b304-89aa-405e-a0ec-9dd4f54f9add admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:00.364457 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a0b304-89aa-405e-a0ec-9dd4f54f9add admin admin] REQUEST_METHOD: `DELETE` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:00.366461 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a0b304-89aa-405e-a0ec-9dd4f54f9add admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:00.368560 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a0b304-89aa-405e-a0ec-9dd4f54f9add admin admin] PATH_INFO: `/v3/projects/ea63814f6e9243a5b2d9ad3d72881a4d` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:00.373112 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a0b304-89aa-405e-a0ec-9dd4f54f9add admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea63814f6e9243a5b2d9ad3d72881a4d)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:00.381466 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a0b304-89aa-405e-a0ec-9dd4f54f9add admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:00.384955 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:14:00.387759 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:14:00.499539 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-41a0b304-89aa-405e-a0ec-9dd4f54f9add admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea63814f6e9243a5b2d9ad3d72881a4d', 'request_id': 'req-41a0b304-89aa-405e-a0ec-9dd4f54f9add'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:00.516853 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-41a0b304-89aa-405e-a0ec-9dd4f54f9add admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea63814f6e9243a5b2d9ad3d72881a4d', 'request_id': 'req-41a0b304-89aa-405e-a0ec-9dd4f54f9add'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:00.517994 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 981/1934] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:14:00 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 357 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:14:00.528294 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-41a0b304-89aa-405e-a0ec-9dd4f54f9add admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea63814f6e9243a5b2d9ad3d72881a4d', 'request_id': 'req-41a0b304-89aa-405e-a0ec-9dd4f54f9add'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:00.530638 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e164b5e-17be-4330-a9d7-6750528917e2 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:00.533017 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-0e164b5e-17be-4330-a9d7-6750528917e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:00.544964 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-41a0b304-89aa-405e-a0ec-9dd4f54f9add admin admin] The token cache is being invalidate because project ea63814f6e9243a5b2d9ad3d72881a4d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81998) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:14:00.544964 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-41a0b304-89aa-405e-a0ec-9dd4f54f9add admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:00.545252 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-41a0b304-89aa-405e-a0ec-9dd4f54f9add admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:00.546892 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 954/1935] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 30 01:14:00 2022] DELETE /identity/v3/projects/ea63814f6e9243a5b2d9ad3d72881a4d => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:14:00.558804 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdf0b0d-b06e-4984-a6fa-b138aef1e25f None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:00.561306 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdf0b0d-b06e-4984-a6fa-b138aef1e25f None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:00.562867 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdf0b0d-b06e-4984-a6fa-b138aef1e25f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:00.620545 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-fcdf0b0d-b06e-4984-a6fa-b138aef1e25f None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:14:00.621776 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-fcdf0b0d-b06e-4984-a6fa-b138aef1e25f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:00.688667 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e164b5e-17be-4330-a9d7-6750528917e2 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:00.703220 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 955/1936] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:14:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:14:00.711436 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65be230-6c2c-4f51-926f-254c4223cabc None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:00.711706 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65be230-6c2c-4f51-926f-254c4223cabc None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:00.712080 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65be230-6c2c-4f51-926f-254c4223cabc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:00.742107 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-e65be230-6c2c-4f51-926f-254c4223cabc None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:14:00.743589 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-e65be230-6c2c-4f51-926f-254c4223cabc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:00.757241 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 956/1937] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:14:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:14:00.760975 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65be230-6c2c-4f51-926f-254c4223cabc None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:00.772407 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65be230-6c2c-4f51-926f-254c4223cabc None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:00.785230 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdcee53-25fe-4145-bad9-c0485dfff2c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:00.786026 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdcee53-25fe-4145-bad9-c0485dfff2c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:00.786376 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdcee53-25fe-4145-bad9-c0485dfff2c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:00.786718 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdcee53-25fe-4145-bad9-c0485dfff2c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:00.787496 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdcee53-25fe-4145-bad9-c0485dfff2c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:14:00.787864 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdcee53-25fe-4145-bad9-c0485dfff2c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:00.789716 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdcee53-25fe-4145-bad9-c0485dfff2c7 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:00.806718 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 957/1938] 10.222.0.79 () {58 vars in 1153 bytes} [Tue Aug 30 01:14:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:14:00.813225 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd2afaa-0cef-4cd8-b054-ed3715aed656 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f827c7670b74d938ffe066ced88d1c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:00.814671 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd2afaa-0cef-4cd8-b054-ed3715aed656 service cinder] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:00.816567 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd2afaa-0cef-4cd8-b054-ed3715aed656 service cinder] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:00.817143 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd2afaa-0cef-4cd8-b054-ed3715aed656 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:00.822535 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-ebd2afaa-0cef-4cd8-b054-ed3715aed656 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:00.824400 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdcee53-25fe-4145-bad9-c0485dfff2c7 admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:00.840156 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdcee53-25fe-4145-bad9-c0485dfff2c7 admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:00.847818 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db981026-ef9f-4781-a228-a61406638085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:00.848894 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db981026-ef9f-4781-a228-a61406638085 admin admin] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:00.849237 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db981026-ef9f-4781-a228-a61406638085 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:00.849515 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db981026-ef9f-4781-a228-a61406638085 admin admin] PATH_INFO: `/v3/projects` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:00.850159 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db981026-ef9f-4781-a228-a61406638085 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:00.852585 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db981026-ef9f-4781-a228-a61406638085 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:00.919730 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 958/1939] 10.222.0.79 () {60 vars in 1153 bytes} [Tue Aug 30 01:14:00 2022] POST /identity/v3/projects => generated 377 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:14:00.926533 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db981026-ef9f-4781-a228-a61406638085 admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:00.965471 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd2afaa-0cef-4cd8-b054-ed3715aed656 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:00.968073 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd2afaa-0cef-4cd8-b054-ed3715aed656 service cinder] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:01.006307 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 982/1940] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:14:00 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 01:14:01.063949 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:14:01.099022 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db981026-ef9f-4781-a228-a61406638085 admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:01.112042 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9178871-5798-4c63-9562-895612824f8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:01.113326 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9178871-5798-4c63-9562-895612824f8c admin admin] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:01.113685 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9178871-5798-4c63-9562-895612824f8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:01.113959 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9178871-5798-4c63-9562-895612824f8c admin admin] PATH_INFO: `/v3/users` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:01.114614 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9178871-5798-4c63-9562-895612824f8c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:01.119302 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9178871-5798-4c63-9562-895612824f8c admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:01.131042 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd2afaa-0cef-4cd8-b054-ed3715aed656 service cinder] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:01.132721 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-ebd2afaa-0cef-4cd8-b054-ed3715aed656 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:01.158676 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd2afaa-0cef-4cd8-b054-ed3715aed656 service cinder] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:01.165539 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 959/1941] 10.222.0.79 () {60 vars in 1144 bytes} [Tue Aug 30 01:14:00 2022] POST /identity/v3/users => generated 289 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:14:01.166402 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9178871-5798-4c63-9562-895612824f8c admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:01.168025 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541d76bb-ec50-42a3-8149-51fce4de006d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:01.169120 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541d76bb-ec50-42a3-8149-51fce4de006d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:01.169409 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541d76bb-ec50-42a3-8149-51fce4de006d admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:01.169688 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541d76bb-ec50-42a3-8149-51fce4de006d admin admin] PATH_INFO: `/v3/projects/d4824458069a48a5936444968f778e9d` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:01.179555 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-d9178871-5798-4c63-9562-895612824f8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:01.182594 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541d76bb-ec50-42a3-8149-51fce4de006d admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4824458069a48a5936444968f778e9d)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:01.189354 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541d76bb-ec50-42a3-8149-51fce4de006d admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:01.306173 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:14:01.308695 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9178871-5798-4c63-9562-895612824f8c admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:01.323497 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e75bcb6-78bf-4eb1-8335-c2f5db37d895 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f827c7670b74d938ffe066ced88d1c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:01.324036 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e75bcb6-78bf-4eb1-8335-c2f5db37d895 service cinder] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:01.324691 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e75bcb6-78bf-4eb1-8335-c2f5db37d895 service cinder] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:01.325197 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e75bcb6-78bf-4eb1-8335-c2f5db37d895 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:01.341544 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-8e75bcb6-78bf-4eb1-8335-c2f5db37d895 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:01.365084 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-541d76bb-ec50-42a3-8149-51fce4de006d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4824458069a48a5936444968f778e9d', 'request_id': 'req-541d76bb-ec50-42a3-8149-51fce4de006d'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:01.381264 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-541d76bb-ec50-42a3-8149-51fce4de006d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4824458069a48a5936444968f778e9d', 'request_id': 'req-541d76bb-ec50-42a3-8149-51fce4de006d'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:01.392589 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-541d76bb-ec50-42a3-8149-51fce4de006d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4824458069a48a5936444968f778e9d', 'request_id': 'req-541d76bb-ec50-42a3-8149-51fce4de006d'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:01.437601 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-541d76bb-ec50-42a3-8149-51fce4de006d admin admin] The token cache is being invalidate because project d4824458069a48a5936444968f778e9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:14:01.437924 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-541d76bb-ec50-42a3-8149-51fce4de006d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:01.439660 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-541d76bb-ec50-42a3-8149-51fce4de006d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:01.441836 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 983/1942] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 30 01:14:01 2022] DELETE /identity/v3/projects/d4824458069a48a5936444968f778e9d => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:14:01.444224 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541d76bb-ec50-42a3-8149-51fce4de006d admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:01.452112 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-541d76bb-ec50-42a3-8149-51fce4de006d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:01.501448 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e75bcb6-78bf-4eb1-8335-c2f5db37d895 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:01.517552 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e75bcb6-78bf-4eb1-8335-c2f5db37d895 service cinder] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:01.560878 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 960/1943] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:14:01 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:14:01.564064 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e575e9-c97b-4a39-816e-2f267e7fd739 None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:01.567063 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e575e9-c97b-4a39-816e-2f267e7fd739 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:01.567691 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e575e9-c97b-4a39-816e-2f267e7fd739 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:01.638504 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-48e575e9-c97b-4a39-816e-2f267e7fd739 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:14:01.645063 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-48e575e9-c97b-4a39-816e-2f267e7fd739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:01.656483 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541d76bb-ec50-42a3-8149-51fce4de006d admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:01.665096 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182b3b1b-cc7b-4117-b5b8-230d9c0f6dd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:01.666007 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182b3b1b-cc7b-4117-b5b8-230d9c0f6dd6 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:01.666338 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182b3b1b-cc7b-4117-b5b8-230d9c0f6dd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:01.666696 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182b3b1b-cc7b-4117-b5b8-230d9c0f6dd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:01.667665 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182b3b1b-cc7b-4117-b5b8-230d9c0f6dd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:01.669758 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182b3b1b-cc7b-4117-b5b8-230d9c0f6dd6 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:01.672053 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 961/1944] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:14:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:14:01.681888 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421fb467-0161-432c-b871-e632996cb3fe None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:01.682172 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421fb467-0161-432c-b871-e632996cb3fe None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:01.682440 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421fb467-0161-432c-b871-e632996cb3fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:01.688238 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 984/1945] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:14:01 2022] GET /identity/v3/roles => generated 1420 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:14:01.702754 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182b3b1b-cc7b-4117-b5b8-230d9c0f6dd6 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:01.726216 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182b3b1b-cc7b-4117-b5b8-230d9c0f6dd6 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:01.734831 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-421fb467-0161-432c-b871-e632996cb3fe None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:14:01.736281 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-421fb467-0161-432c-b871-e632996cb3fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:01.745978 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f5c135-91fe-492f-b930-5b4ada9b308f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:01.746963 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f5c135-91fe-492f-b930-5b4ada9b308f admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:01.750015 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f5c135-91fe-492f-b930-5b4ada9b308f admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:01.750487 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f5c135-91fe-492f-b930-5b4ada9b308f admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:01.753822 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 962/1946] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:14:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:14:01.756272 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f5c135-91fe-492f-b930-5b4ada9b308f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:01.757520 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421fb467-0161-432c-b871-e632996cb3fe None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:01.763439 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f5c135-91fe-492f-b930-5b4ada9b308f admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:01.778518 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421fb467-0161-432c-b871-e632996cb3fe None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:01.790158 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 985/1947] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:14:01 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:14:01.793848 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2229cf5b-bc41-4c1e-b802-8121576a3e7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:01.794649 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2229cf5b-bc41-4c1e-b802-8121576a3e7d admin admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:01.794942 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2229cf5b-bc41-4c1e-b802-8121576a3e7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:01.795231 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2229cf5b-bc41-4c1e-b802-8121576a3e7d admin admin] PATH_INFO: `/v3/domains` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:01.795912 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2229cf5b-bc41-4c1e-b802-8121576a3e7d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:14:01.796208 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2229cf5b-bc41-4c1e-b802-8121576a3e7d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:01.800672 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2229cf5b-bc41-4c1e-b802-8121576a3e7d admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:01.802115 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f5c135-91fe-492f-b930-5b4ada9b308f admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:01.825090 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f5c135-91fe-492f-b930-5b4ada9b308f admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:01.831769 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 963/1948] 10.222.0.79 () {58 vars in 1153 bytes} [Tue Aug 30 01:14:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:14:01.836386 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2229cf5b-bc41-4c1e-b802-8121576a3e7d admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:01.844629 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ecd554-171d-43da-9f46-5a25c0e52c56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:01.845310 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ecd554-171d-43da-9f46-5a25c0e52c56 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:01.845592 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ecd554-171d-43da-9f46-5a25c0e52c56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:01.846155 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ecd554-171d-43da-9f46-5a25c0e52c56 admin admin] PATH_INFO: `/v3/projects/b9c96846e4374ac3910f5bcfdc518b70/users/a0df638c2e6e45e98089d30804782fc4/roles/c37945a17623465f899d4f217e7af593` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:01.883040 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2229cf5b-bc41-4c1e-b802-8121576a3e7d admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:01.886088 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ecd554-171d-43da-9f46-5a25c0e52c56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9c96846e4374ac3910f5bcfdc518b70, user_id=a0df638c2e6e45e98089d30804782fc4, role_id=c37945a17623465f899d4f217e7af593)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:01.891964 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ecd554-171d-43da-9f46-5a25c0e52c56 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:01.897534 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb91a5c-4284-4230-b990-81a7292fa9af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:01.898170 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb91a5c-4284-4230-b990-81a7292fa9af admin admin] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:01.898613 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb91a5c-4284-4230-b990-81a7292fa9af admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:01.898896 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb91a5c-4284-4230-b990-81a7292fa9af admin admin] PATH_INFO: `/v3/projects` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:01.899714 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb91a5c-4284-4230-b990-81a7292fa9af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:01.909379 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb91a5c-4284-4230-b990-81a7292fa9af admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:01.935785 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 986/1949] 10.222.0.79 () {60 vars in 1483 bytes} [Tue Aug 30 01:14:01 2022] PUT /identity/v3/projects/b9c96846e4374ac3910f5bcfdc518b70/users/a0df638c2e6e45e98089d30804782fc4/roles/c37945a17623465f899d4f217e7af593 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:14:01.938931 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f22f6e1-f769-4644-93af-c25ab965ab3f None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:01.940934 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f22f6e1-f769-4644-93af-c25ab965ab3f None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:01.941055 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f22f6e1-f769-4644-93af-c25ab965ab3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:01.991493 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 964/1950] 10.222.0.79 () {60 vars in 1153 bytes} [Tue Aug 30 01:14:01 2022] POST /identity/v3/projects => generated 373 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:14:01.998540 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb91a5c-4284-4230-b990-81a7292fa9af admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:02.033437 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-3f22f6e1-f769-4644-93af-c25ab965ab3f None None] MFA Rules not processed for user `a0df638c2e6e45e98089d30804782fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:14:02.035594 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-3f22f6e1-f769-4644-93af-c25ab965ab3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:02.085891 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:14:02.108001 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb91a5c-4284-4230-b990-81a7292fa9af admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:02.114156 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803cf9e6-9dab-470d-a864-6ad5501961df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:02.115253 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803cf9e6-9dab-470d-a864-6ad5501961df admin admin] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:02.115645 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803cf9e6-9dab-470d-a864-6ad5501961df admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:02.116038 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803cf9e6-9dab-470d-a864-6ad5501961df admin admin] PATH_INFO: `/v3/users` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:02.116965 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803cf9e6-9dab-470d-a864-6ad5501961df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:02.119410 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803cf9e6-9dab-470d-a864-6ad5501961df admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:02.149613 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 965/1951] 10.222.0.79 () {60 vars in 1144 bytes} [Tue Aug 30 01:14:01 2022] POST /identity/v3/users => generated 287 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:14:02.153600 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803cf9e6-9dab-470d-a864-6ad5501961df admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:02.167213 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803cf9e6-9dab-470d-a864-6ad5501961df admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:02.172403 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb749152-fd93-4c27-a3af-aa92f59c6093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:02.173288 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb749152-fd93-4c27-a3af-aa92f59c6093 admin admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:02.173709 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb749152-fd93-4c27-a3af-aa92f59c6093 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:02.173961 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb749152-fd93-4c27-a3af-aa92f59c6093 admin admin] PATH_INFO: `/v3/roles` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:02.174680 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb749152-fd93-4c27-a3af-aa92f59c6093 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:02.177194 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb749152-fd93-4c27-a3af-aa92f59c6093 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:02.179924 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 987/1952] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:14:01 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:14:02.184131 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f22f6e1-f769-4644-93af-c25ab965ab3f None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:02.192091 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 966/1953] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:14:02 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 01:14:02.192239 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=2 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:14:02.195524 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb749152-fd93-4c27-a3af-aa92f59c6093 admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:02.197857 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f22f6e1-f769-4644-93af-c25ab965ab3f None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:02.204098 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8827fddd-29f9-417a-b380-8da585188091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:02.205372 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8827fddd-29f9-417a-b380-8da585188091 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:02.205992 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8827fddd-29f9-417a-b380-8da585188091 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:02.206640 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8827fddd-29f9-417a-b380-8da585188091 admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:02.207458 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8827fddd-29f9-417a-b380-8da585188091 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:02.209574 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8827fddd-29f9-417a-b380-8da585188091 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:02.214620 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb749152-fd93-4c27-a3af-aa92f59c6093 admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:02.219798 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b144b7c-3152-41ac-89ae-fac3232cbf60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:02.220573 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b144b7c-3152-41ac-89ae-fac3232cbf60 admin admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:02.222789 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b144b7c-3152-41ac-89ae-fac3232cbf60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:02.222789 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b144b7c-3152-41ac-89ae-fac3232cbf60 admin admin] PATH_INFO: `/v3/roles` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:02.223290 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b144b7c-3152-41ac-89ae-fac3232cbf60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:02.225476 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b144b7c-3152-41ac-89ae-fac3232cbf60 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:02.249212 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 967/1954] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:14:02 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:14:02.250064 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b144b7c-3152-41ac-89ae-fac3232cbf60 admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:02.256970 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 988/1955] 10.222.0.79 () {60 vars in 1153 bytes} [Tue Aug 30 01:14:02 2022] POST /identity/v3/projects => generated 373 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:14:02.260883 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8827fddd-29f9-417a-b380-8da585188091 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:02.263818 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b144b7c-3152-41ac-89ae-fac3232cbf60 admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:02.341778 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9168258-f82c-4db6-9b2e-41639f349fee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:02.342788 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9168258-f82c-4db6-9b2e-41639f349fee admin admin] REQUEST_METHOD: `PUT` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:02.342941 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9168258-f82c-4db6-9b2e-41639f349fee admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:02.343249 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9168258-f82c-4db6-9b2e-41639f349fee admin admin] PATH_INFO: `/v3/projects/c0e3e0996ff14f648a7673675a9d1bb7/users/8ff088f6dbf04e37b1ef72e4b3835fe0/roles/c37945a17623465f899d4f217e7af593` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:02.346548 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8827fddd-29f9-417a-b380-8da585188091 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:02.353357 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0843b911-15ff-4831-9e92-eaac16da4294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:02.353983 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0843b911-15ff-4831-9e92-eaac16da4294 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:02.354644 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0843b911-15ff-4831-9e92-eaac16da4294 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:02.354644 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0843b911-15ff-4831-9e92-eaac16da4294 admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:02.355181 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0843b911-15ff-4831-9e92-eaac16da4294 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:02.357211 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0843b911-15ff-4831-9e92-eaac16da4294 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:02.362098 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9168258-f82c-4db6-9b2e-41639f349fee admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0e3e0996ff14f648a7673675a9d1bb7, user_id=8ff088f6dbf04e37b1ef72e4b3835fe0, role_id=c37945a17623465f899d4f217e7af593)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:02.365666 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9168258-f82c-4db6-9b2e-41639f349fee admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:02.381413 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 968/1956] 10.222.0.79 () {60 vars in 1483 bytes} [Tue Aug 30 01:14:02 2022] PUT /identity/v3/projects/c0e3e0996ff14f648a7673675a9d1bb7/users/8ff088f6dbf04e37b1ef72e4b3835fe0/roles/c37945a17623465f899d4f217e7af593 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:14:02.383177 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 989/1957] 10.222.0.79 () {60 vars in 1144 bytes} [Tue Aug 30 01:14:02 2022] POST /identity/v3/users => generated 293 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:14:02.385986 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9168258-f82c-4db6-9b2e-41639f349fee admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:02.393035 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbc774c-d79e-46f9-85cd-67027044fbda None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:02.394378 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbc774c-d79e-46f9-85cd-67027044fbda None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:02.394857 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbc774c-d79e-46f9-85cd-67027044fbda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:02.434915 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-ccbc774c-d79e-46f9-85cd-67027044fbda None None] MFA Rules not processed for user `8ff088f6dbf04e37b1ef72e4b3835fe0`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:14:02.436330 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-ccbc774c-d79e-46f9-85cd-67027044fbda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:02.464147 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9168258-f82c-4db6-9b2e-41639f349fee admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:02.468963 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093684e2-0884-47a2-b9d0-ceabe9ab85a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:02.469578 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093684e2-0884-47a2-b9d0-ceabe9ab85a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:02.469856 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093684e2-0884-47a2-b9d0-ceabe9ab85a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:02.470127 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093684e2-0884-47a2-b9d0-ceabe9ab85a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:02.470773 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093684e2-0884-47a2-b9d0-ceabe9ab85a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:02.474157 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093684e2-0884-47a2-b9d0-ceabe9ab85a5 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:02.490331 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 969/1958] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:14:02 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:14:02.492474 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093684e2-0884-47a2-b9d0-ceabe9ab85a5 admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:02.505309 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093684e2-0884-47a2-b9d0-ceabe9ab85a5 admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:02.511604 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8253d398-1dd7-44e7-8fad-ed8f4a8a6d09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:02.513100 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8253d398-1dd7-44e7-8fad-ed8f4a8a6d09 admin admin] REQUEST_METHOD: `PUT` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:02.513187 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8253d398-1dd7-44e7-8fad-ed8f4a8a6d09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:02.513468 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8253d398-1dd7-44e7-8fad-ed8f4a8a6d09 admin admin] PATH_INFO: `/v3/projects/c1d25c38c8554661ab91b8e3399c21bf/users/25e0208c2a0b4a1c93486717ab00b651/roles/d14c3070c9184d76a7b23df69bd3db07` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:02.537643 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 990/1959] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:14:02 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:14:02.541990 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbc774c-d79e-46f9-85cd-67027044fbda None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:02.559404 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8253d398-1dd7-44e7-8fad-ed8f4a8a6d09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1d25c38c8554661ab91b8e3399c21bf, user_id=25e0208c2a0b4a1c93486717ab00b651, role_id=d14c3070c9184d76a7b23df69bd3db07)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:02.561587 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbc774c-d79e-46f9-85cd-67027044fbda None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:02.562039 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8253d398-1dd7-44e7-8fad-ed8f4a8a6d09 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:02.569400 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8c0a66-f17b-49d7-aa2f-753b1c128fdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:02.570354 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8c0a66-f17b-49d7-aa2f-753b1c128fdf admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:02.570709 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8c0a66-f17b-49d7-aa2f-753b1c128fdf admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:02.571053 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8c0a66-f17b-49d7-aa2f-753b1c128fdf admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:02.571909 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8c0a66-f17b-49d7-aa2f-753b1c128fdf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:02.574142 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8c0a66-f17b-49d7-aa2f-753b1c128fdf admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:02.598365 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 970/1960] 10.222.0.79 () {60 vars in 1483 bytes} [Tue Aug 30 01:14:02 2022] PUT /identity/v3/projects/c1d25c38c8554661ab91b8e3399c21bf/users/25e0208c2a0b4a1c93486717ab00b651/roles/d14c3070c9184d76a7b23df69bd3db07 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:14:02.600051 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8253d398-1dd7-44e7-8fad-ed8f4a8a6d09 admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:02.619389 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:14:02.642540 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 991/1961] 10.222.0.79 () {60 vars in 1153 bytes} [Tue Aug 30 01:14:02 2022] POST /identity/v3/projects => generated 373 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:14:02.647157 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8c0a66-f17b-49d7-aa2f-753b1c128fdf admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:02.649023 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-fb8c0a66-f17b-49d7-aa2f-753b1c128fdf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:02.698760 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8253d398-1dd7-44e7-8fad-ed8f4a8a6d09 admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:02.702337 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:14:02.742765 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8c0a66-f17b-49d7-aa2f-753b1c128fdf admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:02.752146 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e806cf8-ea99-4d94-b676-329c09e108d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:02.753099 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e806cf8-ea99-4d94-b676-329c09e108d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:02.753555 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e806cf8-ea99-4d94-b676-329c09e108d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:02.753983 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e806cf8-ea99-4d94-b676-329c09e108d3 admin admin] PATH_INFO: `/v3/users/ee003da4d9aa4918ba44fa04baf7e8b5` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:02.755903 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e806cf8-ea99-4d94-b676-329c09e108d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee003da4d9aa4918ba44fa04baf7e8b5)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:02.758008 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e806cf8-ea99-4d94-b676-329c09e108d3 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:02.770324 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe91bb3-7b2f-4575-90cc-dbdbc6dc250a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:02.771446 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe91bb3-7b2f-4575-90cc-dbdbc6dc250a admin admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:02.771913 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe91bb3-7b2f-4575-90cc-dbdbc6dc250a admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:02.772363 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe91bb3-7b2f-4575-90cc-dbdbc6dc250a admin admin] PATH_INFO: `/v3/roles` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:02.773221 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe91bb3-7b2f-4575-90cc-dbdbc6dc250a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:02.775004 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe91bb3-7b2f-4575-90cc-dbdbc6dc250a admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:02.788621 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 971/1962] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:14:02 2022] GET /identity/v3/roles => generated 1420 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 01:14:02.789733 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe91bb3-7b2f-4575-90cc-dbdbc6dc250a admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:02.801314 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe91bb3-7b2f-4575-90cc-dbdbc6dc250a admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:02.806673 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23eef6d-2e54-4750-b759-a3f21b518ad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:02.807657 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23eef6d-2e54-4750-b759-a3f21b518ad8 admin admin] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:02.808116 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23eef6d-2e54-4750-b759-a3f21b518ad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:02.808689 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23eef6d-2e54-4750-b759-a3f21b518ad8 admin admin] PATH_INFO: `/v3/users` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:02.809212 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23eef6d-2e54-4750-b759-a3f21b518ad8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:02.811610 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23eef6d-2e54-4750-b759-a3f21b518ad8 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:02.814970 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-5e806cf8-ea99-4d94-b676-329c09e108d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee003da4d9aa4918ba44fa04baf7e8b5'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:02.824250 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-5e806cf8-ea99-4d94-b676-329c09e108d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee003da4d9aa4918ba44fa04baf7e8b5'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:02.835221 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-5e806cf8-ea99-4d94-b676-329c09e108d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee003da4d9aa4918ba44fa04baf7e8b5'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:02.835967 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-5e806cf8-ea99-4d94-b676-329c09e108d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee003da4d9aa4918ba44fa04baf7e8b5'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:02.837313 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 972/1963] 10.222.0.79 () {60 vars in 1144 bytes} [Tue Aug 30 01:14:02 2022] POST /identity/v3/users => generated 293 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:14:02.838204 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23eef6d-2e54-4750-b759-a3f21b518ad8 admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:02.840220 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-b23eef6d-2e54-4750-b759-a3f21b518ad8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:02.852841 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23eef6d-2e54-4750-b759-a3f21b518ad8 admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:02.854605 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-5e806cf8-ea99-4d94-b676-329c09e108d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee003da4d9aa4918ba44fa04baf7e8b5'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:02.858602 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa41bb1-e1b8-4db6-b812-db7af999a8f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:02.859290 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa41bb1-e1b8-4db6-b812-db7af999a8f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:02.859770 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa41bb1-e1b8-4db6-b812-db7af999a8f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:02.859874 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa41bb1-e1b8-4db6-b812-db7af999a8f6 admin admin] PATH_INFO: `/v3/projects/c1d25c38c8554661ab91b8e3399c21bf/users/25e0208c2a0b4a1c93486717ab00b651/roles/d14c3070c9184d76a7b23df69bd3db07` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:02.861216 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 992/1964] 10.222.0.79 () {58 vars in 1224 bytes} [Tue Aug 30 01:14:02 2022] DELETE /identity/v3/users/ee003da4d9aa4918ba44fa04baf7e8b5 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:14:02.861911 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e806cf8-ea99-4d94-b676-329c09e108d3 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:02.862184 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa41bb1-e1b8-4db6-b812-db7af999a8f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1d25c38c8554661ab91b8e3399c21bf, user_id=25e0208c2a0b4a1c93486717ab00b651, role_id=d14c3070c9184d76a7b23df69bd3db07)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:02.865611 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa41bb1-e1b8-4db6-b812-db7af999a8f6 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:02.866147 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-5e806cf8-ea99-4d94-b676-329c09e108d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:02.879844 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 973/1965] 10.222.0.79 () {60 vars in 1483 bytes} [Tue Aug 30 01:14:02 2022] PUT /identity/v3/projects/c1d25c38c8554661ab91b8e3399c21bf/users/25e0208c2a0b4a1c93486717ab00b651/roles/d14c3070c9184d76a7b23df69bd3db07 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:14:02.881167 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f30b5b0-fdd3-4783-9cf9-3e1bb6230c51 None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:02.881458 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f30b5b0-fdd3-4783-9cf9-3e1bb6230c51 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:02.881737 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f30b5b0-fdd3-4783-9cf9-3e1bb6230c51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:02.912367 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-2f30b5b0-fdd3-4783-9cf9-3e1bb6230c51 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:14:02.913782 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-2f30b5b0-fdd3-4783-9cf9-3e1bb6230c51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:02.967340 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e806cf8-ea99-4d94-b676-329c09e108d3 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:03.037304 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 974/1966] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:14:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:14:03.039144 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423e76fe-223c-4d5a-8ff4-aea79d86acb0 None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:03.039666 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423e76fe-223c-4d5a-8ff4-aea79d86acb0 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:03.040744 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423e76fe-223c-4d5a-8ff4-aea79d86acb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:03.071040 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1320d426-ea17-45d1-8294-c3a2e8be6819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:03.071694 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1320d426-ea17-45d1-8294-c3a2e8be6819 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:03.071970 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1320d426-ea17-45d1-8294-c3a2e8be6819 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:03.072239 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1320d426-ea17-45d1-8294-c3a2e8be6819 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:03.072908 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1320d426-ea17-45d1-8294-c3a2e8be6819 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:03.075160 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1320d426-ea17-45d1-8294-c3a2e8be6819 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:03.078356 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-423e76fe-223c-4d5a-8ff4-aea79d86acb0 None None] MFA Rules not processed for user `25e0208c2a0b4a1c93486717ab00b651`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:14:03.079791 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-423e76fe-223c-4d5a-8ff4-aea79d86acb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:03.080773 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:14:03.088224 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 993/1967] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:14:02 2022] GET /identity/v3/roles => generated 1420 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:14:03.089286 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1320d426-ea17-45d1-8294-c3a2e8be6819 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:03.092397 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-1320d426-ea17-45d1-8294-c3a2e8be6819 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:03.095312 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:14:03.179535 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1320d426-ea17-45d1-8294-c3a2e8be6819 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:03.183464 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 975/1968] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:14:03 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:14:03.184986 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423e76fe-223c-4d5a-8ff4-aea79d86acb0 None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:03.196136 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73b9fb4-9e13-470a-82b0-66ad84c41743 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16e6a0ca26fc4ef892c188ad89a1e132', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:03.196853 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73b9fb4-9e13-470a-82b0-66ad84c41743 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:03.196961 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423e76fe-223c-4d5a-8ff4-aea79d86acb0 None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:03.197258 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73b9fb4-9e13-470a-82b0-66ad84c41743 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:03.197717 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73b9fb4-9e13-470a-82b0-66ad84c41743 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:03.202010 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f536ddbe-1118-43a1-badf-f41f1c05a1d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:03.202659 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f536ddbe-1118-43a1-badf-f41f1c05a1d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:03.202938 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f536ddbe-1118-43a1-badf-f41f1c05a1d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:03.203248 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f536ddbe-1118-43a1-badf-f41f1c05a1d5 admin admin] PATH_INFO: `/v3/projects/91e43f3558a44170b24d6b25fee79494/users/abf553b2dfff464fb78f984fb63a2082/roles/d14c3070c9184d76a7b23df69bd3db07` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:03.212686 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73b9fb4-9e13-470a-82b0-66ad84c41743 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:03.214153 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73b9fb4-9e13-470a-82b0-66ad84c41743 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:03.228529 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 994/1969] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:14:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:14:03.238875 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f536ddbe-1118-43a1-badf-f41f1c05a1d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91e43f3558a44170b24d6b25fee79494, user_id=abf553b2dfff464fb78f984fb63a2082, role_id=d14c3070c9184d76a7b23df69bd3db07)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:03.243041 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f536ddbe-1118-43a1-badf-f41f1c05a1d5 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:03.245906 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73b9fb4-9e13-470a-82b0-66ad84c41743 service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:03.249340 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-a73b9fb4-9e13-470a-82b0-66ad84c41743 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:03.270512 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 976/1970] 10.222.0.79 () {60 vars in 1483 bytes} [Tue Aug 30 01:14:03 2022] PUT /identity/v3/projects/91e43f3558a44170b24d6b25fee79494/users/abf553b2dfff464fb78f984fb63a2082/roles/d14c3070c9184d76a7b23df69bd3db07 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:14:03.273950 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f536ddbe-1118-43a1-badf-f41f1c05a1d5 admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:03.367624 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f536ddbe-1118-43a1-badf-f41f1c05a1d5 admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:03.374784 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5338e1e-e545-4d45-886b-2f30323355a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:03.375565 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5338e1e-e545-4d45-886b-2f30323355a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:03.375853 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5338e1e-e545-4d45-886b-2f30323355a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:03.376127 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5338e1e-e545-4d45-886b-2f30323355a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:03.376971 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5338e1e-e545-4d45-886b-2f30323355a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:03.380498 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5338e1e-e545-4d45-886b-2f30323355a1 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:03.392664 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 977/1971] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:14:03 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 01:14:03.397139 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5338e1e-e545-4d45-886b-2f30323355a1 admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:03.403325 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73b9fb4-9e13-470a-82b0-66ad84c41743 service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:03.419012 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5338e1e-e545-4d45-886b-2f30323355a1 admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:03.426310 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89adeb99-0eba-4768-96f8-649896087b93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:03.427105 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89adeb99-0eba-4768-96f8-649896087b93 admin admin] REQUEST_METHOD: `PUT` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:03.427485 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89adeb99-0eba-4768-96f8-649896087b93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:03.428028 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89adeb99-0eba-4768-96f8-649896087b93 admin admin] PATH_INFO: `/v3/projects/91e43f3558a44170b24d6b25fee79494/users/abf553b2dfff464fb78f984fb63a2082/roles/d14c3070c9184d76a7b23df69bd3db07` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:03.430449 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89adeb99-0eba-4768-96f8-649896087b93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91e43f3558a44170b24d6b25fee79494, user_id=abf553b2dfff464fb78f984fb63a2082, role_id=d14c3070c9184d76a7b23df69bd3db07)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:03.433476 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89adeb99-0eba-4768-96f8-649896087b93 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:03.453878 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 978/1972] 10.222.0.79 () {60 vars in 1483 bytes} [Tue Aug 30 01:14:03 2022] PUT /identity/v3/projects/91e43f3558a44170b24d6b25fee79494/users/abf553b2dfff464fb78f984fb63a2082/roles/d14c3070c9184d76a7b23df69bd3db07 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:14:03.465179 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42add3d5-719e-453d-b482-09ad350f8d21 None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:03.465575 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42add3d5-719e-453d-b482-09ad350f8d21 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:03.465955 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42add3d5-719e-453d-b482-09ad350f8d21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:03.494938 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c3373e-70fd-41cc-8fdc-48365508d5fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f827c7670b74d938ffe066ced88d1c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:03.495760 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c3373e-70fd-41cc-8fdc-48365508d5fe service cinder] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:03.496246 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c3373e-70fd-41cc-8fdc-48365508d5fe service cinder] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:03.496466 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c3373e-70fd-41cc-8fdc-48365508d5fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:03.499937 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-42add3d5-719e-453d-b482-09ad350f8d21 None None] MFA Rules not processed for user `abf553b2dfff464fb78f984fb63a2082`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:14:03.500169 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-81c3373e-70fd-41cc-8fdc-48365508d5fe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:03.502709 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-42add3d5-719e-453d-b482-09ad350f8d21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:03.617643 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:14:03.664670 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 979/1973] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:14:03 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:14:03.676924 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c3373e-70fd-41cc-8fdc-48365508d5fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:03.678604 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c3373e-70fd-41cc-8fdc-48365508d5fe service cinder] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:03.716087 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 995/1974] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:14:03 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:14:03.720363 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42add3d5-719e-453d-b482-09ad350f8d21 None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:03.722167 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-42add3d5-719e-453d-b482-09ad350f8d21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:03.860878 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42add3d5-719e-453d-b482-09ad350f8d21 None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:03.885861 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e861e1-e640-43b8-8690-fc1c6734227d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f827c7670b74d938ffe066ced88d1c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:03.886517 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e861e1-e640-43b8-8690-fc1c6734227d service cinder] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:03.886795 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e861e1-e640-43b8-8690-fc1c6734227d service cinder] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:03.889470 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e861e1-e640-43b8-8690-fc1c6734227d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:03.892828 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-a5e861e1-e640-43b8-8690-fc1c6734227d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:04.072993 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e861e1-e640-43b8-8690-fc1c6734227d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:04.076684 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e861e1-e640-43b8-8690-fc1c6734227d service cinder] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:04.110107 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 980/1975] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:14:03 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:14:04.423744 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c3373e-70fd-41cc-8fdc-48365508d5fe service cinder] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:04.427265 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-81c3373e-70fd-41cc-8fdc-48365508d5fe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:04.447780 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c3373e-70fd-41cc-8fdc-48365508d5fe service cinder] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:04.461971 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:14:04.540559 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ca8488-1425-4f0b-94d6-2ccf640002dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:04.541494 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ca8488-1425-4f0b-94d6-2ccf640002dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:04.541894 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ca8488-1425-4f0b-94d6-2ccf640002dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:04.542822 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ca8488-1425-4f0b-94d6-2ccf640002dc admin admin] PATH_INFO: `/v3/users/63f050b05b1941859926a160fb9f81be` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:04.545217 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ca8488-1425-4f0b-94d6-2ccf640002dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=63f050b05b1941859926a160fb9f81be)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:04.548109 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ca8488-1425-4f0b-94d6-2ccf640002dc admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:04.632765 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-59ca8488-1425-4f0b-94d6-2ccf640002dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63f050b05b1941859926a160fb9f81be'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:04.645860 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-59ca8488-1425-4f0b-94d6-2ccf640002dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63f050b05b1941859926a160fb9f81be'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:04.657121 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-59ca8488-1425-4f0b-94d6-2ccf640002dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63f050b05b1941859926a160fb9f81be'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:04.659642 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-59ca8488-1425-4f0b-94d6-2ccf640002dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63f050b05b1941859926a160fb9f81be'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:04.678535 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-59ca8488-1425-4f0b-94d6-2ccf640002dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63f050b05b1941859926a160fb9f81be'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:04.690561 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 996/1976] 10.222.0.79 () {58 vars in 1224 bytes} [Tue Aug 30 01:14:04 2022] DELETE /identity/v3/users/63f050b05b1941859926a160fb9f81be => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:14:04.695860 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a612b895-2c2c-4e4a-822f-5c868729cd18 None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:04.696332 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a612b895-2c2c-4e4a-822f-5c868729cd18 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:04.696425 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a612b895-2c2c-4e4a-822f-5c868729cd18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:04.717167 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-a612b895-2c2c-4e4a-822f-5c868729cd18 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:14:04.718520 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-a612b895-2c2c-4e4a-822f-5c868729cd18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:04.730071 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ca8488-1425-4f0b-94d6-2ccf640002dc admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:04.731658 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-59ca8488-1425-4f0b-94d6-2ccf640002dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:04.798676 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 981/1977] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:14:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:14:04.809487 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a612b895-2c2c-4e4a-822f-5c868729cd18 None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:04.812803 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-a612b895-2c2c-4e4a-822f-5c868729cd18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:04.817607 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ca8488-1425-4f0b-94d6-2ccf640002dc admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:04.825061 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0076e44e-4f47-4e79-ad56-a39bf65e967c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:04.826200 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0076e44e-4f47-4e79-ad56-a39bf65e967c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:04.826676 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0076e44e-4f47-4e79-ad56-a39bf65e967c admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:04.827389 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0076e44e-4f47-4e79-ad56-a39bf65e967c admin admin] PATH_INFO: `/v3/projects/795e8c8207d54e278b0b7f0bbd2a4cce` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:04.829162 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0076e44e-4f47-4e79-ad56-a39bf65e967c admin admin] RBAC: Authorizing `identity:delete_project(project_id=795e8c8207d54e278b0b7f0bbd2a4cce)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:04.831449 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0076e44e-4f47-4e79-ad56-a39bf65e967c admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:04.869016 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:14:04.883840 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a612b895-2c2c-4e4a-822f-5c868729cd18 None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:04.888810 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:14:04.901220 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-0076e44e-4f47-4e79-ad56-a39bf65e967c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '795e8c8207d54e278b0b7f0bbd2a4cce', 'request_id': 'req-0076e44e-4f47-4e79-ad56-a39bf65e967c'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:04.909864 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-0076e44e-4f47-4e79-ad56-a39bf65e967c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '795e8c8207d54e278b0b7f0bbd2a4cce', 'request_id': 'req-0076e44e-4f47-4e79-ad56-a39bf65e967c'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:04.919605 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-0076e44e-4f47-4e79-ad56-a39bf65e967c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '795e8c8207d54e278b0b7f0bbd2a4cce', 'request_id': 'req-0076e44e-4f47-4e79-ad56-a39bf65e967c'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:04.948868 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-0076e44e-4f47-4e79-ad56-a39bf65e967c admin admin] The token cache is being invalidate because project 795e8c8207d54e278b0b7f0bbd2a4cce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:14:04.949171 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-0076e44e-4f47-4e79-ad56-a39bf65e967c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:04.950419 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-0076e44e-4f47-4e79-ad56-a39bf65e967c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:04.952046 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 997/1978] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 30 01:14:04 2022] DELETE /identity/v3/projects/795e8c8207d54e278b0b7f0bbd2a4cce => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:14:04.955784 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0076e44e-4f47-4e79-ad56-a39bf65e967c admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:04.958133 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-0076e44e-4f47-4e79-ad56-a39bf65e967c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:04.973853 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b088c731-721f-4d71-93c3-10f2991df9f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16e6a0ca26fc4ef892c188ad89a1e132', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:04.976389 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b088c731-721f-4d71-93c3-10f2991df9f8 service neutron] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:04.976680 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b088c731-721f-4d71-93c3-10f2991df9f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:04.978356 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b088c731-721f-4d71-93c3-10f2991df9f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:04.984605 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-b088c731-721f-4d71-93c3-10f2991df9f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:05.061386 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0076e44e-4f47-4e79-ad56-a39bf65e967c admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:05.067664 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a259c596-bbf4-4ade-81ab-6d70b18b2444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:05.069058 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a259c596-bbf4-4ade-81ab-6d70b18b2444 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:05.069392 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a259c596-bbf4-4ade-81ab-6d70b18b2444 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:05.069668 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a259c596-bbf4-4ade-81ab-6d70b18b2444 admin admin] PATH_INFO: `/v3/users/70df62d5ebdf4d0a951a0fcda52f5ee8` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:05.071923 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a259c596-bbf4-4ade-81ab-6d70b18b2444 admin admin] RBAC: Authorizing `identity:delete_user(user_id=70df62d5ebdf4d0a951a0fcda52f5ee8)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:05.073560 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a259c596-bbf4-4ade-81ab-6d70b18b2444 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:05.104320 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b088c731-721f-4d71-93c3-10f2991df9f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:05.105971 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b088c731-721f-4d71-93c3-10f2991df9f8 service neutron] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:05.147348 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 982/1979] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:14:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 01:14:05.155863 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-a259c596-bbf4-4ade-81ab-6d70b18b2444 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70df62d5ebdf4d0a951a0fcda52f5ee8'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:05.166666 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-a259c596-bbf4-4ade-81ab-6d70b18b2444 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70df62d5ebdf4d0a951a0fcda52f5ee8'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:05.194482 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-a259c596-bbf4-4ade-81ab-6d70b18b2444 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70df62d5ebdf4d0a951a0fcda52f5ee8'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:05.195559 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-a259c596-bbf4-4ade-81ab-6d70b18b2444 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70df62d5ebdf4d0a951a0fcda52f5ee8'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:05.246472 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-a259c596-bbf4-4ade-81ab-6d70b18b2444 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70df62d5ebdf4d0a951a0fcda52f5ee8'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:05.278560 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 998/1980] 10.222.0.79 () {58 vars in 1224 bytes} [Tue Aug 30 01:14:04 2022] DELETE /identity/v3/users/70df62d5ebdf4d0a951a0fcda52f5ee8 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:14:05.616944 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b088c731-721f-4d71-93c3-10f2991df9f8 service neutron] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:05.618412 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-b088c731-721f-4d71-93c3-10f2991df9f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:05.643105 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b088c731-721f-4d71-93c3-10f2991df9f8 service neutron] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:05.762442 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f221403f-29fe-4544-ac77-755201aeba1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:05.763642 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f221403f-29fe-4544-ac77-755201aeba1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:05.764221 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f221403f-29fe-4544-ac77-755201aeba1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:05.764672 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f221403f-29fe-4544-ac77-755201aeba1e admin admin] PATH_INFO: `/v3/projects/7e6234c32e344e7c863124461c4e5d61` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:05.767050 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f221403f-29fe-4544-ac77-755201aeba1e admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e6234c32e344e7c863124461c4e5d61)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:05.769828 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f221403f-29fe-4544-ac77-755201aeba1e admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:05.829554 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a259c596-bbf4-4ade-81ab-6d70b18b2444 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:05.831872 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-a259c596-bbf4-4ade-81ab-6d70b18b2444 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:05.839104 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-f221403f-29fe-4544-ac77-755201aeba1e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e6234c32e344e7c863124461c4e5d61', 'request_id': 'req-f221403f-29fe-4544-ac77-755201aeba1e'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:05.842766 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:14:05.851601 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a259c596-bbf4-4ade-81ab-6d70b18b2444 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:05.851795 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-f221403f-29fe-4544-ac77-755201aeba1e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e6234c32e344e7c863124461c4e5d61', 'request_id': 'req-f221403f-29fe-4544-ac77-755201aeba1e'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:05.874809 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-f221403f-29fe-4544-ac77-755201aeba1e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e6234c32e344e7c863124461c4e5d61', 'request_id': 'req-f221403f-29fe-4544-ac77-755201aeba1e'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:05.898135 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-f221403f-29fe-4544-ac77-755201aeba1e admin admin] The token cache is being invalidate because project 7e6234c32e344e7c863124461c4e5d61 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81998) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:14:05.898759 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-f221403f-29fe-4544-ac77-755201aeba1e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:05.900674 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-f221403f-29fe-4544-ac77-755201aeba1e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:05.901594 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 983/1981] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 30 01:14:05 2022] DELETE /identity/v3/projects/7e6234c32e344e7c863124461c4e5d61 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:14:05.905135 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:14:05.907845 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f221403f-29fe-4544-ac77-755201aeba1e admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:05.910325 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-f221403f-29fe-4544-ac77-755201aeba1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:05.938630 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205af58a-bf68-4ed2-87a4-cad9e2b6c396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:05.939847 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205af58a-bf68-4ed2-87a4-cad9e2b6c396 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:05.940182 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205af58a-bf68-4ed2-87a4-cad9e2b6c396 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:05.950667 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205af58a-bf68-4ed2-87a4-cad9e2b6c396 admin admin] PATH_INFO: `/v3/projects/8dbc5ddce7994fc5a4413e89e43b9138` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:05.950667 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205af58a-bf68-4ed2-87a4-cad9e2b6c396 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8dbc5ddce7994fc5a4413e89e43b9138)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:05.954170 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205af58a-bf68-4ed2-87a4-cad9e2b6c396 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:05.997588 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f221403f-29fe-4544-ac77-755201aeba1e admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:06.013788 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-205af58a-bf68-4ed2-87a4-cad9e2b6c396 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8dbc5ddce7994fc5a4413e89e43b9138', 'request_id': 'req-205af58a-bf68-4ed2-87a4-cad9e2b6c396'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:06.025567 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-205af58a-bf68-4ed2-87a4-cad9e2b6c396 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8dbc5ddce7994fc5a4413e89e43b9138', 'request_id': 'req-205af58a-bf68-4ed2-87a4-cad9e2b6c396'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:06.033719 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-205af58a-bf68-4ed2-87a4-cad9e2b6c396 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8dbc5ddce7994fc5a4413e89e43b9138', 'request_id': 'req-205af58a-bf68-4ed2-87a4-cad9e2b6c396'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:06.047203 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-205af58a-bf68-4ed2-87a4-cad9e2b6c396 admin admin] The token cache is being invalidate because project 8dbc5ddce7994fc5a4413e89e43b9138 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:14:06.047552 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-205af58a-bf68-4ed2-87a4-cad9e2b6c396 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:06.048441 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-205af58a-bf68-4ed2-87a4-cad9e2b6c396 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:06.052374 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 999/1982] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 30 01:14:05 2022] DELETE /identity/v3/projects/8dbc5ddce7994fc5a4413e89e43b9138 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:14:06.057498 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dee607d-a762-4d97-a2b7-d7abbfc63f38 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:06.057782 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dee607d-a762-4d97-a2b7-d7abbfc63f38 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:06.058131 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dee607d-a762-4d97-a2b7-d7abbfc63f38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:06.069947 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060fc979-8880-47d6-8456-52c3301475cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:06.070837 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060fc979-8880-47d6-8456-52c3301475cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:06.071223 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060fc979-8880-47d6-8456-52c3301475cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:06.071502 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060fc979-8880-47d6-8456-52c3301475cc admin admin] PATH_INFO: `/v3/users/7cd6139f677c4911a998be9ea16dca1a` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:06.072682 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060fc979-8880-47d6-8456-52c3301475cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=7cd6139f677c4911a998be9ea16dca1a)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:06.076405 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060fc979-8880-47d6-8456-52c3301475cc admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:06.083901 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-9dee607d-a762-4d97-a2b7-d7abbfc63f38 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:14:06.085791 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-9dee607d-a762-4d97-a2b7-d7abbfc63f38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:06.095393 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1000/1983] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:14:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:14:06.103316 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffc9517-3d99-4b1b-bdb7-e54931cadbac None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:06.103726 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffc9517-3d99-4b1b-bdb7-e54931cadbac None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:06.104009 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffc9517-3d99-4b1b-bdb7-e54931cadbac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:06.124798 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-bffc9517-3d99-4b1b-bdb7-e54931cadbac None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:14:06.125781 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-bffc9517-3d99-4b1b-bdb7-e54931cadbac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:06.130131 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-060fc979-8880-47d6-8456-52c3301475cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7cd6139f677c4911a998be9ea16dca1a'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:06.134346 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1001/1984] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:14:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:14:06.138602 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffc9517-3d99-4b1b-bdb7-e54931cadbac None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:06.139656 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-060fc979-8880-47d6-8456-52c3301475cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7cd6139f677c4911a998be9ea16dca1a'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:06.148331 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffc9517-3d99-4b1b-bdb7-e54931cadbac None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:06.152982 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2468e55-3915-4e8d-bba8-d85488dfe609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:06.153567 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2468e55-3915-4e8d-bba8-d85488dfe609 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:06.153672 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-060fc979-8880-47d6-8456-52c3301475cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7cd6139f677c4911a998be9ea16dca1a'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:06.153848 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2468e55-3915-4e8d-bba8-d85488dfe609 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:06.154121 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2468e55-3915-4e8d-bba8-d85488dfe609 admin admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:06.154276 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-060fc979-8880-47d6-8456-52c3301475cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7cd6139f677c4911a998be9ea16dca1a'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:06.154762 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2468e55-3915-4e8d-bba8-d85488dfe609 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:14:06.155061 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2468e55-3915-4e8d-bba8-d85488dfe609 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:06.156671 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2468e55-3915-4e8d-bba8-d85488dfe609 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:06.162069 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-060fc979-8880-47d6-8456-52c3301475cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7cd6139f677c4911a998be9ea16dca1a'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:06.168781 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1002/1985] 10.222.0.79 () {58 vars in 1153 bytes} [Tue Aug 30 01:14:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:14:06.169000 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 984/1986] 10.222.0.79 () {58 vars in 1224 bytes} [Tue Aug 30 01:14:05 2022] DELETE /identity/v3/users/7cd6139f677c4911a998be9ea16dca1a => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:14:06.173289 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2468e55-3915-4e8d-bba8-d85488dfe609 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:06.175666 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-c2468e55-3915-4e8d-bba8-d85488dfe609 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:06.188476 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2468e55-3915-4e8d-bba8-d85488dfe609 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:06.264653 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b9b219-e429-41c6-8587-01892e064140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:06.265885 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b9b219-e429-41c6-8587-01892e064140 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:06.266285 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b9b219-e429-41c6-8587-01892e064140 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:06.266520 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b9b219-e429-41c6-8587-01892e064140 admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:06.267217 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b9b219-e429-41c6-8587-01892e064140 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:06.270041 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b9b219-e429-41c6-8587-01892e064140 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:06.301247 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1003/1987] 10.222.0.79 () {60 vars in 1153 bytes} [Tue Aug 30 01:14:06 2022] POST /identity/v3/projects => generated 379 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:14:06.305091 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060fc979-8880-47d6-8456-52c3301475cc admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:06.315200 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060fc979-8880-47d6-8456-52c3301475cc admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:06.319947 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:14:06.385198 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0c3945-03c4-40cc-9f0a-d4947b08df3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:06.385982 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0c3945-03c4-40cc-9f0a-d4947b08df3b admin admin] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:06.386217 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0c3945-03c4-40cc-9f0a-d4947b08df3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:06.386451 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0c3945-03c4-40cc-9f0a-d4947b08df3b admin admin] PATH_INFO: `/v3/users` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:06.387186 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0c3945-03c4-40cc-9f0a-d4947b08df3b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:06.389265 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0c3945-03c4-40cc-9f0a-d4947b08df3b admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:06.413678 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 985/1988] 10.222.0.79 () {60 vars in 1144 bytes} [Tue Aug 30 01:14:06 2022] POST /identity/v3/users => generated 290 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:14:06.418003 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b9b219-e429-41c6-8587-01892e064140 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:06.431389 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b9b219-e429-41c6-8587-01892e064140 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:06.436783 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d372c6b3-8e78-4844-9552-d0a7b58689d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:06.437648 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d372c6b3-8e78-4844-9552-d0a7b58689d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:06.437926 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d372c6b3-8e78-4844-9552-d0a7b58689d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:06.438196 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d372c6b3-8e78-4844-9552-d0a7b58689d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:06.438844 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d372c6b3-8e78-4844-9552-d0a7b58689d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:06.441049 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d372c6b3-8e78-4844-9552-d0a7b58689d5 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:06.453432 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1004/1989] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:14:06 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 01:14:06.457861 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0c3945-03c4-40cc-9f0a-d4947b08df3b admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:06.468733 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0c3945-03c4-40cc-9f0a-d4947b08df3b admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:06.473946 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6d51ec-4493-4851-a696-be4fac967c4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:06.474664 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6d51ec-4493-4851-a696-be4fac967c4d admin admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:06.475286 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6d51ec-4493-4851-a696-be4fac967c4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:06.475458 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6d51ec-4493-4851-a696-be4fac967c4d admin admin] PATH_INFO: `/v3/roles` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:06.476526 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6d51ec-4493-4851-a696-be4fac967c4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:06.478205 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6d51ec-4493-4851-a696-be4fac967c4d admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:06.494609 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 986/1990] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:14:06 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:14:06.496446 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d372c6b3-8e78-4844-9552-d0a7b58689d5 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:06.509842 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d372c6b3-8e78-4844-9552-d0a7b58689d5 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:06.515361 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a82f5aa-a7c2-4788-8b1c-18eb7eb30cea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:06.516317 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a82f5aa-a7c2-4788-8b1c-18eb7eb30cea admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:06.516663 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a82f5aa-a7c2-4788-8b1c-18eb7eb30cea admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:06.517042 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a82f5aa-a7c2-4788-8b1c-18eb7eb30cea admin admin] PATH_INFO: `/v3/projects/4c0719f1b6744ee2b67809038e59abbc/users/569e2600f5e7460a82d5030476609d5d/roles/c37945a17623465f899d4f217e7af593` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:06.532448 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6d51ec-4493-4851-a696-be4fac967c4d admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:06.534803 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-1e6d51ec-4493-4851-a696-be4fac967c4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:06.537907 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a82f5aa-a7c2-4788-8b1c-18eb7eb30cea admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c0719f1b6744ee2b67809038e59abbc, user_id=569e2600f5e7460a82d5030476609d5d, role_id=c37945a17623465f899d4f217e7af593)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:06.540629 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a82f5aa-a7c2-4788-8b1c-18eb7eb30cea admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:06.546681 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:14:06.551935 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6d51ec-4493-4851-a696-be4fac967c4d admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:06.557795 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f855ea-f618-4bea-bcda-cdc61ddccf91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:06.558337 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f855ea-f618-4bea-bcda-cdc61ddccf91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:06.558610 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f855ea-f618-4bea-bcda-cdc61ddccf91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:06.558888 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f855ea-f618-4bea-bcda-cdc61ddccf91 admin admin] PATH_INFO: `/v3/projects/d7461935c58b44daa48b5e169d96d6b1` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:06.560407 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f855ea-f618-4bea-bcda-cdc61ddccf91 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7461935c58b44daa48b5e169d96d6b1)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:06.562551 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f855ea-f618-4bea-bcda-cdc61ddccf91 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:06.567678 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1005/1991] 10.222.0.79 () {60 vars in 1483 bytes} [Tue Aug 30 01:14:06 2022] PUT /identity/v3/projects/4c0719f1b6744ee2b67809038e59abbc/users/569e2600f5e7460a82d5030476609d5d/roles/c37945a17623465f899d4f217e7af593 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:14:06.594288 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d2030b-515d-4305-b7a9-d2f907d58cc8 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:06.594580 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d2030b-515d-4305-b7a9-d2f907d58cc8 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:06.594853 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d2030b-515d-4305-b7a9-d2f907d58cc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:06.633573 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-10d2030b-515d-4305-b7a9-d2f907d58cc8 None None] MFA Rules not processed for user `569e2600f5e7460a82d5030476609d5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:14:06.634862 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-10d2030b-515d-4305-b7a9-d2f907d58cc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:06.647742 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-30f855ea-f618-4bea-bcda-cdc61ddccf91 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7461935c58b44daa48b5e169d96d6b1', 'request_id': 'req-30f855ea-f618-4bea-bcda-cdc61ddccf91'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:06.657136 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-30f855ea-f618-4bea-bcda-cdc61ddccf91 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7461935c58b44daa48b5e169d96d6b1', 'request_id': 'req-30f855ea-f618-4bea-bcda-cdc61ddccf91'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:06.665046 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-30f855ea-f618-4bea-bcda-cdc61ddccf91 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7461935c58b44daa48b5e169d96d6b1', 'request_id': 'req-30f855ea-f618-4bea-bcda-cdc61ddccf91'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:06.677787 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-30f855ea-f618-4bea-bcda-cdc61ddccf91 admin admin] The token cache is being invalidate because project d7461935c58b44daa48b5e169d96d6b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81998) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:14:06.678087 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-30f855ea-f618-4bea-bcda-cdc61ddccf91 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:06.678753 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-30f855ea-f618-4bea-bcda-cdc61ddccf91 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:06.685792 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 987/1992] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 30 01:14:06 2022] DELETE /identity/v3/projects/d7461935c58b44daa48b5e169d96d6b1 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:14:06.685792 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f855ea-f618-4bea-bcda-cdc61ddccf91 admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:06.685792 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-30f855ea-f618-4bea-bcda-cdc61ddccf91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:06.714392 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1006/1993] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:14:06 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:14:06.716182 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae80a55-6206-4ca9-b77e-62d7cb102ede None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:06.716653 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae80a55-6206-4ca9-b77e-62d7cb102ede None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:06.717120 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae80a55-6206-4ca9-b77e-62d7cb102ede None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:06.738996 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-4ae80a55-6206-4ca9-b77e-62d7cb102ede None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:14:06.740250 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-4ae80a55-6206-4ca9-b77e-62d7cb102ede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:06.751813 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f855ea-f618-4bea-bcda-cdc61ddccf91 admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:06.756745 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15830333-209b-49a5-bb7b-543d79b560c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f827c7670b74d938ffe066ced88d1c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:06.757369 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15830333-209b-49a5-bb7b-543d79b560c9 service cinder] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:06.757646 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15830333-209b-49a5-bb7b-543d79b560c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:06.757918 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15830333-209b-49a5-bb7b-543d79b560c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:06.760177 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-15830333-209b-49a5-bb7b-543d79b560c9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:06.788316 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:14:06.803205 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1007/1994] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:14:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:14:06.804360 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae80a55-6206-4ca9-b77e-62d7cb102ede None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:06.805692 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-4ae80a55-6206-4ca9-b77e-62d7cb102ede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:06.817863 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae80a55-6206-4ca9-b77e-62d7cb102ede None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:06.822765 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a2603d-cc99-4852-9318-bf2d5b471e4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:06.823425 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a2603d-cc99-4852-9318-bf2d5b471e4b admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:06.823706 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a2603d-cc99-4852-9318-bf2d5b471e4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:06.823973 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a2603d-cc99-4852-9318-bf2d5b471e4b admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:06.824603 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a2603d-cc99-4852-9318-bf2d5b471e4b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:06.826469 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a2603d-cc99-4852-9318-bf2d5b471e4b admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:06.841078 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15830333-209b-49a5-bb7b-543d79b560c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:06.842746 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15830333-209b-49a5-bb7b-543d79b560c9 service cinder] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:06.853793 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 988/1995] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:14:06 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:14:06.855057 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1623f9-835f-4546-b863-bc457f2f6e42 None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:06.855518 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1623f9-835f-4546-b863-bc457f2f6e42 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:06.858675 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1623f9-835f-4546-b863-bc457f2f6e42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:06.858791 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1008/1996] 10.222.0.79 () {60 vars in 1153 bytes} [Tue Aug 30 01:14:06 2022] POST /identity/v3/projects => generated 381 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:14:06.860095 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a2603d-cc99-4852-9318-bf2d5b471e4b admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:06.880852 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-0a1623f9-835f-4546-b863-bc457f2f6e42 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:14:06.882074 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-0a1623f9-835f-4546-b863-bc457f2f6e42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:06.947561 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a2603d-cc99-4852-9318-bf2d5b471e4b admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:06.951348 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 989/1997] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:14:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:14:06.956933 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cbcaf0-187e-4dbc-b3d4-099594a2925f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:06.957127 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1623f9-835f-4546-b863-bc457f2f6e42 None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:06.957294 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cbcaf0-187e-4dbc-b3d4-099594a2925f admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:06.957294 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cbcaf0-187e-4dbc-b3d4-099594a2925f admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:06.957294 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cbcaf0-187e-4dbc-b3d4-099594a2925f admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:06.957842 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cbcaf0-187e-4dbc-b3d4-099594a2925f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:06.961204 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cbcaf0-187e-4dbc-b3d4-099594a2925f admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:06.966929 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1623f9-835f-4546-b863-bc457f2f6e42 None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:06.972568 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfc0b0f-f5e2-417a-8adb-eb5ad6f0633f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:06.973256 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfc0b0f-f5e2-417a-8adb-eb5ad6f0633f admin admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:06.973609 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfc0b0f-f5e2-417a-8adb-eb5ad6f0633f admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:06.973963 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfc0b0f-f5e2-417a-8adb-eb5ad6f0633f admin admin] PATH_INFO: `/v3/domains` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:06.974682 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfc0b0f-f5e2-417a-8adb-eb5ad6f0633f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:14:06.975052 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfc0b0f-f5e2-417a-8adb-eb5ad6f0633f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:06.976927 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfc0b0f-f5e2-417a-8adb-eb5ad6f0633f admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:06.989622 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:14:06.993957 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 990/1998] 10.222.0.79 () {58 vars in 1153 bytes} [Tue Aug 30 01:14:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:14:06.994951 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfc0b0f-f5e2-417a-8adb-eb5ad6f0633f admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:06.997117 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-4dfc0b0f-f5e2-417a-8adb-eb5ad6f0633f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:07.007618 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1009/1999] 10.222.0.79 () {60 vars in 1144 bytes} [Tue Aug 30 01:14:06 2022] POST /identity/v3/users => generated 297 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:14:07.008383 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cbcaf0-187e-4dbc-b3d4-099594a2925f admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:07.015038 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfc0b0f-f5e2-417a-8adb-eb5ad6f0633f admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:07.020182 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a393c85-85e5-4207-84ff-54da445082ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:07.020900 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a393c85-85e5-4207-84ff-54da445082ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:07.021063 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cbcaf0-187e-4dbc-b3d4-099594a2925f admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:07.021195 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a393c85-85e5-4207-84ff-54da445082ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:07.021449 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a393c85-85e5-4207-84ff-54da445082ee admin admin] PATH_INFO: `/v3/users/8ff088f6dbf04e37b1ef72e4b3835fe0` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:07.022677 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a393c85-85e5-4207-84ff-54da445082ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ff088f6dbf04e37b1ef72e4b3835fe0)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:07.024739 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a393c85-85e5-4207-84ff-54da445082ee admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:07.026140 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c5833a-50b8-4aed-b71f-f31f46915018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:07.026769 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c5833a-50b8-4aed-b71f-f31f46915018 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:07.027058 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c5833a-50b8-4aed-b71f-f31f46915018 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:07.027426 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c5833a-50b8-4aed-b71f-f31f46915018 admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:07.028165 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c5833a-50b8-4aed-b71f-f31f46915018 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:07.030061 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c5833a-50b8-4aed-b71f-f31f46915018 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:07.064203 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1010/2000] 10.222.0.79 () {60 vars in 1153 bytes} [Tue Aug 30 01:14:07 2022] POST /identity/v3/projects => generated 385 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:14:07.065268 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c5833a-50b8-4aed-b71f-f31f46915018 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:07.085981 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-5a393c85-85e5-4207-84ff-54da445082ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ff088f6dbf04e37b1ef72e4b3835fe0'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:07.095835 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-5a393c85-85e5-4207-84ff-54da445082ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ff088f6dbf04e37b1ef72e4b3835fe0'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:07.110065 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-5a393c85-85e5-4207-84ff-54da445082ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ff088f6dbf04e37b1ef72e4b3835fe0'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:07.110835 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-5a393c85-85e5-4207-84ff-54da445082ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ff088f6dbf04e37b1ef72e4b3835fe0'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:07.122087 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-5a393c85-85e5-4207-84ff-54da445082ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ff088f6dbf04e37b1ef72e4b3835fe0'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:07.131535 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 991/2001] 10.222.0.79 () {58 vars in 1224 bytes} [Tue Aug 30 01:14:06 2022] DELETE /identity/v3/users/8ff088f6dbf04e37b1ef72e4b3835fe0 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:14:07.132443 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a393c85-85e5-4207-84ff-54da445082ee admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:07.133843 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-5a393c85-85e5-4207-84ff-54da445082ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:07.146290 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c5833a-50b8-4aed-b71f-f31f46915018 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:07.156670 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:14:07.218076 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a393c85-85e5-4207-84ff-54da445082ee admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:07.219349 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046b8ab4-1f35-48ea-91f1-87304f22c0c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:07.220020 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046b8ab4-1f35-48ea-91f1-87304f22c0c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:07.220301 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046b8ab4-1f35-48ea-91f1-87304f22c0c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:07.220666 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046b8ab4-1f35-48ea-91f1-87304f22c0c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:07.221344 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046b8ab4-1f35-48ea-91f1-87304f22c0c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:07.224206 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046b8ab4-1f35-48ea-91f1-87304f22c0c0 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:07.225210 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d4551c-7e63-43c8-9eb3-99906cdb80fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:07.225864 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d4551c-7e63-43c8-9eb3-99906cdb80fe admin admin] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:07.226123 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d4551c-7e63-43c8-9eb3-99906cdb80fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:07.226408 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d4551c-7e63-43c8-9eb3-99906cdb80fe admin admin] PATH_INFO: `/v3/users` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:07.227043 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d4551c-7e63-43c8-9eb3-99906cdb80fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:07.235646 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d4551c-7e63-43c8-9eb3-99906cdb80fe admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:07.242259 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1011/2002] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:14:07 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:14:07.243903 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbc6e5e-8532-40c7-86a8-d2ba9fc2f1d2 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:07.244361 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbc6e5e-8532-40c7-86a8-d2ba9fc2f1d2 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:07.249092 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbc6e5e-8532-40c7-86a8-d2ba9fc2f1d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:07.260821 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 992/2003] 10.222.0.79 () {60 vars in 1144 bytes} [Tue Aug 30 01:14:07 2022] POST /identity/v3/users => generated 293 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:14:07.262338 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d4551c-7e63-43c8-9eb3-99906cdb80fe admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:07.264829 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-70d4551c-7e63-43c8-9eb3-99906cdb80fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:07.278412 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d4551c-7e63-43c8-9eb3-99906cdb80fe admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:07.278559 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-7fbc6e5e-8532-40c7-86a8-d2ba9fc2f1d2 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:14:07.279842 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-7fbc6e5e-8532-40c7-86a8-d2ba9fc2f1d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:07.286551 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d42e7f9-7384-4396-ab4e-b3511152b95a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:07.287330 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d42e7f9-7384-4396-ab4e-b3511152b95a admin admin] REQUEST_METHOD: `PUT` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:07.287722 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d42e7f9-7384-4396-ab4e-b3511152b95a admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:07.287908 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d42e7f9-7384-4396-ab4e-b3511152b95a admin admin] PATH_INFO: `/v3/projects/d3a0039aa4024d35a0c888d334f92b6e/users/f987c8147570490fb7f994812d83b623/roles/d14c3070c9184d76a7b23df69bd3db07` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:07.290309 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1012/2004] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:14:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:14:07.291224 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbc6e5e-8532-40c7-86a8-d2ba9fc2f1d2 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:07.307306 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbc6e5e-8532-40c7-86a8-d2ba9fc2f1d2 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:07.308707 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d42e7f9-7384-4396-ab4e-b3511152b95a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3a0039aa4024d35a0c888d334f92b6e, user_id=f987c8147570490fb7f994812d83b623, role_id=d14c3070c9184d76a7b23df69bd3db07)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:07.311427 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d42e7f9-7384-4396-ab4e-b3511152b95a admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:07.311977 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02591da-536f-4abf-8ca6-1004e97376dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:07.312590 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02591da-536f-4abf-8ca6-1004e97376dd admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:07.312868 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02591da-536f-4abf-8ca6-1004e97376dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:07.313136 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02591da-536f-4abf-8ca6-1004e97376dd admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:07.313783 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02591da-536f-4abf-8ca6-1004e97376dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:07.316417 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02591da-536f-4abf-8ca6-1004e97376dd admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:07.328108 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 993/2005] 10.222.0.79 () {60 vars in 1483 bytes} [Tue Aug 30 01:14:07 2022] PUT /identity/v3/projects/d3a0039aa4024d35a0c888d334f92b6e/users/f987c8147570490fb7f994812d83b623/roles/d14c3070c9184d76a7b23df69bd3db07 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:14:07.328950 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d42e7f9-7384-4396-ab4e-b3511152b95a admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:07.329131 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1013/2006] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:14:07 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:14:07.332769 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02591da-536f-4abf-8ca6-1004e97376dd admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:07.333647 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-8d42e7f9-7384-4396-ab4e-b3511152b95a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:07.343368 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02591da-536f-4abf-8ca6-1004e97376dd admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:07.405695 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d42e7f9-7384-4396-ab4e-b3511152b95a admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:07.409950 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3298062d-28dc-4e7b-8ae7-6b9dcad1310c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16e6a0ca26fc4ef892c188ad89a1e132', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:07.410571 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3298062d-28dc-4e7b-8ae7-6b9dcad1310c service neutron] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:07.410844 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3298062d-28dc-4e7b-8ae7-6b9dcad1310c service neutron] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:07.411452 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3298062d-28dc-4e7b-8ae7-6b9dcad1310c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:07.418279 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:14:07.427711 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b903c881-1f5e-4eb3-9e18-e7ae519a95a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:07.428847 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b903c881-1f5e-4eb3-9e18-e7ae519a95a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:07.429577 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b903c881-1f5e-4eb3-9e18-e7ae519a95a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:07.429941 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b903c881-1f5e-4eb3-9e18-e7ae519a95a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:07.430790 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b903c881-1f5e-4eb3-9e18-e7ae519a95a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:07.432535 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b903c881-1f5e-4eb3-9e18-e7ae519a95a8 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:07.445065 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1014/2007] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:14:07 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:14:07.446382 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b903c881-1f5e-4eb3-9e18-e7ae519a95a8 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:07.459240 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b903c881-1f5e-4eb3-9e18-e7ae519a95a8 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:07.464433 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71789642-8203-4255-84e4-0737ca8b7ebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:07.465195 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71789642-8203-4255-84e4-0737ca8b7ebd admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:07.465506 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71789642-8203-4255-84e4-0737ca8b7ebd admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:07.465736 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71789642-8203-4255-84e4-0737ca8b7ebd admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:07.466500 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71789642-8203-4255-84e4-0737ca8b7ebd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:07.468113 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71789642-8203-4255-84e4-0737ca8b7ebd admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:07.484377 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1015/2008] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:14:07 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:14:07.487441 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71789642-8203-4255-84e4-0737ca8b7ebd admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:07.492760 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3298062d-28dc-4e7b-8ae7-6b9dcad1310c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:07.494697 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3298062d-28dc-4e7b-8ae7-6b9dcad1310c service neutron] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:07.498661 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71789642-8203-4255-84e4-0737ca8b7ebd admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:07.504829 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d0b775-063f-44f2-8999-06416052f0ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:07.505560 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d0b775-063f-44f2-8999-06416052f0ba admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:07.505905 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d0b775-063f-44f2-8999-06416052f0ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:07.506244 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d0b775-063f-44f2-8999-06416052f0ba admin admin] PATH_INFO: `/v3/projects/d3a0039aa4024d35a0c888d334f92b6e/users/f987c8147570490fb7f994812d83b623/roles/d14c3070c9184d76a7b23df69bd3db07` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:07.506713 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 994/2009] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:14:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:14:07.508629 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d0b775-063f-44f2-8999-06416052f0ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3a0039aa4024d35a0c888d334f92b6e, user_id=f987c8147570490fb7f994812d83b623, role_id=d14c3070c9184d76a7b23df69bd3db07)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:07.511358 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d0b775-063f-44f2-8999-06416052f0ba admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:07.520031 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3298062d-28dc-4e7b-8ae7-6b9dcad1310c service neutron] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:07.525097 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1016/2010] 10.222.0.79 () {60 vars in 1483 bytes} [Tue Aug 30 01:14:07 2022] PUT /identity/v3/projects/d3a0039aa4024d35a0c888d334f92b6e/users/f987c8147570490fb7f994812d83b623/roles/d14c3070c9184d76a7b23df69bd3db07 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:14:07.533672 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3298062d-28dc-4e7b-8ae7-6b9dcad1310c service neutron] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:07.536339 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce5fe72-d193-49d6-b6bb-fa069e4e2432 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:07.536339 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce5fe72-d193-49d6-b6bb-fa069e4e2432 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:07.536511 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce5fe72-d193-49d6-b6bb-fa069e4e2432 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:07.568751 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-fce5fe72-d193-49d6-b6bb-fa069e4e2432 None None] MFA Rules not processed for user `f987c8147570490fb7f994812d83b623`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:14:07.570079 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-fce5fe72-d193-49d6-b6bb-fa069e4e2432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:07.577857 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:14:07.618691 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77e94c0-41ac-4ce8-9434-b0e5c38aa87a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:07.619803 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77e94c0-41ac-4ce8-9434-b0e5c38aa87a admin admin] REQUEST_METHOD: `PUT` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:07.620156 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77e94c0-41ac-4ce8-9434-b0e5c38aa87a admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:07.620590 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77e94c0-41ac-4ce8-9434-b0e5c38aa87a admin admin] PATH_INFO: `/v3/projects/bff1abdc348b4fb9a5a02eb0cd1028ef/users/4a9b0883a36c407d994b945227d9e120/roles/c37945a17623465f899d4f217e7af593` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:07.643193 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77e94c0-41ac-4ce8-9434-b0e5c38aa87a admin admin] RBAC: Authorizing `identity:create_grant(project_id=bff1abdc348b4fb9a5a02eb0cd1028ef, user_id=4a9b0883a36c407d994b945227d9e120, role_id=c37945a17623465f899d4f217e7af593)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:07.646054 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77e94c0-41ac-4ce8-9434-b0e5c38aa87a admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:07.679511 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1017/2011] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:14:07 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:14:07.686189 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 995/2012] 10.222.0.79 () {60 vars in 1483 bytes} [Tue Aug 30 01:14:07 2022] PUT /identity/v3/projects/bff1abdc348b4fb9a5a02eb0cd1028ef/users/4a9b0883a36c407d994b945227d9e120/roles/c37945a17623465f899d4f217e7af593 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:14:07.696704 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77e94c0-41ac-4ce8-9434-b0e5c38aa87a admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:07.697566 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3a059e-7c62-4085-b693-31224d857b3d None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:07.698053 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3a059e-7c62-4085-b693-31224d857b3d None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:07.698911 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-d77e94c0-41ac-4ce8-9434-b0e5c38aa87a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:07.699236 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3a059e-7c62-4085-b693-31224d857b3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:07.743189 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-fd3a059e-7c62-4085-b693-31224d857b3d None None] MFA Rules not processed for user `4a9b0883a36c407d994b945227d9e120`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:14:07.744973 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-fd3a059e-7c62-4085-b693-31224d857b3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:07.788158 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77e94c0-41ac-4ce8-9434-b0e5c38aa87a admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:07.795054 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d25e875-8cb4-462d-946d-699060c6efdf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f827c7670b74d938ffe066ced88d1c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:07.797205 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d25e875-8cb4-462d-946d-699060c6efdf service cinder] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:07.797825 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d25e875-8cb4-462d-946d-699060c6efdf service cinder] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:07.798366 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d25e875-8cb4-462d-946d-699060c6efdf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:07.825898 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1018/2013] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:14:07 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:14:07.838006 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3a059e-7c62-4085-b693-31224d857b3d None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:07.839222 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-fd3a059e-7c62-4085-b693-31224d857b3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:07.855455 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3a059e-7c62-4085-b693-31224d857b3d None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:07.860795 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96d8adc-77e2-45ad-a790-b76a6adf0382 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f827c7670b74d938ffe066ced88d1c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:07.862044 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96d8adc-77e2-45ad-a790-b76a6adf0382 service cinder] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:07.862044 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96d8adc-77e2-45ad-a790-b76a6adf0382 service cinder] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:07.862285 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96d8adc-77e2-45ad-a790-b76a6adf0382 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:07.876292 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96d8adc-77e2-45ad-a790-b76a6adf0382 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:07.880598 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96d8adc-77e2-45ad-a790-b76a6adf0382 service cinder] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:07.890508 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d25e875-8cb4-462d-946d-699060c6efdf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:07.891199 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1019/2014] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:14:07 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 01:14:07.892537 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d25e875-8cb4-462d-946d-699060c6efdf service cinder] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:07.905158 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 996/2015] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:14:07 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 01:14:07.937355 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96d8adc-77e2-45ad-a790-b76a6adf0382 service cinder] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:07.938817 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-c96d8adc-77e2-45ad-a790-b76a6adf0382 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:07.980831 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:14:08.062213 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96d8adc-77e2-45ad-a790-b76a6adf0382 service cinder] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:08.073250 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1d5c35-c6a2-421d-b40d-4b76dd01e6bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:08.074221 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1d5c35-c6a2-421d-b40d-4b76dd01e6bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:08.074705 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1d5c35-c6a2-421d-b40d-4b76dd01e6bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:08.075759 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1d5c35-c6a2-421d-b40d-4b76dd01e6bc admin admin] PATH_INFO: `/v3/projects/c0e3e0996ff14f648a7673675a9d1bb7` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:08.077139 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1d5c35-c6a2-421d-b40d-4b76dd01e6bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0e3e0996ff14f648a7673675a9d1bb7)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:08.079865 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1d5c35-c6a2-421d-b40d-4b76dd01e6bc admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:08.145756 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-5e1d5c35-c6a2-421d-b40d-4b76dd01e6bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0e3e0996ff14f648a7673675a9d1bb7', 'request_id': 'req-5e1d5c35-c6a2-421d-b40d-4b76dd01e6bc'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:08.153518 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-5e1d5c35-c6a2-421d-b40d-4b76dd01e6bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0e3e0996ff14f648a7673675a9d1bb7', 'request_id': 'req-5e1d5c35-c6a2-421d-b40d-4b76dd01e6bc'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:08.167874 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-5e1d5c35-c6a2-421d-b40d-4b76dd01e6bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0e3e0996ff14f648a7673675a9d1bb7', 'request_id': 'req-5e1d5c35-c6a2-421d-b40d-4b76dd01e6bc'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:08.181629 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-5e1d5c35-c6a2-421d-b40d-4b76dd01e6bc admin admin] The token cache is being invalidate because project c0e3e0996ff14f648a7673675a9d1bb7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:14:08.181931 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-5e1d5c35-c6a2-421d-b40d-4b76dd01e6bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:08.183863 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-5e1d5c35-c6a2-421d-b40d-4b76dd01e6bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:08.190064 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1020/2016] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 30 01:14:07 2022] DELETE /identity/v3/projects/c0e3e0996ff14f648a7673675a9d1bb7 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:14:08.190674 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d25e875-8cb4-462d-946d-699060c6efdf service cinder] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:08.211258 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d25e875-8cb4-462d-946d-699060c6efdf service cinder] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:08.290777 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8286d4ce-d76b-4944-9e2d-fbb5650e6b35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:08.291599 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8286d4ce-d76b-4944-9e2d-fbb5650e6b35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:08.291950 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8286d4ce-d76b-4944-9e2d-fbb5650e6b35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:08.292296 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8286d4ce-d76b-4944-9e2d-fbb5650e6b35 admin admin] PATH_INFO: `/v3/users/abf553b2dfff464fb78f984fb63a2082` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:08.293932 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8286d4ce-d76b-4944-9e2d-fbb5650e6b35 admin admin] RBAC: Authorizing `identity:delete_user(user_id=abf553b2dfff464fb78f984fb63a2082)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:08.297576 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8286d4ce-d76b-4944-9e2d-fbb5650e6b35 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:08.306047 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:14:08.382480 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-8286d4ce-d76b-4944-9e2d-fbb5650e6b35 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'abf553b2dfff464fb78f984fb63a2082'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:08.398406 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-8286d4ce-d76b-4944-9e2d-fbb5650e6b35 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'abf553b2dfff464fb78f984fb63a2082'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:08.412666 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-8286d4ce-d76b-4944-9e2d-fbb5650e6b35 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'abf553b2dfff464fb78f984fb63a2082'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:08.413667 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-8286d4ce-d76b-4944-9e2d-fbb5650e6b35 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'abf553b2dfff464fb78f984fb63a2082'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:08.425324 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-8286d4ce-d76b-4944-9e2d-fbb5650e6b35 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'abf553b2dfff464fb78f984fb63a2082'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:08.438929 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 997/2017] 10.222.0.79 () {58 vars in 1224 bytes} [Tue Aug 30 01:14:08 2022] DELETE /identity/v3/users/abf553b2dfff464fb78f984fb63a2082 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:14:08.451932 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1d5c35-c6a2-421d-b40d-4b76dd01e6bc admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:08.453387 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-5e1d5c35-c6a2-421d-b40d-4b76dd01e6bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:08.466480 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1d5c35-c6a2-421d-b40d-4b76dd01e6bc admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:08.545876 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c0a787-4e68-40c7-ac58-eabc167ef4de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:08.546527 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c0a787-4e68-40c7-ac58-eabc167ef4de admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:08.546802 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c0a787-4e68-40c7-ac58-eabc167ef4de admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:08.547073 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c0a787-4e68-40c7-ac58-eabc167ef4de admin admin] PATH_INFO: `/v3/users/569e2600f5e7460a82d5030476609d5d` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:08.548321 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c0a787-4e68-40c7-ac58-eabc167ef4de admin admin] RBAC: Authorizing `identity:delete_user(user_id=569e2600f5e7460a82d5030476609d5d)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:08.550984 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c0a787-4e68-40c7-ac58-eabc167ef4de admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:08.626767 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b7c0a787-4e68-40c7-ac58-eabc167ef4de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '569e2600f5e7460a82d5030476609d5d'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:08.635745 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b7c0a787-4e68-40c7-ac58-eabc167ef4de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '569e2600f5e7460a82d5030476609d5d'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:08.645191 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b7c0a787-4e68-40c7-ac58-eabc167ef4de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '569e2600f5e7460a82d5030476609d5d'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:08.646201 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b7c0a787-4e68-40c7-ac58-eabc167ef4de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '569e2600f5e7460a82d5030476609d5d'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:08.648056 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:14:08.661897 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b7c0a787-4e68-40c7-ac58-eabc167ef4de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '569e2600f5e7460a82d5030476609d5d'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:08.668110 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1021/2018] 10.222.0.79 () {58 vars in 1224 bytes} [Tue Aug 30 01:14:08 2022] DELETE /identity/v3/users/569e2600f5e7460a82d5030476609d5d => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:14:08.672662 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710cba92-7867-407b-b85f-96c23422058d None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:08.672944 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710cba92-7867-407b-b85f-96c23422058d None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:08.673244 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710cba92-7867-407b-b85f-96c23422058d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:08.693652 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-710cba92-7867-407b-b85f-96c23422058d None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:14:08.694833 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-710cba92-7867-407b-b85f-96c23422058d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:08.761984 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c0a787-4e68-40c7-ac58-eabc167ef4de admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:08.763375 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-b7c0a787-4e68-40c7-ac58-eabc167ef4de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:08.765724 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 998/2019] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:14:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:14:08.776285 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710cba92-7867-407b-b85f-96c23422058d None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:08.779111 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-710cba92-7867-407b-b85f-96c23422058d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:08.782428 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c0a787-4e68-40c7-ac58-eabc167ef4de admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:08.791503 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25446c0-2d36-4fcb-9a30-aa08f3786d98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:08.792803 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25446c0-2d36-4fcb-9a30-aa08f3786d98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:08.793099 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25446c0-2d36-4fcb-9a30-aa08f3786d98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:08.794410 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25446c0-2d36-4fcb-9a30-aa08f3786d98 admin admin] PATH_INFO: `/v3/projects/91e43f3558a44170b24d6b25fee79494` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:08.794623 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25446c0-2d36-4fcb-9a30-aa08f3786d98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=91e43f3558a44170b24d6b25fee79494)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:08.796859 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25446c0-2d36-4fcb-9a30-aa08f3786d98 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:08.850365 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710cba92-7867-407b-b85f-96c23422058d None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:08.856899 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-d25446c0-2d36-4fcb-9a30-aa08f3786d98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91e43f3558a44170b24d6b25fee79494', 'request_id': 'req-d25446c0-2d36-4fcb-9a30-aa08f3786d98'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:08.865813 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-d25446c0-2d36-4fcb-9a30-aa08f3786d98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91e43f3558a44170b24d6b25fee79494', 'request_id': 'req-d25446c0-2d36-4fcb-9a30-aa08f3786d98'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:08.873420 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-d25446c0-2d36-4fcb-9a30-aa08f3786d98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91e43f3558a44170b24d6b25fee79494', 'request_id': 'req-d25446c0-2d36-4fcb-9a30-aa08f3786d98'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:08.891370 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-d25446c0-2d36-4fcb-9a30-aa08f3786d98 admin admin] The token cache is being invalidate because project 91e43f3558a44170b24d6b25fee79494 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:14:08.891671 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-d25446c0-2d36-4fcb-9a30-aa08f3786d98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:08.892354 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-d25446c0-2d36-4fcb-9a30-aa08f3786d98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:08.893942 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1022/2020] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 30 01:14:08 2022] DELETE /identity/v3/projects/91e43f3558a44170b24d6b25fee79494 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:14:08.895571 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:14:08.901151 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df51fde5-9f06-4a9d-8f69-51c48686abea None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:08.901258 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df51fde5-9f06-4a9d-8f69-51c48686abea None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:08.901520 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df51fde5-9f06-4a9d-8f69-51c48686abea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:08.911569 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1557ea-3b42-4e16-92c4-744aada17abf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16e6a0ca26fc4ef892c188ad89a1e132', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:08.912517 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1557ea-3b42-4e16-92c4-744aada17abf service neutron] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:08.912800 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1557ea-3b42-4e16-92c4-744aada17abf service neutron] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:08.913127 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1557ea-3b42-4e16-92c4-744aada17abf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:08.915084 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-ff1557ea-3b42-4e16-92c4-744aada17abf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:08.927497 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-df51fde5-9f06-4a9d-8f69-51c48686abea None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:14:08.928126 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-df51fde5-9f06-4a9d-8f69-51c48686abea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:08.994548 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1023/2021] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:14:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:14:09.000411 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1557ea-3b42-4e16-92c4-744aada17abf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:09.002225 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1557ea-3b42-4e16-92c4-744aada17abf service neutron] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:09.003630 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b108069-5255-4cf3-8d25-f15050f11ae9 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:09.003914 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b108069-5255-4cf3-8d25-f15050f11ae9 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:09.004192 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b108069-5255-4cf3-8d25-f15050f11ae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:09.015004 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 999/2022] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:14:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:14:09.024413 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-7b108069-5255-4cf3-8d25-f15050f11ae9 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:14:09.025660 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-7b108069-5255-4cf3-8d25-f15050f11ae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:09.034471 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1024/2023] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:14:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:14:09.038937 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1557ea-3b42-4e16-92c4-744aada17abf service neutron] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:09.048671 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1557ea-3b42-4e16-92c4-744aada17abf service neutron] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:09.054562 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b03167-2ae4-4973-b1f1-b91ab52ec616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:09.055213 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b03167-2ae4-4973-b1f1-b91ab52ec616 admin admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:09.055495 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b03167-2ae4-4973-b1f1-b91ab52ec616 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:09.055872 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b03167-2ae4-4973-b1f1-b91ab52ec616 admin admin] PATH_INFO: `/v3/domains` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:09.056565 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b03167-2ae4-4973-b1f1-b91ab52ec616 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:14:09.056866 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b03167-2ae4-4973-b1f1-b91ab52ec616 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:09.058485 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b03167-2ae4-4973-b1f1-b91ab52ec616 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:09.072864 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1000/2024] 10.222.0.79 () {58 vars in 1153 bytes} [Tue Aug 30 01:14:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:14:09.077120 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b108069-5255-4cf3-8d25-f15050f11ae9 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:09.091375 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b108069-5255-4cf3-8d25-f15050f11ae9 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:09.103076 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc489812-cde2-4d6f-afb2-f901a6cbff4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:09.103790 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc489812-cde2-4d6f-afb2-f901a6cbff4d admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:09.105291 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc489812-cde2-4d6f-afb2-f901a6cbff4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:09.105682 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc489812-cde2-4d6f-afb2-f901a6cbff4d admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:09.106821 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc489812-cde2-4d6f-afb2-f901a6cbff4d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:09.109427 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc489812-cde2-4d6f-afb2-f901a6cbff4d admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:09.150653 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1025/2025] 10.222.0.79 () {60 vars in 1153 bytes} [Tue Aug 30 01:14:09 2022] POST /identity/v3/projects => generated 373 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:14:09.155030 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b03167-2ae4-4973-b1f1-b91ab52ec616 admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:09.170885 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b03167-2ae4-4973-b1f1-b91ab52ec616 admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:09.250337 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9065bde8-4cbe-43d6-99a9-d365ca40ea2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:09.250959 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9065bde8-4cbe-43d6-99a9-d365ca40ea2a admin admin] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:09.251279 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9065bde8-4cbe-43d6-99a9-d365ca40ea2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:09.251599 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9065bde8-4cbe-43d6-99a9-d365ca40ea2a admin admin] PATH_INFO: `/v3/users` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:09.252280 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9065bde8-4cbe-43d6-99a9-d365ca40ea2a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:09.254504 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9065bde8-4cbe-43d6-99a9-d365ca40ea2a admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:09.282969 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1001/2026] 10.222.0.79 () {60 vars in 1144 bytes} [Tue Aug 30 01:14:09 2022] POST /identity/v3/users => generated 287 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:14:09.285290 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc489812-cde2-4d6f-afb2-f901a6cbff4d admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:09.295871 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc489812-cde2-4d6f-afb2-f901a6cbff4d admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:09.300711 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400625e8-c476-4fb4-8b4f-938a6a5d7d4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:09.301311 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400625e8-c476-4fb4-8b4f-938a6a5d7d4b admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:09.301589 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400625e8-c476-4fb4-8b4f-938a6a5d7d4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:09.301857 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400625e8-c476-4fb4-8b4f-938a6a5d7d4b admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:09.302499 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400625e8-c476-4fb4-8b4f-938a6a5d7d4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:09.304248 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400625e8-c476-4fb4-8b4f-938a6a5d7d4b admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:09.317017 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1026/2027] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:14:09 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:14:09.321882 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9065bde8-4cbe-43d6-99a9-d365ca40ea2a admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:09.336155 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9065bde8-4cbe-43d6-99a9-d365ca40ea2a admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:09.343509 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf9966e-59f5-4c77-82ac-5aa01e58c10d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:09.344260 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf9966e-59f5-4c77-82ac-5aa01e58c10d admin admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:09.344501 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf9966e-59f5-4c77-82ac-5aa01e58c10d admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:09.344676 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf9966e-59f5-4c77-82ac-5aa01e58c10d admin admin] PATH_INFO: `/v3/roles` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:09.345327 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf9966e-59f5-4c77-82ac-5aa01e58c10d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:09.347549 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf9966e-59f5-4c77-82ac-5aa01e58c10d admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:09.368291 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400625e8-c476-4fb4-8b4f-938a6a5d7d4b admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:09.368752 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1002/2028] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:14:09 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:14:09.379608 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400625e8-c476-4fb4-8b4f-938a6a5d7d4b admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:09.385333 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1851504-56d5-4ac3-b63f-6a86bb2bdcfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:09.386075 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1851504-56d5-4ac3-b63f-6a86bb2bdcfd admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:09.386974 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1851504-56d5-4ac3-b63f-6a86bb2bdcfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:09.387445 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1851504-56d5-4ac3-b63f-6a86bb2bdcfd admin admin] PATH_INFO: `/v3/projects/7e75c0befe034ca9bb8dfeb2149f98b6/users/20a1480c643e4917b90a0d00a87c73a1/roles/c37945a17623465f899d4f217e7af593` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:09.417019 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1851504-56d5-4ac3-b63f-6a86bb2bdcfd admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e75c0befe034ca9bb8dfeb2149f98b6, user_id=20a1480c643e4917b90a0d00a87c73a1, role_id=c37945a17623465f899d4f217e7af593)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:09.420860 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1851504-56d5-4ac3-b63f-6a86bb2bdcfd admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:09.436881 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:14:09.447810 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1027/2029] 10.222.0.79 () {60 vars in 1483 bytes} [Tue Aug 30 01:14:09 2022] PUT /identity/v3/projects/7e75c0befe034ca9bb8dfeb2149f98b6/users/20a1480c643e4917b90a0d00a87c73a1/roles/c37945a17623465f899d4f217e7af593 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:14:09.460989 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f9aef9-0cdb-41a1-904b-c54880f7cbd9 None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:09.461270 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f9aef9-0cdb-41a1-904b-c54880f7cbd9 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:09.461545 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f9aef9-0cdb-41a1-904b-c54880f7cbd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:09.501279 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-02f9aef9-0cdb-41a1-904b-c54880f7cbd9 None None] MFA Rules not processed for user `20a1480c643e4917b90a0d00a87c73a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:14:09.502208 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-02f9aef9-0cdb-41a1-904b-c54880f7cbd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:09.507514 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1851504-56d5-4ac3-b63f-6a86bb2bdcfd admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:09.510692 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-b1851504-56d5-4ac3-b63f-6a86bb2bdcfd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:09.600371 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:14:09.638438 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1851504-56d5-4ac3-b63f-6a86bb2bdcfd admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:09.652108 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce44871-7f5a-483f-ae85-bb944c8f777f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:09.652948 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce44871-7f5a-483f-ae85-bb944c8f777f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:09.654590 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce44871-7f5a-483f-ae85-bb944c8f777f admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:09.655461 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1003/2030] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:14:09 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:14:09.656010 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce44871-7f5a-483f-ae85-bb944c8f777f admin admin] PATH_INFO: `/v3/projects/4c0719f1b6744ee2b67809038e59abbc` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:09.660974 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce44871-7f5a-483f-ae85-bb944c8f777f admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c0719f1b6744ee2b67809038e59abbc)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:09.664508 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce44871-7f5a-483f-ae85-bb944c8f777f admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:09.680268 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f9aef9-0cdb-41a1-904b-c54880f7cbd9 None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:09.682191 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-02f9aef9-0cdb-41a1-904b-c54880f7cbd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:09.737925 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-5ce44871-7f5a-483f-ae85-bb944c8f777f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c0719f1b6744ee2b67809038e59abbc', 'request_id': 'req-5ce44871-7f5a-483f-ae85-bb944c8f777f'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:09.750155 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-5ce44871-7f5a-483f-ae85-bb944c8f777f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c0719f1b6744ee2b67809038e59abbc', 'request_id': 'req-5ce44871-7f5a-483f-ae85-bb944c8f777f'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:09.764229 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-5ce44871-7f5a-483f-ae85-bb944c8f777f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c0719f1b6744ee2b67809038e59abbc', 'request_id': 'req-5ce44871-7f5a-483f-ae85-bb944c8f777f'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:09.777371 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-5ce44871-7f5a-483f-ae85-bb944c8f777f admin admin] The token cache is being invalidate because project 4c0719f1b6744ee2b67809038e59abbc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:14:09.777371 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-5ce44871-7f5a-483f-ae85-bb944c8f777f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:09.778640 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-5ce44871-7f5a-483f-ae85-bb944c8f777f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:09.783028 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1028/2031] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 30 01:14:09 2022] DELETE /identity/v3/projects/4c0719f1b6744ee2b67809038e59abbc => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:14:09.783230 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f9aef9-0cdb-41a1-904b-c54880f7cbd9 None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:09.784818 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce44871-7f5a-483f-ae85-bb944c8f777f admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:09.786045 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-5ce44871-7f5a-483f-ae85-bb944c8f777f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:09.875095 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce44871-7f5a-483f-ae85-bb944c8f777f admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:09.883337 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ce5172-8960-481f-9250-75679c97ac71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:09.884351 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ce5172-8960-481f-9250-75679c97ac71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:09.884634 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ce5172-8960-481f-9250-75679c97ac71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:09.885027 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ce5172-8960-481f-9250-75679c97ac71 admin admin] PATH_INFO: `/v3/users/f987c8147570490fb7f994812d83b623` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:09.886242 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ce5172-8960-481f-9250-75679c97ac71 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f987c8147570490fb7f994812d83b623)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:09.888398 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ce5172-8960-481f-9250-75679c97ac71 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:09.893162 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b23767-c822-4444-9c86-506ef639f1ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f827c7670b74d938ffe066ced88d1c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:09.895012 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b23767-c822-4444-9c86-506ef639f1ae service cinder] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:09.896346 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b23767-c822-4444-9c86-506ef639f1ae service cinder] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:09.896346 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b23767-c822-4444-9c86-506ef639f1ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:09.897722 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-44b23767-c822-4444-9c86-506ef639f1ae service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:09.941410 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:14:09.961057 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-67ce5172-8960-481f-9250-75679c97ac71 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f987c8147570490fb7f994812d83b623'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:09.971458 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-67ce5172-8960-481f-9250-75679c97ac71 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f987c8147570490fb7f994812d83b623'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:09.989409 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-67ce5172-8960-481f-9250-75679c97ac71 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f987c8147570490fb7f994812d83b623'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:09.991619 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-67ce5172-8960-481f-9250-75679c97ac71 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f987c8147570490fb7f994812d83b623'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:09.995551 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b23767-c822-4444-9c86-506ef639f1ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:09.997422 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b23767-c822-4444-9c86-506ef639f1ae service cinder] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:10.008891 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1004/2032] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:14:09 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 01:14:10.022689 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-67ce5172-8960-481f-9250-75679c97ac71 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f987c8147570490fb7f994812d83b623'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:10.039217 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1029/2033] 10.222.0.79 () {58 vars in 1224 bytes} [Tue Aug 30 01:14:09 2022] DELETE /identity/v3/users/f987c8147570490fb7f994812d83b623 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:14:10.475467 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b23767-c822-4444-9c86-506ef639f1ae service cinder] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:10.487827 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b23767-c822-4444-9c86-506ef639f1ae service cinder] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:10.563548 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:14:10.571493 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efd3227-b09f-47a0-afab-54e57154dbe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:10.572170 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efd3227-b09f-47a0-afab-54e57154dbe9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:10.572448 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efd3227-b09f-47a0-afab-54e57154dbe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:10.573332 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efd3227-b09f-47a0-afab-54e57154dbe9 admin admin] PATH_INFO: `/v3/projects/d3a0039aa4024d35a0c888d334f92b6e` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:10.574565 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efd3227-b09f-47a0-afab-54e57154dbe9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3a0039aa4024d35a0c888d334f92b6e)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:10.576606 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efd3227-b09f-47a0-afab-54e57154dbe9 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:10.630858 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-8efd3227-b09f-47a0-afab-54e57154dbe9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3a0039aa4024d35a0c888d334f92b6e', 'request_id': 'req-8efd3227-b09f-47a0-afab-54e57154dbe9'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:10.639628 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-8efd3227-b09f-47a0-afab-54e57154dbe9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3a0039aa4024d35a0c888d334f92b6e', 'request_id': 'req-8efd3227-b09f-47a0-afab-54e57154dbe9'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:10.646077 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-8efd3227-b09f-47a0-afab-54e57154dbe9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3a0039aa4024d35a0c888d334f92b6e', 'request_id': 'req-8efd3227-b09f-47a0-afab-54e57154dbe9'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:10.660466 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-8efd3227-b09f-47a0-afab-54e57154dbe9 admin admin] The token cache is being invalidate because project d3a0039aa4024d35a0c888d334f92b6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81998) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:14:10.660749 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-8efd3227-b09f-47a0-afab-54e57154dbe9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:10.661410 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-8efd3227-b09f-47a0-afab-54e57154dbe9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:10.662995 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1005/2034] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 30 01:14:10 2022] DELETE /identity/v3/projects/d3a0039aa4024d35a0c888d334f92b6e => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:14:10.669300 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6a4e6b-ca55-4654-8c13-2234fedd10f2 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:10.669585 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6a4e6b-ca55-4654-8c13-2234fedd10f2 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:10.669857 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6a4e6b-ca55-4654-8c13-2234fedd10f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:10.697744 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-fc6a4e6b-ca55-4654-8c13-2234fedd10f2 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:14:10.698975 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-fc6a4e6b-ca55-4654-8c13-2234fedd10f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:10.779992 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1030/2035] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:14:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:14:10.789281 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5479a1-fd77-4bf7-92e9-4b7ba47257eb None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:10.789570 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5479a1-fd77-4bf7-92e9-4b7ba47257eb None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:10.789850 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5479a1-fd77-4bf7-92e9-4b7ba47257eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:10.812683 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-3c5479a1-fd77-4bf7-92e9-4b7ba47257eb None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:14:10.814048 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-3c5479a1-fd77-4bf7-92e9-4b7ba47257eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:10.823930 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1006/2036] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:14:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:14:10.828076 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6a4e6b-ca55-4654-8c13-2234fedd10f2 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:10.839815 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6a4e6b-ca55-4654-8c13-2234fedd10f2 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:10.844822 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48cf5e5-39ea-4217-8cf7-ab6e21d13578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:10.845795 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48cf5e5-39ea-4217-8cf7-ab6e21d13578 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:10.845795 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48cf5e5-39ea-4217-8cf7-ab6e21d13578 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:10.846188 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48cf5e5-39ea-4217-8cf7-ab6e21d13578 admin admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:10.847795 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48cf5e5-39ea-4217-8cf7-ab6e21d13578 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:14:10.848248 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48cf5e5-39ea-4217-8cf7-ab6e21d13578 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:10.849916 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48cf5e5-39ea-4217-8cf7-ab6e21d13578 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:10.871972 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1031/2037] 10.222.0.79 () {58 vars in 1153 bytes} [Tue Aug 30 01:14:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:14:10.872185 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5479a1-fd77-4bf7-92e9-4b7ba47257eb None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:10.882967 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5479a1-fd77-4bf7-92e9-4b7ba47257eb None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:10.889623 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6725d1-a09f-4d90-abda-363214a5738d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:10.890304 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6725d1-a09f-4d90-abda-363214a5738d admin admin] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:10.890594 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6725d1-a09f-4d90-abda-363214a5738d admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:10.890858 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6725d1-a09f-4d90-abda-363214a5738d admin admin] PATH_INFO: `/v3/projects` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:10.891630 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6725d1-a09f-4d90-abda-363214a5738d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:10.894229 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6725d1-a09f-4d90-abda-363214a5738d admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:10.935204 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1007/2038] 10.222.0.79 () {60 vars in 1153 bytes} [Tue Aug 30 01:14:10 2022] POST /identity/v3/projects => generated 397 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:14:10.939106 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48cf5e5-39ea-4217-8cf7-ab6e21d13578 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:10.950164 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48cf5e5-39ea-4217-8cf7-ab6e21d13578 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:11.040962 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7908d337-51c4-490a-9014-ba405398ce79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:11.043109 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7908d337-51c4-490a-9014-ba405398ce79 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:11.043360 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7908d337-51c4-490a-9014-ba405398ce79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:11.043734 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7908d337-51c4-490a-9014-ba405398ce79 admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:11.044429 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7908d337-51c4-490a-9014-ba405398ce79 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:11.046872 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7908d337-51c4-490a-9014-ba405398ce79 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:11.073833 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1032/2039] 10.222.0.79 () {60 vars in 1144 bytes} [Tue Aug 30 01:14:10 2022] POST /identity/v3/users => generated 299 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:14:11.077658 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6725d1-a09f-4d90-abda-363214a5738d admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:11.092768 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6725d1-a09f-4d90-abda-363214a5738d admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:11.099874 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7a598f-431a-4c46-b968-e0ab42b02504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:11.100814 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7a598f-431a-4c46-b968-e0ab42b02504 admin admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:11.101238 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7a598f-431a-4c46-b968-e0ab42b02504 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:11.101610 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7a598f-431a-4c46-b968-e0ab42b02504 admin admin] PATH_INFO: `/v3/roles` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:11.102578 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7a598f-431a-4c46-b968-e0ab42b02504 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:11.104351 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7a598f-431a-4c46-b968-e0ab42b02504 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:11.118587 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1008/2040] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:14:11 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:14:11.122682 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7908d337-51c4-490a-9014-ba405398ce79 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:11.133716 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7908d337-51c4-490a-9014-ba405398ce79 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:11.139939 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27fb6f3-aacd-46d1-83f0-43eb37200a1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:11.140670 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27fb6f3-aacd-46d1-83f0-43eb37200a1c admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:11.140949 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27fb6f3-aacd-46d1-83f0-43eb37200a1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:11.141227 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27fb6f3-aacd-46d1-83f0-43eb37200a1c admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:11.142594 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27fb6f3-aacd-46d1-83f0-43eb37200a1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:11.145551 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27fb6f3-aacd-46d1-83f0-43eb37200a1c admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:11.163101 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1033/2041] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:14:11 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:14:11.164409 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7a598f-431a-4c46-b968-e0ab42b02504 admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:11.195970 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7a598f-431a-4c46-b968-e0ab42b02504 admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:11.201538 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29be1f29-e1cc-42f0-ac4d-58cce9393d33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:11.202232 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29be1f29-e1cc-42f0-ac4d-58cce9393d33 admin admin] REQUEST_METHOD: `PUT` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:11.202464 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29be1f29-e1cc-42f0-ac4d-58cce9393d33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:11.202739 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29be1f29-e1cc-42f0-ac4d-58cce9393d33 admin admin] PATH_INFO: `/v3/projects/28c4c2267da24caaab3df2facba6e3ec/users/da6b457dee654a73acee1dbb6387c4fc/roles/c37945a17623465f899d4f217e7af593` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:11.245973 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29be1f29-e1cc-42f0-ac4d-58cce9393d33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=28c4c2267da24caaab3df2facba6e3ec, user_id=da6b457dee654a73acee1dbb6387c4fc, role_id=c37945a17623465f899d4f217e7af593)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:11.251064 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29be1f29-e1cc-42f0-ac4d-58cce9393d33 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:11.280337 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1009/2042] 10.222.0.79 () {60 vars in 1483 bytes} [Tue Aug 30 01:14:11 2022] PUT /identity/v3/projects/28c4c2267da24caaab3df2facba6e3ec/users/da6b457dee654a73acee1dbb6387c4fc/roles/c37945a17623465f899d4f217e7af593 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:14:11.296313 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45881c1b-58ec-45b2-a9af-d30d6a1041d0 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:11.296957 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45881c1b-58ec-45b2-a9af-d30d6a1041d0 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:11.297252 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45881c1b-58ec-45b2-a9af-d30d6a1041d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:11.344697 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-45881c1b-58ec-45b2-a9af-d30d6a1041d0 None None] MFA Rules not processed for user `da6b457dee654a73acee1dbb6387c4fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:14:11.346213 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-45881c1b-58ec-45b2-a9af-d30d6a1041d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:11.350439 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:14:11.449828 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1034/2043] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:14:11 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:14:11.467890 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29be1f29-e1cc-42f0-ac4d-58cce9393d33 admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:11.471052 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-29be1f29-e1cc-42f0-ac4d-58cce9393d33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:11.559564 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29be1f29-e1cc-42f0-ac4d-58cce9393d33 admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:11.564080 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d9c672-123c-446a-bd91-797f1a6f74c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f827c7670b74d938ffe066ced88d1c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:11.565382 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d9c672-123c-446a-bd91-797f1a6f74c7 service cinder] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:11.565867 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d9c672-123c-446a-bd91-797f1a6f74c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:11.566284 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d9c672-123c-446a-bd91-797f1a6f74c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:11.576978 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d9c672-123c-446a-bd91-797f1a6f74c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:11.579159 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d9c672-123c-446a-bd91-797f1a6f74c7 service cinder] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:11.597962 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1010/2044] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:14:11 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 01:14:13.287088 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45881c1b-58ec-45b2-a9af-d30d6a1041d0 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:13.288652 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-45881c1b-58ec-45b2-a9af-d30d6a1041d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:13.425994 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45881c1b-58ec-45b2-a9af-d30d6a1041d0 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:13.431637 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae5e12f-87de-48c8-9287-982d982ab5ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:13.432595 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae5e12f-87de-48c8-9287-982d982ab5ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:13.432917 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae5e12f-87de-48c8-9287-982d982ab5ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:13.433359 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae5e12f-87de-48c8-9287-982d982ab5ba admin admin] PATH_INFO: `/v3/users/5b55e7ed5f194f4dabd56b80573aa3c0` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:13.434658 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae5e12f-87de-48c8-9287-982d982ab5ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b55e7ed5f194f4dabd56b80573aa3c0)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:13.436745 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae5e12f-87de-48c8-9287-982d982ab5ba admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:13.499058 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-1ae5e12f-87de-48c8-9287-982d982ab5ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b55e7ed5f194f4dabd56b80573aa3c0'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:13.507224 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-1ae5e12f-87de-48c8-9287-982d982ab5ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b55e7ed5f194f4dabd56b80573aa3c0'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:13.516366 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-1ae5e12f-87de-48c8-9287-982d982ab5ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b55e7ed5f194f4dabd56b80573aa3c0'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:13.518869 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-1ae5e12f-87de-48c8-9287-982d982ab5ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b55e7ed5f194f4dabd56b80573aa3c0'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:13.533598 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-1ae5e12f-87de-48c8-9287-982d982ab5ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b55e7ed5f194f4dabd56b80573aa3c0'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:13.542055 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1035/2045] 10.222.0.79 () {58 vars in 1224 bytes} [Tue Aug 30 01:14:13 2022] DELETE /identity/v3/users/5b55e7ed5f194f4dabd56b80573aa3c0 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:14:13.592401 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d9c672-123c-446a-bd91-797f1a6f74c7 service cinder] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:13.595513 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-c6d9c672-123c-446a-bd91-797f1a6f74c7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:13.625149 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d9c672-123c-446a-bd91-797f1a6f74c7 service cinder] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:13.660886 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:14:13.701766 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4286acc-aa4a-47f4-b0b2-6ea3e55293ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:13.702668 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4286acc-aa4a-47f4-b0b2-6ea3e55293ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:13.703201 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4286acc-aa4a-47f4-b0b2-6ea3e55293ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:13.703473 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4286acc-aa4a-47f4-b0b2-6ea3e55293ca admin admin] PATH_INFO: `/v3/users/20a1480c643e4917b90a0d00a87c73a1` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:13.704962 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4286acc-aa4a-47f4-b0b2-6ea3e55293ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=20a1480c643e4917b90a0d00a87c73a1)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:13.707844 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4286acc-aa4a-47f4-b0b2-6ea3e55293ca admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:13.764555 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae5e12f-87de-48c8-9287-982d982ab5ba admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:13.766269 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-1ae5e12f-87de-48c8-9287-982d982ab5ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:13.784625 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae5e12f-87de-48c8-9287-982d982ab5ba admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:13.786171 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-e4286acc-aa4a-47f4-b0b2-6ea3e55293ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20a1480c643e4917b90a0d00a87c73a1'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:13.792736 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b13e0b5-c7a1-49e7-8e10-ae375d4069bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:13.793380 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b13e0b5-c7a1-49e7-8e10-ae375d4069bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:13.793663 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b13e0b5-c7a1-49e7-8e10-ae375d4069bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:13.793928 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b13e0b5-c7a1-49e7-8e10-ae375d4069bf admin admin] PATH_INFO: `/v3/projects/a8f44254a7f5453c81bc021153375831` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:13.795069 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b13e0b5-c7a1-49e7-8e10-ae375d4069bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8f44254a7f5453c81bc021153375831)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:13.798144 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b13e0b5-c7a1-49e7-8e10-ae375d4069bf admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:13.803494 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-e4286acc-aa4a-47f4-b0b2-6ea3e55293ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20a1480c643e4917b90a0d00a87c73a1'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:13.820048 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-e4286acc-aa4a-47f4-b0b2-6ea3e55293ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20a1480c643e4917b90a0d00a87c73a1'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:13.821218 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-e4286acc-aa4a-47f4-b0b2-6ea3e55293ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20a1480c643e4917b90a0d00a87c73a1'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:13.824213 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:14:13.833267 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-e4286acc-aa4a-47f4-b0b2-6ea3e55293ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20a1480c643e4917b90a0d00a87c73a1'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:13.841027 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1011/2046] 10.222.0.79 () {58 vars in 1224 bytes} [Tue Aug 30 01:14:13 2022] DELETE /identity/v3/users/20a1480c643e4917b90a0d00a87c73a1 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:14:13.846694 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf35e273-4303-42fd-ab55-eaf794f7a2d8 None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:13.847694 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf35e273-4303-42fd-ab55-eaf794f7a2d8 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:13.848354 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf35e273-4303-42fd-ab55-eaf794f7a2d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:13.869597 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-cf35e273-4303-42fd-ab55-eaf794f7a2d8 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:14:13.871045 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-cf35e273-4303-42fd-ab55-eaf794f7a2d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:13.875367 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-6b13e0b5-c7a1-49e7-8e10-ae375d4069bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8f44254a7f5453c81bc021153375831', 'request_id': 'req-6b13e0b5-c7a1-49e7-8e10-ae375d4069bf'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:13.887232 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-6b13e0b5-c7a1-49e7-8e10-ae375d4069bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8f44254a7f5453c81bc021153375831', 'request_id': 'req-6b13e0b5-c7a1-49e7-8e10-ae375d4069bf'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:13.895033 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-6b13e0b5-c7a1-49e7-8e10-ae375d4069bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8f44254a7f5453c81bc021153375831', 'request_id': 'req-6b13e0b5-c7a1-49e7-8e10-ae375d4069bf'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:13.908711 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-6b13e0b5-c7a1-49e7-8e10-ae375d4069bf admin admin] The token cache is being invalidate because project a8f44254a7f5453c81bc021153375831 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:14:13.909124 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-6b13e0b5-c7a1-49e7-8e10-ae375d4069bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:13.909895 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-6b13e0b5-c7a1-49e7-8e10-ae375d4069bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:13.911573 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1036/2047] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 30 01:14:13 2022] DELETE /identity/v3/projects/a8f44254a7f5453c81bc021153375831 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:14:13.912607 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b13e0b5-c7a1-49e7-8e10-ae375d4069bf admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:13.914516 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-6b13e0b5-c7a1-49e7-8e10-ae375d4069bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:13.955322 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1012/2048] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:14:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:14:13.956110 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9e6758-acec-46a9-b991-b20f545460ad None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:13.956454 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9e6758-acec-46a9-b991-b20f545460ad None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:13.956790 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9e6758-acec-46a9-b991-b20f545460ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:13.979834 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-aa9e6758-acec-46a9-b991-b20f545460ad None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:14:13.981024 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-aa9e6758-acec-46a9-b991-b20f545460ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:13.989875 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1013/2049] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:14:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:14:13.990790 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9e6758-acec-46a9-b991-b20f545460ad None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:13.992027 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-aa9e6758-acec-46a9-b991-b20f545460ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:14.003566 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b13e0b5-c7a1-49e7-8e10-ae375d4069bf admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:14.008519 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65e1b1d-16cc-4c26-a89e-f53602343405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:14.009140 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65e1b1d-16cc-4c26-a89e-f53602343405 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:14.009414 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65e1b1d-16cc-4c26-a89e-f53602343405 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:14.009681 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65e1b1d-16cc-4c26-a89e-f53602343405 admin admin] PATH_INFO: `/v3/users/4a9b0883a36c407d994b945227d9e120` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:14.010807 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65e1b1d-16cc-4c26-a89e-f53602343405 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a9b0883a36c407d994b945227d9e120)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:14.012846 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65e1b1d-16cc-4c26-a89e-f53602343405 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:14.040571 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:14:14.058386 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9e6758-acec-46a9-b991-b20f545460ad None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:14.062154 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb665c9-ad85-4d5c-b2c1-ceb3ded5c6f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16e6a0ca26fc4ef892c188ad89a1e132', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:14.062789 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb665c9-ad85-4d5c-b2c1-ceb3ded5c6f4 service neutron] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:14.063058 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb665c9-ad85-4d5c-b2c1-ceb3ded5c6f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:14.063371 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb665c9-ad85-4d5c-b2c1-ceb3ded5c6f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:14.066567 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-d65e1b1d-16cc-4c26-a89e-f53602343405 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a9b0883a36c407d994b945227d9e120'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:14.073300 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb665c9-ad85-4d5c-b2c1-ceb3ded5c6f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:14.074061 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-d65e1b1d-16cc-4c26-a89e-f53602343405 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a9b0883a36c407d994b945227d9e120'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:14.074756 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb665c9-ad85-4d5c-b2c1-ceb3ded5c6f4 service neutron] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:14.080943 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-d65e1b1d-16cc-4c26-a89e-f53602343405 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a9b0883a36c407d994b945227d9e120'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:14.081874 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-d65e1b1d-16cc-4c26-a89e-f53602343405 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a9b0883a36c407d994b945227d9e120'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:14.084994 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1014/2050] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:14:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:14:14.086298 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c70cf1-8559-4c04-9e1f-051ac40037be None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:14.086608 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c70cf1-8559-4c04-9e1f-051ac40037be None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:14.087000 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c70cf1-8559-4c04-9e1f-051ac40037be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:14.105125 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-d65e1b1d-16cc-4c26-a89e-f53602343405 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a9b0883a36c407d994b945227d9e120'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:14.108274 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-c3c70cf1-8559-4c04-9e1f-051ac40037be None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:14:14.109566 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-c3c70cf1-8559-4c04-9e1f-051ac40037be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:14.114004 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1037/2051] 10.222.0.79 () {58 vars in 1224 bytes} [Tue Aug 30 01:14:13 2022] DELETE /identity/v3/users/4a9b0883a36c407d994b945227d9e120 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:14:14.122049 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b6d4c7-f3b7-4954-9885-17fcaaac938d None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:14.122226 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1015/2052] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:14:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:14:14.122353 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b6d4c7-f3b7-4954-9885-17fcaaac938d None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:14.122353 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b6d4c7-f3b7-4954-9885-17fcaaac938d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:14.123861 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c70cf1-8559-4c04-9e1f-051ac40037be None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:14.134233 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c70cf1-8559-4c04-9e1f-051ac40037be None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:14.144880 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-10b6d4c7-f3b7-4954-9885-17fcaaac938d None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:14:14.146433 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-10b6d4c7-f3b7-4954-9885-17fcaaac938d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:14.172802 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:14:14.220430 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ae39b3-0666-4c06-9280-5ea6dc575a85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:14.222400 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ae39b3-0666-4c06-9280-5ea6dc575a85 admin admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:14.223017 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ae39b3-0666-4c06-9280-5ea6dc575a85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:14.223697 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ae39b3-0666-4c06-9280-5ea6dc575a85 admin admin] PATH_INFO: `/v3/domains` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:14.225356 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ae39b3-0666-4c06-9280-5ea6dc575a85 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:14:14.225356 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ae39b3-0666-4c06-9280-5ea6dc575a85 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:14.228093 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ae39b3-0666-4c06-9280-5ea6dc575a85 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:14.235621 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1038/2053] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:14:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:14:14.248979 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1016/2054] 10.222.0.79 () {58 vars in 1153 bytes} [Tue Aug 30 01:14:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:14:14.252924 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b6d4c7-f3b7-4954-9885-17fcaaac938d None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:14.255079 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ae39b3-0666-4c06-9280-5ea6dc575a85 admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:14.257411 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-e0ae39b3-0666-4c06-9280-5ea6dc575a85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:14.265408 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b6d4c7-f3b7-4954-9885-17fcaaac938d None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:14.272085 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ce8ef9-9a85-45f2-9d5f-7cc27d4f0b4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:14.272700 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ce8ef9-9a85-45f2-9d5f-7cc27d4f0b4e admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:14.272975 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ce8ef9-9a85-45f2-9d5f-7cc27d4f0b4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:14.273242 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ce8ef9-9a85-45f2-9d5f-7cc27d4f0b4e admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:14.273895 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ce8ef9-9a85-45f2-9d5f-7cc27d4f0b4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:14.276152 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ce8ef9-9a85-45f2-9d5f-7cc27d4f0b4e admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:14.309920 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1039/2055] 10.222.0.79 () {60 vars in 1153 bytes} [Tue Aug 30 01:14:14 2022] POST /identity/v3/projects => generated 375 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:14:14.313613 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ce8ef9-9a85-45f2-9d5f-7cc27d4f0b4e admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:14.329853 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ae39b3-0666-4c06-9280-5ea6dc575a85 admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:14.383390 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ce8ef9-9a85-45f2-9d5f-7cc27d4f0b4e admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:14.388467 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a133b3-e504-4ea8-94a0-5953f549e362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:14.389118 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a133b3-e504-4ea8-94a0-5953f549e362 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:14.389433 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a133b3-e504-4ea8-94a0-5953f549e362 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:14.389746 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a133b3-e504-4ea8-94a0-5953f549e362 admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:14.390446 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a133b3-e504-4ea8-94a0-5953f549e362 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:14.391335 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11323038-33e8-48ca-858f-c0b4bf90ddc0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16e6a0ca26fc4ef892c188ad89a1e132', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:14.392204 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11323038-33e8-48ca-858f-c0b4bf90ddc0 service neutron] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:14.392562 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a133b3-e504-4ea8-94a0-5953f549e362 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:14.392790 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11323038-33e8-48ca-858f-c0b4bf90ddc0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:14.393278 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11323038-33e8-48ca-858f-c0b4bf90ddc0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:14.408248 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11323038-33e8-48ca-858f-c0b4bf90ddc0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:14.411372 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11323038-33e8-48ca-858f-c0b4bf90ddc0 service neutron] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:14.423322 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1040/2056] 10.222.0.79 () {60 vars in 1144 bytes} [Tue Aug 30 01:14:14 2022] POST /identity/v3/users => generated 288 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:14:14.423322 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a133b3-e504-4ea8-94a0-5953f549e362 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:14.423322 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-d3a133b3-e504-4ea8-94a0-5953f549e362 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:14.435004 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1017/2057] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:14:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:14:14.435834 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11323038-33e8-48ca-858f-c0b4bf90ddc0 service neutron] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:14.437458 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a133b3-e504-4ea8-94a0-5953f549e362 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:14.444498 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbabc5e-1f7c-4d1a-834b-524342926144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:14.445140 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbabc5e-1f7c-4d1a-834b-524342926144 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:14.445418 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbabc5e-1f7c-4d1a-834b-524342926144 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:14.445749 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbabc5e-1f7c-4d1a-834b-524342926144 admin admin] PATH_INFO: `/v3/projects/7e75c0befe034ca9bb8dfeb2149f98b6` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:14.446880 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11323038-33e8-48ca-858f-c0b4bf90ddc0 service neutron] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:14.447001 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbabc5e-1f7c-4d1a-834b-524342926144 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e75c0befe034ca9bb8dfeb2149f98b6)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:14.448802 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbabc5e-1f7c-4d1a-834b-524342926144 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:14.452195 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cc47e9-d91a-4d51-8c44-69f6bc267bd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:14.452930 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cc47e9-d91a-4d51-8c44-69f6bc267bd1 admin admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:14.453214 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cc47e9-d91a-4d51-8c44-69f6bc267bd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:14.453498 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cc47e9-d91a-4d51-8c44-69f6bc267bd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:14.454129 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cc47e9-d91a-4d51-8c44-69f6bc267bd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:14.456802 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cc47e9-d91a-4d51-8c44-69f6bc267bd1 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:14.471046 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1018/2058] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:14:14 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:14:14.472379 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cc47e9-d91a-4d51-8c44-69f6bc267bd1 admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:14.482921 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cc47e9-d91a-4d51-8c44-69f6bc267bd1 admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:14.488856 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b53a2b1-5c36-4706-8a80-8ae9d4ad99ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:14.489461 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b53a2b1-5c36-4706-8a80-8ae9d4ad99ea admin admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:14.489745 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b53a2b1-5c36-4706-8a80-8ae9d4ad99ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:14.490203 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b53a2b1-5c36-4706-8a80-8ae9d4ad99ea admin admin] PATH_INFO: `/v3/roles` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:14.491083 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b53a2b1-5c36-4706-8a80-8ae9d4ad99ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:14.493394 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b53a2b1-5c36-4706-8a80-8ae9d4ad99ea admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:14.509802 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1019/2059] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:14:14 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:14:14.513145 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b53a2b1-5c36-4706-8a80-8ae9d4ad99ea admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:14.529638 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b53a2b1-5c36-4706-8a80-8ae9d4ad99ea admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:14.534404 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:14:14.539147 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-5fbabc5e-1f7c-4d1a-834b-524342926144 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e75c0befe034ca9bb8dfeb2149f98b6', 'request_id': 'req-5fbabc5e-1f7c-4d1a-834b-524342926144'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:14.550540 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-5fbabc5e-1f7c-4d1a-834b-524342926144 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e75c0befe034ca9bb8dfeb2149f98b6', 'request_id': 'req-5fbabc5e-1f7c-4d1a-834b-524342926144'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:14.558699 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-5fbabc5e-1f7c-4d1a-834b-524342926144 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e75c0befe034ca9bb8dfeb2149f98b6', 'request_id': 'req-5fbabc5e-1f7c-4d1a-834b-524342926144'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:14.575771 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-5fbabc5e-1f7c-4d1a-834b-524342926144 admin admin] The token cache is being invalidate because project 7e75c0befe034ca9bb8dfeb2149f98b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:14:14.576090 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-5fbabc5e-1f7c-4d1a-834b-524342926144 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:14.576860 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-5fbabc5e-1f7c-4d1a-834b-524342926144 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:14.580128 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1041/2060] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 30 01:14:14 2022] DELETE /identity/v3/projects/7e75c0befe034ca9bb8dfeb2149f98b6 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:14:14.585830 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ee3f8a-3829-4cc3-8b84-eb31199e8b98 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:14.586109 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ee3f8a-3829-4cc3-8b84-eb31199e8b98 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:14.586381 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ee3f8a-3829-4cc3-8b84-eb31199e8b98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:14.607025 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042a0266-c278-48ab-9355-70fe4a9d0d1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:14.608579 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042a0266-c278-48ab-9355-70fe4a9d0d1e admin admin] REQUEST_METHOD: `PUT` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:14.609102 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042a0266-c278-48ab-9355-70fe4a9d0d1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:14.609593 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042a0266-c278-48ab-9355-70fe4a9d0d1e admin admin] PATH_INFO: `/v3/projects/13c5624b0b004794b345c8d69152139f/users/d8445faa3bd6407986d739614cdd3a67/roles/c37945a17623465f899d4f217e7af593` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:14.619212 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-f8ee3f8a-3829-4cc3-8b84-eb31199e8b98 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:14:14.620117 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-f8ee3f8a-3829-4cc3-8b84-eb31199e8b98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:14.634276 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042a0266-c278-48ab-9355-70fe4a9d0d1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=13c5624b0b004794b345c8d69152139f, user_id=d8445faa3bd6407986d739614cdd3a67, role_id=c37945a17623465f899d4f217e7af593)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:14.637189 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042a0266-c278-48ab-9355-70fe4a9d0d1e admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:14.640810 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1042/2061] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:14:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:14:14.651069 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73d02c2-788d-4c20-b57d-40ec6d741132 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:14.651401 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73d02c2-788d-4c20-b57d-40ec6d741132 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:14.651659 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73d02c2-788d-4c20-b57d-40ec6d741132 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:14.661281 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1020/2062] 10.222.0.79 () {60 vars in 1483 bytes} [Tue Aug 30 01:14:14 2022] PUT /identity/v3/projects/13c5624b0b004794b345c8d69152139f/users/d8445faa3bd6407986d739614cdd3a67/roles/c37945a17623465f899d4f217e7af593 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:14:14.679789 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeacc41e-0968-4930-ab9c-b49e017fe05b None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:14.681171 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeacc41e-0968-4930-ab9c-b49e017fe05b None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:14.681462 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeacc41e-0968-4930-ab9c-b49e017fe05b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:14.684267 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-f73d02c2-788d-4c20-b57d-40ec6d741132 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:14:14.686284 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-f73d02c2-788d-4c20-b57d-40ec6d741132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:14.693721 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:14:14.730629 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-eeacc41e-0968-4930-ab9c-b49e017fe05b None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:14:14.732184 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-eeacc41e-0968-4930-ab9c-b49e017fe05b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:14.807932 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1043/2063] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:14:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:14:14.809892 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73d02c2-788d-4c20-b57d-40ec6d741132 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:14.823826 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73d02c2-788d-4c20-b57d-40ec6d741132 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:14.829813 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c70126f-e1bf-4fdd-b672-c8c62dc27483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:14.830509 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c70126f-e1bf-4fdd-b672-c8c62dc27483 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:14.831729 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c70126f-e1bf-4fdd-b672-c8c62dc27483 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:14.832407 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c70126f-e1bf-4fdd-b672-c8c62dc27483 admin admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:14.835192 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1021/2064] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:14:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:14:14.835328 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c70126f-e1bf-4fdd-b672-c8c62dc27483 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:14:14.835328 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c70126f-e1bf-4fdd-b672-c8c62dc27483 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:14.836845 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c70126f-e1bf-4fdd-b672-c8c62dc27483 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:14.842564 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeacc41e-0968-4930-ab9c-b49e017fe05b None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:14.844224 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-eeacc41e-0968-4930-ab9c-b49e017fe05b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:14.863256 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1044/2065] 10.222.0.79 () {58 vars in 1153 bytes} [Tue Aug 30 01:14:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:14:14.867112 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c70126f-e1bf-4fdd-b672-c8c62dc27483 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:14.869958 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-3c70126f-e1bf-4fdd-b672-c8c62dc27483 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:14.886113 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c70126f-e1bf-4fdd-b672-c8c62dc27483 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:14.891204 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83a6a3c-a6be-4b61-a2f3-65c3852be260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:14.891851 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83a6a3c-a6be-4b61-a2f3-65c3852be260 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:14.892205 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83a6a3c-a6be-4b61-a2f3-65c3852be260 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:14.892577 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83a6a3c-a6be-4b61-a2f3-65c3852be260 admin admin] PATH_INFO: `/v3/projects/bff1abdc348b4fb9a5a02eb0cd1028ef` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:14.894625 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83a6a3c-a6be-4b61-a2f3-65c3852be260 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bff1abdc348b4fb9a5a02eb0cd1028ef)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:14.897185 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83a6a3c-a6be-4b61-a2f3-65c3852be260 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:14.915240 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeacc41e-0968-4930-ab9c-b49e017fe05b None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:14.919624 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4da1ac-0fde-444d-8f2a-8bc95bb90d18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16e6a0ca26fc4ef892c188ad89a1e132', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:14.920232 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4da1ac-0fde-444d-8f2a-8bc95bb90d18 service neutron] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:14.920572 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4da1ac-0fde-444d-8f2a-8bc95bb90d18 service neutron] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:14.920842 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4da1ac-0fde-444d-8f2a-8bc95bb90d18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:14.932055 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4da1ac-0fde-444d-8f2a-8bc95bb90d18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:14.933597 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4da1ac-0fde-444d-8f2a-8bc95bb90d18 service neutron] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:14.945673 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1022/2066] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:14:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 01:14:14.946509 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4da1ac-0fde-444d-8f2a-8bc95bb90d18 service neutron] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:14.953751 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-f83a6a3c-a6be-4b61-a2f3-65c3852be260 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bff1abdc348b4fb9a5a02eb0cd1028ef', 'request_id': 'req-f83a6a3c-a6be-4b61-a2f3-65c3852be260'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:14.959165 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4da1ac-0fde-444d-8f2a-8bc95bb90d18 service neutron] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:14.965280 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-f83a6a3c-a6be-4b61-a2f3-65c3852be260 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bff1abdc348b4fb9a5a02eb0cd1028ef', 'request_id': 'req-f83a6a3c-a6be-4b61-a2f3-65c3852be260'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:14.976259 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-f83a6a3c-a6be-4b61-a2f3-65c3852be260 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bff1abdc348b4fb9a5a02eb0cd1028ef', 'request_id': 'req-f83a6a3c-a6be-4b61-a2f3-65c3852be260'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:14.997194 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-f83a6a3c-a6be-4b61-a2f3-65c3852be260 admin admin] The token cache is being invalidate because project bff1abdc348b4fb9a5a02eb0cd1028ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:14:14.997935 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-f83a6a3c-a6be-4b61-a2f3-65c3852be260 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:14.999156 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-f83a6a3c-a6be-4b61-a2f3-65c3852be260 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:15.008757 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1045/2067] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 30 01:14:14 2022] DELETE /identity/v3/projects/bff1abdc348b4fb9a5a02eb0cd1028ef => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:14:15.011236 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194ad8e4-6dac-4474-8b51-c229aadc8d1b None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:15.011708 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194ad8e4-6dac-4474-8b51-c229aadc8d1b None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:15.012174 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194ad8e4-6dac-4474-8b51-c229aadc8d1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:15.043321 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:14:15.050227 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-194ad8e4-6dac-4474-8b51-c229aadc8d1b None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:14:15.052777 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-194ad8e4-6dac-4474-8b51-c229aadc8d1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:15.091370 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b91bb4-d6d5-4375-bc90-5a3cebbe0107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:15.092653 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b91bb4-d6d5-4375-bc90-5a3cebbe0107 admin admin] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:15.093120 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b91bb4-d6d5-4375-bc90-5a3cebbe0107 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:15.093566 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b91bb4-d6d5-4375-bc90-5a3cebbe0107 admin admin] PATH_INFO: `/v3/projects` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:15.094600 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b91bb4-d6d5-4375-bc90-5a3cebbe0107 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:15.097493 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b91bb4-d6d5-4375-bc90-5a3cebbe0107 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:15.140244 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1023/2068] 10.222.0.79 () {60 vars in 1153 bytes} [Tue Aug 30 01:14:14 2022] POST /identity/v3/projects => generated 369 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:14:15.145511 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b91bb4-d6d5-4375-bc90-5a3cebbe0107 admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:15.147394 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-90b91bb4-d6d5-4375-bc90-5a3cebbe0107 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:15.170969 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1046/2069] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:14:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:14:15.181732 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cb2238-c32e-4774-920b-a55c4c67aadc None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:15.182320 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cb2238-c32e-4774-920b-a55c4c67aadc None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:15.182602 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cb2238-c32e-4774-920b-a55c4c67aadc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:15.212485 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-41cb2238-c32e-4774-920b-a55c4c67aadc None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:14:15.214348 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-41cb2238-c32e-4774-920b-a55c4c67aadc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:15.248629 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:14:15.256630 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b91bb4-d6d5-4375-bc90-5a3cebbe0107 admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:15.266151 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4147e674-a082-442b-b540-6b5748f73cbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:15.267622 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4147e674-a082-442b-b540-6b5748f73cbe admin admin] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:15.269905 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4147e674-a082-442b-b540-6b5748f73cbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:15.270309 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4147e674-a082-442b-b540-6b5748f73cbe admin admin] PATH_INFO: `/v3/users` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:15.271239 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4147e674-a082-442b-b540-6b5748f73cbe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:15.273741 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4147e674-a082-442b-b540-6b5748f73cbe admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:15.310479 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1024/2070] 10.222.0.79 () {60 vars in 1144 bytes} [Tue Aug 30 01:14:15 2022] POST /identity/v3/users => generated 285 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:14:15.314669 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4147e674-a082-442b-b540-6b5748f73cbe admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:15.329740 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4147e674-a082-442b-b540-6b5748f73cbe admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:15.345639 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6f3b17-f7e6-4cd9-9d44-cf6261ec991a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:15.346759 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6f3b17-f7e6-4cd9-9d44-cf6261ec991a admin admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:15.347787 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6f3b17-f7e6-4cd9-9d44-cf6261ec991a admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:15.348535 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6f3b17-f7e6-4cd9-9d44-cf6261ec991a admin admin] PATH_INFO: `/v3/roles` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:15.351349 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6f3b17-f7e6-4cd9-9d44-cf6261ec991a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:15.353386 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6f3b17-f7e6-4cd9-9d44-cf6261ec991a admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:15.356553 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1047/2071] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:14:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:14:15.363687 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cb2238-c32e-4774-920b-a55c4c67aadc None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:15.375609 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cb2238-c32e-4774-920b-a55c4c67aadc None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:15.379180 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1025/2072] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:14:15 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:14:15.381534 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6f3b17-f7e6-4cd9-9d44-cf6261ec991a admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:15.395605 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609c4d71-00f9-4d6a-a793-0a17c8045a32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:15.395905 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6f3b17-f7e6-4cd9-9d44-cf6261ec991a admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:15.396397 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609c4d71-00f9-4d6a-a793-0a17c8045a32 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:15.396772 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609c4d71-00f9-4d6a-a793-0a17c8045a32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:15.397311 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609c4d71-00f9-4d6a-a793-0a17c8045a32 admin admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:15.398052 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609c4d71-00f9-4d6a-a793-0a17c8045a32 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:14:15.398431 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609c4d71-00f9-4d6a-a793-0a17c8045a32 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:15.400810 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609c4d71-00f9-4d6a-a793-0a17c8045a32 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:15.402644 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe70c99-a39f-458f-b821-498f31556b09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:15.402644 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe70c99-a39f-458f-b821-498f31556b09 admin admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:15.402644 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe70c99-a39f-458f-b821-498f31556b09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:15.402644 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe70c99-a39f-458f-b821-498f31556b09 admin admin] PATH_INFO: `/v3/roles` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:15.403600 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe70c99-a39f-458f-b821-498f31556b09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:15.405424 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe70c99-a39f-458f-b821-498f31556b09 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:15.416304 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1048/2073] 10.222.0.79 () {58 vars in 1153 bytes} [Tue Aug 30 01:14:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:14:15.421717 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1026/2074] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:14:15 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 01:14:15.422962 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609c4d71-00f9-4d6a-a793-0a17c8045a32 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:15.426518 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe70c99-a39f-458f-b821-498f31556b09 admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:15.434332 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609c4d71-00f9-4d6a-a793-0a17c8045a32 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:15.437677 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe70c99-a39f-458f-b821-498f31556b09 admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:15.444357 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d729b8c-d926-4ecb-b5fa-0a1792f9e487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:15.445059 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d729b8c-d926-4ecb-b5fa-0a1792f9e487 admin admin] REQUEST_METHOD: `PUT` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:15.445743 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d729b8c-d926-4ecb-b5fa-0a1792f9e487 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:15.445743 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d729b8c-d926-4ecb-b5fa-0a1792f9e487 admin admin] PATH_INFO: `/v3/projects/5b2bd00730ab43118d77d874c9c131df/users/a9659e2959714d22911379452031d7e6/roles/c37945a17623465f899d4f217e7af593` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:15.445934 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a442ac-4656-47f6-8b49-6e7ee43e94da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:15.446537 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a442ac-4656-47f6-8b49-6e7ee43e94da admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:15.446762 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a442ac-4656-47f6-8b49-6e7ee43e94da admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:15.447085 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a442ac-4656-47f6-8b49-6e7ee43e94da admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:15.447765 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a442ac-4656-47f6-8b49-6e7ee43e94da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:15.449675 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a442ac-4656-47f6-8b49-6e7ee43e94da admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:15.467426 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d729b8c-d926-4ecb-b5fa-0a1792f9e487 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b2bd00730ab43118d77d874c9c131df, user_id=a9659e2959714d22911379452031d7e6, role_id=c37945a17623465f899d4f217e7af593)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:15.470890 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d729b8c-d926-4ecb-b5fa-0a1792f9e487 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:15.492728 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1049/2075] 10.222.0.79 () {60 vars in 1153 bytes} [Tue Aug 30 01:14:15 2022] POST /identity/v3/projects => generated 383 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:14:15.495602 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a442ac-4656-47f6-8b49-6e7ee43e94da admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:15.499300 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1027/2076] 10.222.0.79 () {60 vars in 1483 bytes} [Tue Aug 30 01:14:15 2022] PUT /identity/v3/projects/5b2bd00730ab43118d77d874c9c131df/users/a9659e2959714d22911379452031d7e6/roles/c37945a17623465f899d4f217e7af593 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:14:15.511483 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5748b4a-9d73-4124-97a7-27b932936dbd None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:15.512079 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5748b4a-9d73-4124-97a7-27b932936dbd None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:15.512491 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5748b4a-9d73-4124-97a7-27b932936dbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:15.569529 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-a5748b4a-9d73-4124-97a7-27b932936dbd None None] MFA Rules not processed for user `a9659e2959714d22911379452031d7e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:14:15.572402 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-a5748b4a-9d73-4124-97a7-27b932936dbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:15.586842 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a442ac-4656-47f6-8b49-6e7ee43e94da admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:15.592721 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a5877b-2999-4d75-9a53-18eb18a0e21f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:15.593678 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a5877b-2999-4d75-9a53-18eb18a0e21f admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:15.594108 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a5877b-2999-4d75-9a53-18eb18a0e21f admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:15.594710 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a5877b-2999-4d75-9a53-18eb18a0e21f admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:15.595496 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a5877b-2999-4d75-9a53-18eb18a0e21f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:15.598428 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a5877b-2999-4d75-9a53-18eb18a0e21f admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:15.641691 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1050/2077] 10.222.0.79 () {60 vars in 1144 bytes} [Tue Aug 30 01:14:15 2022] POST /identity/v3/users => generated 292 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:14:15.643395 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a5877b-2999-4d75-9a53-18eb18a0e21f admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:15.655448 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:14:15.656018 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a5877b-2999-4d75-9a53-18eb18a0e21f admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:15.663492 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2ea4b6-984c-4908-a2ab-e6a6b0f6a9fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:15.664225 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2ea4b6-984c-4908-a2ab-e6a6b0f6a9fb admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:15.664513 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2ea4b6-984c-4908-a2ab-e6a6b0f6a9fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:15.664895 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2ea4b6-984c-4908-a2ab-e6a6b0f6a9fb admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:15.665561 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2ea4b6-984c-4908-a2ab-e6a6b0f6a9fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:15.667083 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2ea4b6-984c-4908-a2ab-e6a6b0f6a9fb admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:15.679591 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1051/2078] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:14:15 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 01:14:15.683350 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2ea4b6-984c-4908-a2ab-e6a6b0f6a9fb admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:15.686389 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1028/2079] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:14:15 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:14:15.695990 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2ea4b6-984c-4908-a2ab-e6a6b0f6a9fb admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:15.702515 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a772608b-f3b7-42d7-bd52-b51c31339f50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:15.703343 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a772608b-f3b7-42d7-bd52-b51c31339f50 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:15.703653 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a772608b-f3b7-42d7-bd52-b51c31339f50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:15.706397 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5748b4a-9d73-4124-97a7-27b932936dbd None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:15.707352 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a772608b-f3b7-42d7-bd52-b51c31339f50 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:15.708091 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a772608b-f3b7-42d7-bd52-b51c31339f50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:15.708617 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-a5748b4a-9d73-4124-97a7-27b932936dbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:15.710245 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a772608b-f3b7-42d7-bd52-b51c31339f50 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:15.724297 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1052/2080] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:14:15 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:14:15.728708 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a772608b-f3b7-42d7-bd52-b51c31339f50 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:15.741262 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a772608b-f3b7-42d7-bd52-b51c31339f50 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:15.746507 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f2c6fb-4790-4397-871c-932bf7c73dc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:15.747336 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f2c6fb-4790-4397-871c-932bf7c73dc1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:15.747706 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f2c6fb-4790-4397-871c-932bf7c73dc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:15.747893 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f2c6fb-4790-4397-871c-932bf7c73dc1 admin admin] PATH_INFO: `/v3/projects/be16238e6ac740b99e27230d40de12cf/users/647d376128214cb99a002a7ecce4317c/roles/c37945a17623465f899d4f217e7af593` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:15.767319 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f2c6fb-4790-4397-871c-932bf7c73dc1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be16238e6ac740b99e27230d40de12cf, user_id=647d376128214cb99a002a7ecce4317c, role_id=c37945a17623465f899d4f217e7af593)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:15.772205 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f2c6fb-4790-4397-871c-932bf7c73dc1 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:15.796267 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1053/2081] 10.222.0.79 () {60 vars in 1483 bytes} [Tue Aug 30 01:14:15 2022] PUT /identity/v3/projects/be16238e6ac740b99e27230d40de12cf/users/647d376128214cb99a002a7ecce4317c/roles/c37945a17623465f899d4f217e7af593 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:14:15.811119 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c713ba6-6bfd-482f-a0cf-b64a7064eddb None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:15.811649 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c713ba6-6bfd-482f-a0cf-b64a7064eddb None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:15.812125 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c713ba6-6bfd-482f-a0cf-b64a7064eddb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:15.836694 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5748b4a-9d73-4124-97a7-27b932936dbd None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:15.909514 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28159f3e-1978-4071-940f-e2b250eb3abe service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e37a5c33c064c488fd4667170f7703a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:15.911356 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28159f3e-1978-4071-940f-e2b250eb3abe service glance] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:15.911641 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28159f3e-1978-4071-940f-e2b250eb3abe service glance] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:15.911915 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28159f3e-1978-4071-940f-e2b250eb3abe service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:15.923780 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-1c713ba6-6bfd-482f-a0cf-b64a7064eddb None None] MFA Rules not processed for user `647d376128214cb99a002a7ecce4317c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:14:15.927013 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-1c713ba6-6bfd-482f-a0cf-b64a7064eddb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:15.991365 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:14:16.090205 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28159f3e-1978-4071-940f-e2b250eb3abe service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:16.091635 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28159f3e-1978-4071-940f-e2b250eb3abe service glance] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:16.104409 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1029/2082] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:14:15 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:14:16.123479 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1054/2083] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:14:15 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:14:16.124834 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28159f3e-1978-4071-940f-e2b250eb3abe service glance] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:16.197344 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:14:16.240525 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28159f3e-1978-4071-940f-e2b250eb3abe service glance] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:16.265662 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89180fe0-9af8-454e-85e7-34a311e0e38f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:16.266973 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89180fe0-9af8-454e-85e7-34a311e0e38f admin admin] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:16.267373 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89180fe0-9af8-454e-85e7-34a311e0e38f admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:16.267727 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89180fe0-9af8-454e-85e7-34a311e0e38f admin admin] PATH_INFO: `/v3/projects` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:16.269293 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89180fe0-9af8-454e-85e7-34a311e0e38f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:16.272547 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89180fe0-9af8-454e-85e7-34a311e0e38f admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:16.322793 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1030/2084] 10.222.0.79 () {60 vars in 1153 bytes} [Tue Aug 30 01:14:16 2022] POST /identity/v3/projects => generated 385 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:14:16.323839 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c713ba6-6bfd-482f-a0cf-b64a7064eddb None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:16.335016 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c713ba6-6bfd-482f-a0cf-b64a7064eddb None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:16.414303 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76314a8-cc83-4dd5-b06f-7058d9720e5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:16.415151 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76314a8-cc83-4dd5-b06f-7058d9720e5b admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:16.415545 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76314a8-cc83-4dd5-b06f-7058d9720e5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:16.415930 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76314a8-cc83-4dd5-b06f-7058d9720e5b admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:16.416767 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76314a8-cc83-4dd5-b06f-7058d9720e5b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:16.418886 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76314a8-cc83-4dd5-b06f-7058d9720e5b admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:16.474086 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1055/2085] 10.222.0.79 () {60 vars in 1144 bytes} [Tue Aug 30 01:14:16 2022] POST /identity/v3/users => generated 293 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:14:16.478730 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89180fe0-9af8-454e-85e7-34a311e0e38f admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:16.493155 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89180fe0-9af8-454e-85e7-34a311e0e38f admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:16.505292 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15287d5f-95a8-4499-8ea7-38faa08e41d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:16.505763 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15287d5f-95a8-4499-8ea7-38faa08e41d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:16.506048 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15287d5f-95a8-4499-8ea7-38faa08e41d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:16.506314 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15287d5f-95a8-4499-8ea7-38faa08e41d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:16.506959 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15287d5f-95a8-4499-8ea7-38faa08e41d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:16.508698 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15287d5f-95a8-4499-8ea7-38faa08e41d7 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:16.537678 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1031/2086] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:14:16 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:14:16.543540 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76314a8-cc83-4dd5-b06f-7058d9720e5b admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:16.556335 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76314a8-cc83-4dd5-b06f-7058d9720e5b admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:16.570244 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84695b9f-7c1f-4aa1-97b1-52dc6b9a64f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:16.570949 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84695b9f-7c1f-4aa1-97b1-52dc6b9a64f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:16.571402 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84695b9f-7c1f-4aa1-97b1-52dc6b9a64f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:16.571739 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84695b9f-7c1f-4aa1-97b1-52dc6b9a64f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:16.572490 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84695b9f-7c1f-4aa1-97b1-52dc6b9a64f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:16.574346 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84695b9f-7c1f-4aa1-97b1-52dc6b9a64f9 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:16.602502 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1056/2087] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:14:16 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:14:16.609385 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15287d5f-95a8-4499-8ea7-38faa08e41d7 admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:16.625765 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15287d5f-95a8-4499-8ea7-38faa08e41d7 admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:16.637763 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f341148a-aa20-4f52-a8ce-84721d3f6811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:16.644920 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f341148a-aa20-4f52-a8ce-84721d3f6811 admin admin] REQUEST_METHOD: `PUT` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:16.645389 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f341148a-aa20-4f52-a8ce-84721d3f6811 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:16.645762 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f341148a-aa20-4f52-a8ce-84721d3f6811 admin admin] PATH_INFO: `/v3/projects/8b00f3cf21d14ac09896e0599e9c4f5e/users/693eb5c6758d4e31ace9daecb1e3130b/roles/c37945a17623465f899d4f217e7af593` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:16.668380 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f341148a-aa20-4f52-a8ce-84721d3f6811 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b00f3cf21d14ac09896e0599e9c4f5e, user_id=693eb5c6758d4e31ace9daecb1e3130b, role_id=c37945a17623465f899d4f217e7af593)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:16.674130 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f341148a-aa20-4f52-a8ce-84721d3f6811 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:16.707418 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1032/2088] 10.222.0.79 () {60 vars in 1483 bytes} [Tue Aug 30 01:14:16 2022] PUT /identity/v3/projects/8b00f3cf21d14ac09896e0599e9c4f5e/users/693eb5c6758d4e31ace9daecb1e3130b/roles/c37945a17623465f899d4f217e7af593 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:14:16.717946 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5411b454-3c8f-4a9c-9682-c05806975b42 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:16.718244 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5411b454-3c8f-4a9c-9682-c05806975b42 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:16.718563 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5411b454-3c8f-4a9c-9682-c05806975b42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:16.762901 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-5411b454-3c8f-4a9c-9682-c05806975b42 None None] MFA Rules not processed for user `693eb5c6758d4e31ace9daecb1e3130b`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:14:16.765024 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-5411b454-3c8f-4a9c-9682-c05806975b42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:16.926156 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1057/2089] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:14:16 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:14:16.937117 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f341148a-aa20-4f52-a8ce-84721d3f6811 admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:17.030729 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f341148a-aa20-4f52-a8ce-84721d3f6811 admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:17.037394 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f77b963-f799-4a96-8fe6-323ee037cc49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:17.038514 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f77b963-f799-4a96-8fe6-323ee037cc49 admin admin] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:17.038514 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f77b963-f799-4a96-8fe6-323ee037cc49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:17.038845 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f77b963-f799-4a96-8fe6-323ee037cc49 admin admin] PATH_INFO: `/v3/projects` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:17.039451 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f77b963-f799-4a96-8fe6-323ee037cc49 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:17.044888 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f77b963-f799-4a96-8fe6-323ee037cc49 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:17.115461 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1033/2090] 10.222.0.79 () {60 vars in 1153 bytes} [Tue Aug 30 01:14:16 2022] POST /identity/v3/projects => generated 385 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:14:17.120895 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f77b963-f799-4a96-8fe6-323ee037cc49 admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:17.121097 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5411b454-3c8f-4a9c-9682-c05806975b42 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:17.123390 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-5411b454-3c8f-4a9c-9682-c05806975b42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:17.145717 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5411b454-3c8f-4a9c-9682-c05806975b42 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:17.196317 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:14:17.252039 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f77b963-f799-4a96-8fe6-323ee037cc49 admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:17.257756 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6d5761-2345-4a9c-a884-3c8a49bf7d21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:17.258459 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6d5761-2345-4a9c-a884-3c8a49bf7d21 admin admin] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:17.258665 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6d5761-2345-4a9c-a884-3c8a49bf7d21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:17.258937 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6d5761-2345-4a9c-a884-3c8a49bf7d21 admin admin] PATH_INFO: `/v3/users` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:17.260928 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6d5761-2345-4a9c-a884-3c8a49bf7d21 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:17.262938 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6d5761-2345-4a9c-a884-3c8a49bf7d21 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:17.294352 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478f292d-f735-4a77-b3f8-1741aef321c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:17.295096 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478f292d-f735-4a77-b3f8-1741aef321c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:17.295469 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478f292d-f735-4a77-b3f8-1741aef321c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:17.295736 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478f292d-f735-4a77-b3f8-1741aef321c6 admin admin] PATH_INFO: `/v3/users/da6b457dee654a73acee1dbb6387c4fc` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:17.297551 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478f292d-f735-4a77-b3f8-1741aef321c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=da6b457dee654a73acee1dbb6387c4fc)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:17.300451 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478f292d-f735-4a77-b3f8-1741aef321c6 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:17.301648 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1034/2091] 10.222.0.79 () {60 vars in 1144 bytes} [Tue Aug 30 01:14:17 2022] POST /identity/v3/users => generated 299 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:14:17.305981 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6d5761-2345-4a9c-a884-3c8a49bf7d21 admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:17.322503 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6d5761-2345-4a9c-a884-3c8a49bf7d21 admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:17.329948 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a841b84-19fe-4b72-bb51-3e1f46cae233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:17.330253 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a841b84-19fe-4b72-bb51-3e1f46cae233 admin admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:17.330769 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a841b84-19fe-4b72-bb51-3e1f46cae233 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:17.330937 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a841b84-19fe-4b72-bb51-3e1f46cae233 admin admin] PATH_INFO: `/v3/roles` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:17.331768 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a841b84-19fe-4b72-bb51-3e1f46cae233 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:17.333560 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a841b84-19fe-4b72-bb51-3e1f46cae233 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:17.336494 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:14:17.350369 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1035/2092] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:14:17 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:14:17.354696 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a841b84-19fe-4b72-bb51-3e1f46cae233 admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:17.367660 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a841b84-19fe-4b72-bb51-3e1f46cae233 admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:17.374913 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-478f292d-f735-4a77-b3f8-1741aef321c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da6b457dee654a73acee1dbb6387c4fc'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:17.377176 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f043e15-b0f7-49d4-9e4d-9f2e9d3527f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:17.378015 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f043e15-b0f7-49d4-9e4d-9f2e9d3527f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:17.378292 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f043e15-b0f7-49d4-9e4d-9f2e9d3527f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:17.378556 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f043e15-b0f7-49d4-9e4d-9f2e9d3527f1 admin admin] PATH_INFO: `/v3/projects/0f7c23be01d34ac9a55e7e443051f1e3/users/b735aab34ab84d6f9a929d23d9ae2cac/roles/d14c3070c9184d76a7b23df69bd3db07` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:17.385877 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-478f292d-f735-4a77-b3f8-1741aef321c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da6b457dee654a73acee1dbb6387c4fc'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:17.398159 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f043e15-b0f7-49d4-9e4d-9f2e9d3527f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f7c23be01d34ac9a55e7e443051f1e3, user_id=b735aab34ab84d6f9a929d23d9ae2cac, role_id=d14c3070c9184d76a7b23df69bd3db07)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:17.400460 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-478f292d-f735-4a77-b3f8-1741aef321c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da6b457dee654a73acee1dbb6387c4fc'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:17.401093 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f043e15-b0f7-49d4-9e4d-9f2e9d3527f1 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:17.401526 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-478f292d-f735-4a77-b3f8-1741aef321c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da6b457dee654a73acee1dbb6387c4fc'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:17.421272 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-478f292d-f735-4a77-b3f8-1741aef321c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da6b457dee654a73acee1dbb6387c4fc'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:17.425360 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1036/2093] 10.222.0.79 () {60 vars in 1483 bytes} [Tue Aug 30 01:14:17 2022] PUT /identity/v3/projects/0f7c23be01d34ac9a55e7e443051f1e3/users/b735aab34ab84d6f9a929d23d9ae2cac/roles/d14c3070c9184d76a7b23df69bd3db07 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:14:17.428775 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f043e15-b0f7-49d4-9e4d-9f2e9d3527f1 admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:17.430421 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-4f043e15-b0f7-49d4-9e4d-9f2e9d3527f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:17.434122 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1058/2094] 10.222.0.79 () {58 vars in 1224 bytes} [Tue Aug 30 01:14:17 2022] DELETE /identity/v3/users/da6b457dee654a73acee1dbb6387c4fc => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:14:17.438614 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deefbfd-52b6-4700-aa2c-520a51e7e94d None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:17.439054 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deefbfd-52b6-4700-aa2c-520a51e7e94d None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:17.439485 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deefbfd-52b6-4700-aa2c-520a51e7e94d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:17.473842 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-8deefbfd-52b6-4700-aa2c-520a51e7e94d None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:14:17.479849 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-8deefbfd-52b6-4700-aa2c-520a51e7e94d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:17.557680 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f043e15-b0f7-49d4-9e4d-9f2e9d3527f1 admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:17.594677 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1059/2095] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:14:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:14:17.606873 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8deefbfd-52b6-4700-aa2c-520a51e7e94d None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:17.610305 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-8deefbfd-52b6-4700-aa2c-520a51e7e94d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:17.652891 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2855e2-9c40-4c15-885f-c16b3cab4d03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:17.654002 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2855e2-9c40-4c15-885f-c16b3cab4d03 admin admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:17.654342 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2855e2-9c40-4c15-885f-c16b3cab4d03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:17.654623 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2855e2-9c40-4c15-885f-c16b3cab4d03 admin admin] PATH_INFO: `/v3/roles` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:17.655907 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2855e2-9c40-4c15-885f-c16b3cab4d03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:17.657702 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2855e2-9c40-4c15-885f-c16b3cab4d03 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:17.670248 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1037/2096] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:14:17 2022] GET /identity/v3/roles => generated 1420 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 01:14:17.674168 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2855e2-9c40-4c15-885f-c16b3cab4d03 admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:17.684765 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:14:17.687530 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2855e2-9c40-4c15-885f-c16b3cab4d03 admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:17.694890 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5367f1-e291-4125-832a-462c321b4221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:17.695856 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5367f1-e291-4125-832a-462c321b4221 admin admin] REQUEST_METHOD: `PUT` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:17.696204 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5367f1-e291-4125-832a-462c321b4221 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:17.696538 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5367f1-e291-4125-832a-462c321b4221 admin admin] PATH_INFO: `/v3/projects/0f7c23be01d34ac9a55e7e443051f1e3/users/b735aab34ab84d6f9a929d23d9ae2cac/roles/d14c3070c9184d76a7b23df69bd3db07` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:17.697465 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8deefbfd-52b6-4700-aa2c-520a51e7e94d None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:17.698729 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5367f1-e291-4125-832a-462c321b4221 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f7c23be01d34ac9a55e7e443051f1e3, user_id=b735aab34ab84d6f9a929d23d9ae2cac, role_id=d14c3070c9184d76a7b23df69bd3db07)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:17.705688 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5367f1-e291-4125-832a-462c321b4221 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:17.712728 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0a81c4-4a11-413b-b5fb-1a8e379c9ba3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16e6a0ca26fc4ef892c188ad89a1e132', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:17.713680 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0a81c4-4a11-413b-b5fb-1a8e379c9ba3 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:17.714310 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0a81c4-4a11-413b-b5fb-1a8e379c9ba3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:17.714783 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0a81c4-4a11-413b-b5fb-1a8e379c9ba3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:17.719050 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1038/2097] 10.222.0.79 () {60 vars in 1483 bytes} [Tue Aug 30 01:14:17 2022] PUT /identity/v3/projects/0f7c23be01d34ac9a55e7e443051f1e3/users/b735aab34ab84d6f9a929d23d9ae2cac/roles/d14c3070c9184d76a7b23df69bd3db07 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:14:17.732427 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0e19ad-250b-4edc-bc55-d196fb7aafe2 None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:17.732717 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0e19ad-250b-4edc-bc55-d196fb7aafe2 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:17.733068 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0e19ad-250b-4edc-bc55-d196fb7aafe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:17.738585 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0a81c4-4a11-413b-b5fb-1a8e379c9ba3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:17.740404 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0a81c4-4a11-413b-b5fb-1a8e379c9ba3 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:17.754860 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1060/2098] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:14:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:14:17.801760 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-fa0e19ad-250b-4edc-bc55-d196fb7aafe2 None None] MFA Rules not processed for user `b735aab34ab84d6f9a929d23d9ae2cac`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:14:17.803011 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-fa0e19ad-250b-4edc-bc55-d196fb7aafe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:17.944359 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:14:18.001479 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1039/2099] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:14:17 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:14:18.064163 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0a81c4-4a11-413b-b5fb-1a8e379c9ba3 service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:18.066745 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-af0a81c4-4a11-413b-b5fb-1a8e379c9ba3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:18.185788 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0a81c4-4a11-413b-b5fb-1a8e379c9ba3 service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:18.284528 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bda397e-e8b1-45fa-8160-52b97697e4c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f827c7670b74d938ffe066ced88d1c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:18.285230 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bda397e-e8b1-45fa-8160-52b97697e4c1 service cinder] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:18.286099 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bda397e-e8b1-45fa-8160-52b97697e4c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:18.286099 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bda397e-e8b1-45fa-8160-52b97697e4c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:18.291632 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-4bda397e-e8b1-45fa-8160-52b97697e4c1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:18.344216 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0e19ad-250b-4edc-bc55-d196fb7aafe2 None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:18.345572 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-fa0e19ad-250b-4edc-bc55-d196fb7aafe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:18.419759 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bda397e-e8b1-45fa-8160-52b97697e4c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:18.423312 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bda397e-e8b1-45fa-8160-52b97697e4c1 service cinder] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:18.445832 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1061/2100] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:14:18 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:14:18.467771 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0e19ad-250b-4edc-bc55-d196fb7aafe2 None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:18.474384 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b32a7d-28ab-46f7-84db-7c8cd4bf7f38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:18.475590 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b32a7d-28ab-46f7-84db-7c8cd4bf7f38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:18.475938 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b32a7d-28ab-46f7-84db-7c8cd4bf7f38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:18.479355 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b32a7d-28ab-46f7-84db-7c8cd4bf7f38 admin admin] PATH_INFO: `/v3/projects/28c4c2267da24caaab3df2facba6e3ec` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:18.481243 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b32a7d-28ab-46f7-84db-7c8cd4bf7f38 admin admin] RBAC: Authorizing `identity:delete_project(project_id=28c4c2267da24caaab3df2facba6e3ec)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:18.483332 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b32a7d-28ab-46f7-84db-7c8cd4bf7f38 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:18.574909 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-08b32a7d-28ab-46f7-84db-7c8cd4bf7f38 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28c4c2267da24caaab3df2facba6e3ec', 'request_id': 'req-08b32a7d-28ab-46f7-84db-7c8cd4bf7f38'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:18.593673 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-08b32a7d-28ab-46f7-84db-7c8cd4bf7f38 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28c4c2267da24caaab3df2facba6e3ec', 'request_id': 'req-08b32a7d-28ab-46f7-84db-7c8cd4bf7f38'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:18.606725 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-08b32a7d-28ab-46f7-84db-7c8cd4bf7f38 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28c4c2267da24caaab3df2facba6e3ec', 'request_id': 'req-08b32a7d-28ab-46f7-84db-7c8cd4bf7f38'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:18.627623 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-08b32a7d-28ab-46f7-84db-7c8cd4bf7f38 admin admin] The token cache is being invalidate because project 28c4c2267da24caaab3df2facba6e3ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81998) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:14:18.627919 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-08b32a7d-28ab-46f7-84db-7c8cd4bf7f38 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:18.628602 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-08b32a7d-28ab-46f7-84db-7c8cd4bf7f38 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:18.634868 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1040/2101] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 30 01:14:18 2022] DELETE /identity/v3/projects/28c4c2267da24caaab3df2facba6e3ec => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:14:18.637337 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040f676f-55af-4ca4-9f84-ce8effdaf330 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:18.638162 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040f676f-55af-4ca4-9f84-ce8effdaf330 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:18.638638 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040f676f-55af-4ca4-9f84-ce8effdaf330 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:18.694093 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-040f676f-55af-4ca4-9f84-ce8effdaf330 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:14:18.698498 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-040f676f-55af-4ca4-9f84-ce8effdaf330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:18.905986 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1062/2102] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:14:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:14:18.907180 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfbb247-c37b-4165-9963-90f22f1e4238 None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:18.907677 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfbb247-c37b-4165-9963-90f22f1e4238 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:18.907764 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfbb247-c37b-4165-9963-90f22f1e4238 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:18.948067 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-5cfbb247-c37b-4165-9963-90f22f1e4238 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:14:18.949300 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-5cfbb247-c37b-4165-9963-90f22f1e4238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:18.971007 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1041/2103] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:14:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:14:18.976260 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040f676f-55af-4ca4-9f84-ce8effdaf330 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:18.985692 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:14:19.003816 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040f676f-55af-4ca4-9f84-ce8effdaf330 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:19.011113 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d4e746-cc44-46e0-ac0c-83dc86fbb4d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:19.012148 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d4e746-cc44-46e0-ac0c-83dc86fbb4d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:19.012384 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d4e746-cc44-46e0-ac0c-83dc86fbb4d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:19.013508 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d4e746-cc44-46e0-ac0c-83dc86fbb4d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:19.013508 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d4e746-cc44-46e0-ac0c-83dc86fbb4d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:14:19.013727 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d4e746-cc44-46e0-ac0c-83dc86fbb4d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:19.019993 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d4e746-cc44-46e0-ac0c-83dc86fbb4d5 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:19.056472 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1063/2104] 10.222.0.79 () {58 vars in 1153 bytes} [Tue Aug 30 01:14:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:14:19.058065 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfbb247-c37b-4165-9963-90f22f1e4238 None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:19.073841 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfbb247-c37b-4165-9963-90f22f1e4238 None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:19.081427 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270e9dd5-a448-46df-a799-99be4423dedd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:19.089287 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270e9dd5-a448-46df-a799-99be4423dedd admin admin] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:19.089287 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270e9dd5-a448-46df-a799-99be4423dedd admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:19.089559 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270e9dd5-a448-46df-a799-99be4423dedd admin admin] PATH_INFO: `/v3/projects` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:19.090386 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270e9dd5-a448-46df-a799-99be4423dedd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:19.093479 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270e9dd5-a448-46df-a799-99be4423dedd admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:19.164292 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1042/2105] 10.222.0.79 () {60 vars in 1153 bytes} [Tue Aug 30 01:14:19 2022] POST /identity/v3/projects => generated 383 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:14:19.169587 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d4e746-cc44-46e0-ac0c-83dc86fbb4d5 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:19.183974 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d4e746-cc44-46e0-ac0c-83dc86fbb4d5 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:19.260497 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3118f02e-d35d-4cba-9e73-4debfa351cd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:19.261216 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3118f02e-d35d-4cba-9e73-4debfa351cd4 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:19.261496 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3118f02e-d35d-4cba-9e73-4debfa351cd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:19.261763 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3118f02e-d35d-4cba-9e73-4debfa351cd4 admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:19.262472 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3118f02e-d35d-4cba-9e73-4debfa351cd4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:19.265108 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3118f02e-d35d-4cba-9e73-4debfa351cd4 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:19.292982 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1064/2106] 10.222.0.79 () {60 vars in 1144 bytes} [Tue Aug 30 01:14:19 2022] POST /identity/v3/users => generated 292 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:14:19.297662 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270e9dd5-a448-46df-a799-99be4423dedd admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:19.317391 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270e9dd5-a448-46df-a799-99be4423dedd admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:19.323065 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634fffb6-95f5-4d50-b23c-5ff7f38c04f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:19.324263 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634fffb6-95f5-4d50-b23c-5ff7f38c04f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:19.324930 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634fffb6-95f5-4d50-b23c-5ff7f38c04f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:19.324930 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634fffb6-95f5-4d50-b23c-5ff7f38c04f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:19.325502 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634fffb6-95f5-4d50-b23c-5ff7f38c04f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:19.327229 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634fffb6-95f5-4d50-b23c-5ff7f38c04f3 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:19.341067 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1043/2107] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:14:19 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:14:19.344668 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3118f02e-d35d-4cba-9e73-4debfa351cd4 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:19.356222 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3118f02e-d35d-4cba-9e73-4debfa351cd4 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:19.361433 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cd58c6-e0f3-49c8-aecd-45406e7bda86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:19.361911 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cd58c6-e0f3-49c8-aecd-45406e7bda86 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:19.362330 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cd58c6-e0f3-49c8-aecd-45406e7bda86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:19.362640 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cd58c6-e0f3-49c8-aecd-45406e7bda86 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:19.363327 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cd58c6-e0f3-49c8-aecd-45406e7bda86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:19.365025 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cd58c6-e0f3-49c8-aecd-45406e7bda86 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:19.381094 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1065/2108] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:14:19 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 01:14:19.382078 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634fffb6-95f5-4d50-b23c-5ff7f38c04f3 admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:19.392855 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634fffb6-95f5-4d50-b23c-5ff7f38c04f3 admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:19.399183 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18553198-c93d-4acb-b2d1-f126f6a8aa8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:19.400153 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18553198-c93d-4acb-b2d1-f126f6a8aa8d admin admin] REQUEST_METHOD: `PUT` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:19.400293 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18553198-c93d-4acb-b2d1-f126f6a8aa8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:19.400528 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18553198-c93d-4acb-b2d1-f126f6a8aa8d admin admin] PATH_INFO: `/v3/projects/d0496703c1b04f2393bad32f8f36786d/users/ae567fa8585940bf98167103a86734de/roles/c37945a17623465f899d4f217e7af593` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:19.421682 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18553198-c93d-4acb-b2d1-f126f6a8aa8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0496703c1b04f2393bad32f8f36786d, user_id=ae567fa8585940bf98167103a86734de, role_id=c37945a17623465f899d4f217e7af593)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:19.425121 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18553198-c93d-4acb-b2d1-f126f6a8aa8d admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:19.441963 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1044/2109] 10.222.0.79 () {60 vars in 1483 bytes} [Tue Aug 30 01:14:19 2022] PUT /identity/v3/projects/d0496703c1b04f2393bad32f8f36786d/users/ae567fa8585940bf98167103a86734de/roles/c37945a17623465f899d4f217e7af593 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:14:19.448043 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468a0de8-17df-42f5-83d0-94db65a6689b None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:19.448470 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468a0de8-17df-42f5-83d0-94db65a6689b None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:19.448588 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468a0de8-17df-42f5-83d0-94db65a6689b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:19.473412 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-468a0de8-17df-42f5-83d0-94db65a6689b None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:14:19.474804 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-468a0de8-17df-42f5-83d0-94db65a6689b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:19.577050 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1066/2110] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:14:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:14:19.590251 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18553198-c93d-4acb-b2d1-f126f6a8aa8d admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:19.594743 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-18553198-c93d-4acb-b2d1-f126f6a8aa8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:19.627766 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:14:19.709751 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18553198-c93d-4acb-b2d1-f126f6a8aa8d admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:19.715264 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25854134-7aaa-447c-96ad-eed3559a21aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16e6a0ca26fc4ef892c188ad89a1e132', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:19.716144 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25854134-7aaa-447c-96ad-eed3559a21aa service neutron] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:19.716495 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25854134-7aaa-447c-96ad-eed3559a21aa service neutron] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:19.716879 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25854134-7aaa-447c-96ad-eed3559a21aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:19.734082 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25854134-7aaa-447c-96ad-eed3559a21aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:19.735689 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25854134-7aaa-447c-96ad-eed3559a21aa service neutron] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:19.754395 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1045/2111] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:14:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:14:20.554531 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468a0de8-17df-42f5-83d0-94db65a6689b None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:20.556856 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-468a0de8-17df-42f5-83d0-94db65a6689b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:20.676684 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468a0de8-17df-42f5-83d0-94db65a6689b None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:20.682662 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d9423e-7d8a-45fd-961e-ef2f2ac9cae3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f827c7670b74d938ffe066ced88d1c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:20.683524 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d9423e-7d8a-45fd-961e-ef2f2ac9cae3 service cinder] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:20.683908 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d9423e-7d8a-45fd-961e-ef2f2ac9cae3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:20.684814 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d9423e-7d8a-45fd-961e-ef2f2ac9cae3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:20.686995 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-33d9423e-7d8a-45fd-961e-ef2f2ac9cae3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:20.722014 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:14:20.815693 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d9423e-7d8a-45fd-961e-ef2f2ac9cae3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:20.819226 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d9423e-7d8a-45fd-961e-ef2f2ac9cae3 service cinder] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:20.853587 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25854134-7aaa-447c-96ad-eed3559a21aa service neutron] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:20.855047 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-25854134-7aaa-447c-96ad-eed3559a21aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:20.858160 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1067/2112] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:14:20 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:14:20.874842 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25854134-7aaa-447c-96ad-eed3559a21aa service neutron] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:20.895993 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba66851-7ce5-41ef-8182-3d8a3fc2306e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:20.896806 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba66851-7ce5-41ef-8182-3d8a3fc2306e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:20.897281 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba66851-7ce5-41ef-8182-3d8a3fc2306e admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:20.897703 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba66851-7ce5-41ef-8182-3d8a3fc2306e admin admin] PATH_INFO: `/v3/users/a0df638c2e6e45e98089d30804782fc4` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:20.899441 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba66851-7ce5-41ef-8182-3d8a3fc2306e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0df638c2e6e45e98089d30804782fc4)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:20.901563 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba66851-7ce5-41ef-8182-3d8a3fc2306e admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:20.998595 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-bba66851-7ce5-41ef-8182-3d8a3fc2306e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0df638c2e6e45e98089d30804782fc4'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:21.022397 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-bba66851-7ce5-41ef-8182-3d8a3fc2306e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0df638c2e6e45e98089d30804782fc4'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:21.055872 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-bba66851-7ce5-41ef-8182-3d8a3fc2306e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0df638c2e6e45e98089d30804782fc4'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:21.063171 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-bba66851-7ce5-41ef-8182-3d8a3fc2306e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0df638c2e6e45e98089d30804782fc4'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:21.093195 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-bba66851-7ce5-41ef-8182-3d8a3fc2306e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0df638c2e6e45e98089d30804782fc4'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:21.110466 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1046/2113] 10.222.0.79 () {58 vars in 1224 bytes} [Tue Aug 30 01:14:20 2022] DELETE /identity/v3/users/a0df638c2e6e45e98089d30804782fc4 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:14:21.114774 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3be18af-4e5a-49f4-8fce-27308798d8d8 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:21.115411 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3be18af-4e5a-49f4-8fce-27308798d8d8 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:21.115934 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3be18af-4e5a-49f4-8fce-27308798d8d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:21.156323 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-f3be18af-4e5a-49f4-8fce-27308798d8d8 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:14:21.157587 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-f3be18af-4e5a-49f4-8fce-27308798d8d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:21.335413 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1068/2114] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:14:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:14:21.367284 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba66851-7ce5-41ef-8182-3d8a3fc2306e admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:21.377193 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-bba66851-7ce5-41ef-8182-3d8a3fc2306e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:21.474151 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5b3fb3-78ae-46cd-a406-c3d57683afea None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:21.474437 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5b3fb3-78ae-46cd-a406-c3d57683afea None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:21.475287 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5b3fb3-78ae-46cd-a406-c3d57683afea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:21.516674 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-2b5b3fb3-78ae-46cd-a406-c3d57683afea None None] MFA Rules not processed for user `d8445faa3bd6407986d739614cdd3a67`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:14:21.518733 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-2b5b3fb3-78ae-46cd-a406-c3d57683afea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:21.538618 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba66851-7ce5-41ef-8182-3d8a3fc2306e admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:21.546706 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23d31eb-e4de-4912-ba6d-4d95618b85ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16e6a0ca26fc4ef892c188ad89a1e132', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:21.547718 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23d31eb-e4de-4912-ba6d-4d95618b85ec service neutron] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:21.566083 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23d31eb-e4de-4912-ba6d-4d95618b85ec service neutron] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:21.567641 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23d31eb-e4de-4912-ba6d-4d95618b85ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:21.588532 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23d31eb-e4de-4912-ba6d-4d95618b85ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:21.590621 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23d31eb-e4de-4912-ba6d-4d95618b85ec service neutron] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:21.615295 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1047/2115] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:14:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:14:21.676384 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1069/2116] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:14:21 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:14:21.699076 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23d31eb-e4de-4912-ba6d-4d95618b85ec service neutron] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:21.700963 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-c23d31eb-e4de-4912-ba6d-4d95618b85ec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:21.787989 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:14:21.882373 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5b3fb3-78ae-46cd-a406-c3d57683afea None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:21.884254 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-2b5b3fb3-78ae-46cd-a406-c3d57683afea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:21.894082 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23d31eb-e4de-4912-ba6d-4d95618b85ec service neutron] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:21.918182 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ff975c-4f84-49d9-9300-bcac63c025af service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6480b2f14c37474c89df9fba48f7cd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:21.919113 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ff975c-4f84-49d9-9300-bcac63c025af service nova] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:21.921125 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ff975c-4f84-49d9-9300-bcac63c025af service nova] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:21.921786 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ff975c-4f84-49d9-9300-bcac63c025af service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:21.937608 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ff975c-4f84-49d9-9300-bcac63c025af service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:21.940694 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ff975c-4f84-49d9-9300-bcac63c025af service nova] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:21.957326 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1048/2117] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:14:21 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:14:22.044292 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5b3fb3-78ae-46cd-a406-c3d57683afea None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:22.063536 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c66cc1-cba5-48e2-8b0e-05f6d9dcd01a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f827c7670b74d938ffe066ced88d1c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:22.066822 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c66cc1-cba5-48e2-8b0e-05f6d9dcd01a service cinder] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:22.067689 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c66cc1-cba5-48e2-8b0e-05f6d9dcd01a service cinder] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:22.069343 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c66cc1-cba5-48e2-8b0e-05f6d9dcd01a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:22.076743 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-f7c66cc1-cba5-48e2-8b0e-05f6d9dcd01a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:22.096540 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:14:22.197191 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c66cc1-cba5-48e2-8b0e-05f6d9dcd01a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:22.199471 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c66cc1-cba5-48e2-8b0e-05f6d9dcd01a service cinder] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:22.225807 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1070/2118] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:14:21 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 01:14:22.458576 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ff975c-4f84-49d9-9300-bcac63c025af service nova] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:22.460390 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-95ff975c-4f84-49d9-9300-bcac63c025af service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:22.488738 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ff975c-4f84-49d9-9300-bcac63c025af service nova] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:22.494766 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5818229e-9895-4b49-851b-3d68352d3e46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:22.495450 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5818229e-9895-4b49-851b-3d68352d3e46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:22.495746 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5818229e-9895-4b49-851b-3d68352d3e46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:22.496019 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5818229e-9895-4b49-851b-3d68352d3e46 admin admin] PATH_INFO: `/v3/projects/b9c96846e4374ac3910f5bcfdc518b70` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:22.498884 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5818229e-9895-4b49-851b-3d68352d3e46 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9c96846e4374ac3910f5bcfdc518b70)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:22.500614 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5818229e-9895-4b49-851b-3d68352d3e46 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:22.588306 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-5818229e-9895-4b49-851b-3d68352d3e46 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9c96846e4374ac3910f5bcfdc518b70', 'request_id': 'req-5818229e-9895-4b49-851b-3d68352d3e46'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:22.611678 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-5818229e-9895-4b49-851b-3d68352d3e46 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9c96846e4374ac3910f5bcfdc518b70', 'request_id': 'req-5818229e-9895-4b49-851b-3d68352d3e46'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:22.631546 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-5818229e-9895-4b49-851b-3d68352d3e46 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9c96846e4374ac3910f5bcfdc518b70', 'request_id': 'req-5818229e-9895-4b49-851b-3d68352d3e46'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:22.649420 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-5818229e-9895-4b49-851b-3d68352d3e46 admin admin] The token cache is being invalidate because project b9c96846e4374ac3910f5bcfdc518b70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81998) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:14:22.649996 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-5818229e-9895-4b49-851b-3d68352d3e46 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:22.650991 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-5818229e-9895-4b49-851b-3d68352d3e46 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:22.653208 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1049/2119] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 30 01:14:22 2022] DELETE /identity/v3/projects/b9c96846e4374ac3910f5bcfdc518b70 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:14:22.658253 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c66cc1-cba5-48e2-8b0e-05f6d9dcd01a service cinder] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:22.678673 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c66cc1-cba5-48e2-8b0e-05f6d9dcd01a service cinder] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:22.781900 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9daac36-8490-4126-b8ae-c6cc6eab9c24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:22.782601 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9daac36-8490-4126-b8ae-c6cc6eab9c24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:22.784203 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9daac36-8490-4126-b8ae-c6cc6eab9c24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:22.784203 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9daac36-8490-4126-b8ae-c6cc6eab9c24 admin admin] PATH_INFO: `/v3/users/25e0208c2a0b4a1c93486717ab00b651` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:22.785494 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9daac36-8490-4126-b8ae-c6cc6eab9c24 admin admin] RBAC: Authorizing `identity:delete_user(user_id=25e0208c2a0b4a1c93486717ab00b651)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:22.788291 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9daac36-8490-4126-b8ae-c6cc6eab9c24 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:22.902799 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-c9daac36-8490-4126-b8ae-c6cc6eab9c24 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25e0208c2a0b4a1c93486717ab00b651'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:22.917659 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-c9daac36-8490-4126-b8ae-c6cc6eab9c24 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25e0208c2a0b4a1c93486717ab00b651'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:22.936486 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-c9daac36-8490-4126-b8ae-c6cc6eab9c24 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25e0208c2a0b4a1c93486717ab00b651'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:22.938283 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-c9daac36-8490-4126-b8ae-c6cc6eab9c24 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25e0208c2a0b4a1c93486717ab00b651'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:22.972690 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-c9daac36-8490-4126-b8ae-c6cc6eab9c24 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25e0208c2a0b4a1c93486717ab00b651'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:23.002169 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1071/2120] 10.222.0.79 () {58 vars in 1224 bytes} [Tue Aug 30 01:14:22 2022] DELETE /identity/v3/users/25e0208c2a0b4a1c93486717ab00b651 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:14:23.884694 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5818229e-9895-4b49-851b-3d68352d3e46 admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:23.887168 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-5818229e-9895-4b49-851b-3d68352d3e46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:23.974515 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5818229e-9895-4b49-851b-3d68352d3e46 admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:24.157516 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1c245e-50e1-4e82-b5db-bdfeefe4ac41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:24.158220 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1c245e-50e1-4e82-b5db-bdfeefe4ac41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:24.159305 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1c245e-50e1-4e82-b5db-bdfeefe4ac41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:24.159638 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1c245e-50e1-4e82-b5db-bdfeefe4ac41 admin admin] PATH_INFO: `/v3/projects/c1d25c38c8554661ab91b8e3399c21bf` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:24.160969 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1c245e-50e1-4e82-b5db-bdfeefe4ac41 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1d25c38c8554661ab91b8e3399c21bf)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:24.163236 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1c245e-50e1-4e82-b5db-bdfeefe4ac41 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:24.242364 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:14:24.250617 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-7b1c245e-50e1-4e82-b5db-bdfeefe4ac41 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1d25c38c8554661ab91b8e3399c21bf', 'request_id': 'req-7b1c245e-50e1-4e82-b5db-bdfeefe4ac41'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:24.264472 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-7b1c245e-50e1-4e82-b5db-bdfeefe4ac41 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1d25c38c8554661ab91b8e3399c21bf', 'request_id': 'req-7b1c245e-50e1-4e82-b5db-bdfeefe4ac41'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:24.281048 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-7b1c245e-50e1-4e82-b5db-bdfeefe4ac41 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1d25c38c8554661ab91b8e3399c21bf', 'request_id': 'req-7b1c245e-50e1-4e82-b5db-bdfeefe4ac41'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:24.302859 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-7b1c245e-50e1-4e82-b5db-bdfeefe4ac41 admin admin] The token cache is being invalidate because project c1d25c38c8554661ab91b8e3399c21bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81998) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:14:24.303169 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-7b1c245e-50e1-4e82-b5db-bdfeefe4ac41 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:24.305059 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-7b1c245e-50e1-4e82-b5db-bdfeefe4ac41 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:24.306926 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1050/2121] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 30 01:14:23 2022] DELETE /identity/v3/projects/c1d25c38c8554661ab91b8e3399c21bf => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:14:24.311684 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85391c1a-59b6-41d0-87e7-863641824a12 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:24.312188 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85391c1a-59b6-41d0-87e7-863641824a12 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:24.312268 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85391c1a-59b6-41d0-87e7-863641824a12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:24.358773 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-85391c1a-59b6-41d0-87e7-863641824a12 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:14:24.363173 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-85391c1a-59b6-41d0-87e7-863641824a12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:24.393824 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:14:24.467942 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1072/2122] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:14:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:14:24.470009 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3a45a9-479a-4373-93a4-82ba5c45a25d None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:24.470722 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3a45a9-479a-4373-93a4-82ba5c45a25d None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:24.471289 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3a45a9-479a-4373-93a4-82ba5c45a25d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:24.513089 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-8e3a45a9-479a-4373-93a4-82ba5c45a25d None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:14:24.514471 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-8e3a45a9-479a-4373-93a4-82ba5c45a25d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:24.540930 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1051/2123] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:14:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:14:24.545844 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85391c1a-59b6-41d0-87e7-863641824a12 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:24.561907 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85391c1a-59b6-41d0-87e7-863641824a12 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:24.574085 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46aea9e5-3708-4ab0-9e28-e234f9b6a599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:24.574822 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aea9e5-3708-4ab0-9e28-e234f9b6a599 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:24.575110 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aea9e5-3708-4ab0-9e28-e234f9b6a599 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:24.577014 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aea9e5-3708-4ab0-9e28-e234f9b6a599 admin admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:24.577723 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46aea9e5-3708-4ab0-9e28-e234f9b6a599 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:14:24.578043 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46aea9e5-3708-4ab0-9e28-e234f9b6a599 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:24.579726 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46aea9e5-3708-4ab0-9e28-e234f9b6a599 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:24.618063 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1073/2124] 10.222.0.79 () {58 vars in 1153 bytes} [Tue Aug 30 01:14:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:14:24.622238 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3a45a9-479a-4373-93a4-82ba5c45a25d None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:24.637757 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3a45a9-479a-4373-93a4-82ba5c45a25d None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:24.645824 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0df29ec-c2f4-4cb4-919f-dfa436cdbe6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:24.646532 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0df29ec-c2f4-4cb4-919f-dfa436cdbe6e admin admin] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:24.646884 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0df29ec-c2f4-4cb4-919f-dfa436cdbe6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:24.647261 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0df29ec-c2f4-4cb4-919f-dfa436cdbe6e admin admin] PATH_INFO: `/v3/projects` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:24.647983 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0df29ec-c2f4-4cb4-919f-dfa436cdbe6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:24.650111 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0df29ec-c2f4-4cb4-919f-dfa436cdbe6e admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:24.703119 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46aea9e5-3708-4ab0-9e28-e234f9b6a599 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:24.703991 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1052/2125] 10.222.0.79 () {60 vars in 1153 bytes} [Tue Aug 30 01:14:24 2022] POST /identity/v3/projects => generated 381 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:14:24.718839 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46aea9e5-3708-4ab0-9e28-e234f9b6a599 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:24.886410 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5a72b7-0768-4fb1-a02f-77306b1a06aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:24.887057 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5a72b7-0768-4fb1-a02f-77306b1a06aa admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:24.887371 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5a72b7-0768-4fb1-a02f-77306b1a06aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:24.887644 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5a72b7-0768-4fb1-a02f-77306b1a06aa admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:24.888292 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5a72b7-0768-4fb1-a02f-77306b1a06aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:24.891869 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5a72b7-0768-4fb1-a02f-77306b1a06aa admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:24.944081 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1074/2126] 10.222.0.79 () {60 vars in 1144 bytes} [Tue Aug 30 01:14:24 2022] POST /identity/v3/users => generated 291 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:14:24.948412 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0df29ec-c2f4-4cb4-919f-dfa436cdbe6e admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:24.961673 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0df29ec-c2f4-4cb4-919f-dfa436cdbe6e admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:24.980323 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600da076-95b7-4cee-bca0-1b67868ea44c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:24.981193 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600da076-95b7-4cee-bca0-1b67868ea44c admin admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:24.981660 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600da076-95b7-4cee-bca0-1b67868ea44c admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:24.982119 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600da076-95b7-4cee-bca0-1b67868ea44c admin admin] PATH_INFO: `/v3/roles` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:24.983014 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600da076-95b7-4cee-bca0-1b67868ea44c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:24.985707 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600da076-95b7-4cee-bca0-1b67868ea44c admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:25.015931 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5a72b7-0768-4fb1-a02f-77306b1a06aa admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:25.016725 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1053/2127] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:14:24 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:14:25.035442 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5a72b7-0768-4fb1-a02f-77306b1a06aa admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:25.044285 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf37ba6b-d4e7-43ee-9b34-777227438fba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:25.045016 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf37ba6b-d4e7-43ee-9b34-777227438fba admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:25.045373 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf37ba6b-d4e7-43ee-9b34-777227438fba admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:25.045719 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf37ba6b-d4e7-43ee-9b34-777227438fba admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:25.046466 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf37ba6b-d4e7-43ee-9b34-777227438fba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:25.054345 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf37ba6b-d4e7-43ee-9b34-777227438fba admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:25.085927 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600da076-95b7-4cee-bca0-1b67868ea44c admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:25.087079 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1075/2128] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:14:25 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 01:14:25.098592 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600da076-95b7-4cee-bca0-1b67868ea44c admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:25.117812 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6142698c-a73e-474a-898b-0f549ffddf77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:25.118504 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6142698c-a73e-474a-898b-0f549ffddf77 admin admin] REQUEST_METHOD: `PUT` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:25.118780 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6142698c-a73e-474a-898b-0f549ffddf77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:25.119058 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6142698c-a73e-474a-898b-0f549ffddf77 admin admin] PATH_INFO: `/v3/projects/c15a63127d0c4f42ac454927c07684dc/users/fafd4dee762a4ef08844388044922418/roles/c37945a17623465f899d4f217e7af593` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:25.152880 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6142698c-a73e-474a-898b-0f549ffddf77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c15a63127d0c4f42ac454927c07684dc, user_id=fafd4dee762a4ef08844388044922418, role_id=c37945a17623465f899d4f217e7af593)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:25.155670 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6142698c-a73e-474a-898b-0f549ffddf77 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:25.192472 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1054/2129] 10.222.0.79 () {60 vars in 1483 bytes} [Tue Aug 30 01:14:25 2022] PUT /identity/v3/projects/c15a63127d0c4f42ac454927c07684dc/users/fafd4dee762a4ef08844388044922418/roles/c37945a17623465f899d4f217e7af593 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:14:25.197354 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15db85a9-ffb8-4262-b405-ca12124b9f28 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:25.197643 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15db85a9-ffb8-4262-b405-ca12124b9f28 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:25.197916 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15db85a9-ffb8-4262-b405-ca12124b9f28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:25.258434 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-15db85a9-ffb8-4262-b405-ca12124b9f28 None None] MFA Rules not processed for user `fafd4dee762a4ef08844388044922418`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:14:25.259728 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-15db85a9-ffb8-4262-b405-ca12124b9f28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:25.415971 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1076/2130] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:14:25 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:14:25.420397 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6142698c-a73e-474a-898b-0f549ffddf77 admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:25.571732 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6142698c-a73e-474a-898b-0f549ffddf77 admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:25.583287 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9f690f-3350-45a2-b5a1-d1160b5823f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:25.583861 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9f690f-3350-45a2-b5a1-d1160b5823f8 admin admin] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:25.584145 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9f690f-3350-45a2-b5a1-d1160b5823f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:25.584419 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9f690f-3350-45a2-b5a1-d1160b5823f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:25.585077 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9f690f-3350-45a2-b5a1-d1160b5823f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:25.587011 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9f690f-3350-45a2-b5a1-d1160b5823f8 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:25.650344 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1055/2131] 10.222.0.79 () {60 vars in 1153 bytes} [Tue Aug 30 01:14:25 2022] POST /identity/v3/projects => generated 379 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:14:25.654941 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15db85a9-ffb8-4262-b405-ca12124b9f28 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:25.685955 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15db85a9-ffb8-4262-b405-ca12124b9f28 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:25.729270 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:14:25.797738 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed81f26-6ac6-48c7-99ff-1940f995d43f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:25.802339 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed81f26-6ac6-48c7-99ff-1940f995d43f admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:25.802339 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed81f26-6ac6-48c7-99ff-1940f995d43f admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:25.802339 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed81f26-6ac6-48c7-99ff-1940f995d43f admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:25.802339 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed81f26-6ac6-48c7-99ff-1940f995d43f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:25.803797 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed81f26-6ac6-48c7-99ff-1940f995d43f admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:25.853543 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1077/2132] 10.222.0.79 () {60 vars in 1144 bytes} [Tue Aug 30 01:14:25 2022] POST /identity/v3/users => generated 296 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:14:25.854297 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9f690f-3350-45a2-b5a1-d1160b5823f8 admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:25.901680 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9f690f-3350-45a2-b5a1-d1160b5823f8 admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:25.908270 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e0515e-3762-4f8e-9a08-5f91b004fbbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:25.909667 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e0515e-3762-4f8e-9a08-5f91b004fbbd admin admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:25.910179 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e0515e-3762-4f8e-9a08-5f91b004fbbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:25.910588 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e0515e-3762-4f8e-9a08-5f91b004fbbd admin admin] PATH_INFO: `/v3/roles` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:25.911472 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e0515e-3762-4f8e-9a08-5f91b004fbbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:25.913433 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e0515e-3762-4f8e-9a08-5f91b004fbbd admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:25.940685 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed81f26-6ac6-48c7-99ff-1940f995d43f admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:25.943876 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1056/2133] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:14:25 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:14:25.974158 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed81f26-6ac6-48c7-99ff-1940f995d43f admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:25.993158 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03712421-0633-444d-922e-83f6ea5078f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:25.993852 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03712421-0633-444d-922e-83f6ea5078f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:25.994186 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03712421-0633-444d-922e-83f6ea5078f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:25.994407 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03712421-0633-444d-922e-83f6ea5078f8 admin admin] PATH_INFO: `/v3/projects/c920e971bc854ab2af8686ec6ea68488/users/fc44995d6e0d46ddba1c4482698ab3a1/roles/d14c3070c9184d76a7b23df69bd3db07` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:26.050503 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff47b97f-217a-41c3-aab9-48198df12f1b None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:26.051373 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff47b97f-217a-41c3-aab9-48198df12f1b None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:26.052710 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff47b97f-217a-41c3-aab9-48198df12f1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:26.060937 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03712421-0633-444d-922e-83f6ea5078f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c920e971bc854ab2af8686ec6ea68488, user_id=fc44995d6e0d46ddba1c4482698ab3a1, role_id=d14c3070c9184d76a7b23df69bd3db07)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:26.064510 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03712421-0633-444d-922e-83f6ea5078f8 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:26.105033 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1078/2134] 10.222.0.79 () {60 vars in 1483 bytes} [Tue Aug 30 01:14:25 2022] PUT /identity/v3/projects/c920e971bc854ab2af8686ec6ea68488/users/fc44995d6e0d46ddba1c4482698ab3a1/roles/d14c3070c9184d76a7b23df69bd3db07 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:14:26.109241 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03712421-0633-444d-922e-83f6ea5078f8 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:26.118914 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-ff47b97f-217a-41c3-aab9-48198df12f1b None None] MFA Rules not processed for user `d8445faa3bd6407986d739614cdd3a67`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:14:26.121112 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-ff47b97f-217a-41c3-aab9-48198df12f1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:26.201000 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:14:26.266798 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1057/2135] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:14:26 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:14:26.271190 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03712421-0633-444d-922e-83f6ea5078f8 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:26.286230 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737f5715-0e46-4199-8a6f-91b93d306616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:26.286688 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737f5715-0e46-4199-8a6f-91b93d306616 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:26.286972 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737f5715-0e46-4199-8a6f-91b93d306616 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:26.288251 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737f5715-0e46-4199-8a6f-91b93d306616 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:26.288251 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737f5715-0e46-4199-8a6f-91b93d306616 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:26.300385 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737f5715-0e46-4199-8a6f-91b93d306616 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:26.320125 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1079/2136] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:14:26 2022] GET /identity/v3/roles => generated 1420 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 01:14:26.324744 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff47b97f-217a-41c3-aab9-48198df12f1b None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:26.343189 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff47b97f-217a-41c3-aab9-48198df12f1b None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:26.360382 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829bf882-0723-480d-a512-85ff5b3cfc2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:26.364372 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829bf882-0723-480d-a512-85ff5b3cfc2f admin admin] REQUEST_METHOD: `PUT` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:26.364372 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829bf882-0723-480d-a512-85ff5b3cfc2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:26.364372 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829bf882-0723-480d-a512-85ff5b3cfc2f admin admin] PATH_INFO: `/v3/projects/c920e971bc854ab2af8686ec6ea68488/users/fc44995d6e0d46ddba1c4482698ab3a1/roles/d14c3070c9184d76a7b23df69bd3db07` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:26.370352 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829bf882-0723-480d-a512-85ff5b3cfc2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c920e971bc854ab2af8686ec6ea68488, user_id=fc44995d6e0d46ddba1c4482698ab3a1, role_id=d14c3070c9184d76a7b23df69bd3db07)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:26.391146 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829bf882-0723-480d-a512-85ff5b3cfc2f admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:26.410735 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1058/2137] 10.222.0.79 () {60 vars in 1483 bytes} [Tue Aug 30 01:14:26 2022] PUT /identity/v3/projects/c920e971bc854ab2af8686ec6ea68488/users/fc44995d6e0d46ddba1c4482698ab3a1/roles/d14c3070c9184d76a7b23df69bd3db07 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:14:26.422105 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9141d88d-5d45-436a-9b8b-1d6553f774cf None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:26.422655 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9141d88d-5d45-436a-9b8b-1d6553f774cf None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:26.422655 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9141d88d-5d45-436a-9b8b-1d6553f774cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:26.458545 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-9141d88d-5d45-436a-9b8b-1d6553f774cf None None] MFA Rules not processed for user `fc44995d6e0d46ddba1c4482698ab3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:14:26.459868 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-9141d88d-5d45-436a-9b8b-1d6553f774cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:26.547765 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1080/2138] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:14:26 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:14:26.569583 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829bf882-0723-480d-a512-85ff5b3cfc2f admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:26.571841 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-829bf882-0723-480d-a512-85ff5b3cfc2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:26.693537 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829bf882-0723-480d-a512-85ff5b3cfc2f admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:26.699041 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a10bfb4-e4bf-4f93-b7d7-85641b79c16f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f827c7670b74d938ffe066ced88d1c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:26.699851 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a10bfb4-e4bf-4f93-b7d7-85641b79c16f service cinder] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:26.700193 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a10bfb4-e4bf-4f93-b7d7-85641b79c16f service cinder] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:26.700532 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a10bfb4-e4bf-4f93-b7d7-85641b79c16f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:26.717541 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a10bfb4-e4bf-4f93-b7d7-85641b79c16f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:26.719112 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a10bfb4-e4bf-4f93-b7d7-85641b79c16f service cinder] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:26.732893 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1059/2139] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:14:26 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:14:27.284760 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9141d88d-5d45-436a-9b8b-1d6553f774cf None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:27.293150 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-9141d88d-5d45-436a-9b8b-1d6553f774cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:27.303276 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:14:27.408365 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9141d88d-5d45-436a-9b8b-1d6553f774cf None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:27.414088 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10489c02-8a4d-4150-8e28-faed528e1050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:27.414741 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10489c02-8a4d-4150-8e28-faed528e1050 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:27.415017 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10489c02-8a4d-4150-8e28-faed528e1050 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:27.415319 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10489c02-8a4d-4150-8e28-faed528e1050 admin admin] PATH_INFO: `/v3/users/647d376128214cb99a002a7ecce4317c` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:27.424696 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10489c02-8a4d-4150-8e28-faed528e1050 admin admin] RBAC: Authorizing `identity:delete_user(user_id=647d376128214cb99a002a7ecce4317c)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:27.426430 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10489c02-8a4d-4150-8e28-faed528e1050 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:27.510234 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a10bfb4-e4bf-4f93-b7d7-85641b79c16f service cinder] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:27.521666 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a10bfb4-e4bf-4f93-b7d7-85641b79c16f service cinder] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:27.524363 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-10489c02-8a4d-4150-8e28-faed528e1050 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '647d376128214cb99a002a7ecce4317c'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:27.536262 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-10489c02-8a4d-4150-8e28-faed528e1050 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '647d376128214cb99a002a7ecce4317c'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:27.536549 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e02732-5ce1-4890-aea3-abd1b3629c3c tempest-VolumeQuotaClassesTest-821306931 tempest-VolumeQuotaClassesTest-821306931-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc44995d6e0d46ddba1c4482698ab3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c920e971bc854ab2af8686ec6ea68488', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:27.537109 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e02732-5ce1-4890-aea3-abd1b3629c3c tempest-VolumeQuotaClassesTest-821306931 tempest-VolumeQuotaClassesTest-821306931-project-admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:27.537386 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e02732-5ce1-4890-aea3-abd1b3629c3c tempest-VolumeQuotaClassesTest-821306931 tempest-VolumeQuotaClassesTest-821306931-project-admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:27.537656 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e02732-5ce1-4890-aea3-abd1b3629c3c tempest-VolumeQuotaClassesTest-821306931 tempest-VolumeQuotaClassesTest-821306931-project-admin] PATH_INFO: `/v3/domains` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:27.538314 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e02732-5ce1-4890-aea3-abd1b3629c3c tempest-VolumeQuotaClassesTest-821306931 tempest-VolumeQuotaClassesTest-821306931-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:14:27.538614 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e02732-5ce1-4890-aea3-abd1b3629c3c tempest-VolumeQuotaClassesTest-821306931 tempest-VolumeQuotaClassesTest-821306931-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:27.541661 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e02732-5ce1-4890-aea3-abd1b3629c3c tempest-VolumeQuotaClassesTest-821306931 tempest-VolumeQuotaClassesTest-821306931-project-admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:27.553388 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-10489c02-8a4d-4150-8e28-faed528e1050 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '647d376128214cb99a002a7ecce4317c'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:27.556511 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-10489c02-8a4d-4150-8e28-faed528e1050 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '647d376128214cb99a002a7ecce4317c'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:27.586448 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1060/2140] 10.222.0.79 () {58 vars in 1153 bytes} [Tue Aug 30 01:14:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:14:27.587843 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e02732-5ce1-4890-aea3-abd1b3629c3c tempest-VolumeQuotaClassesTest-821306931 tempest-VolumeQuotaClassesTest-821306931-project-admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:27.593201 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-d1e02732-5ce1-4890-aea3-abd1b3629c3c tempest-VolumeQuotaClassesTest-821306931 tempest-VolumeQuotaClassesTest-821306931-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:27.596348 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-10489c02-8a4d-4150-8e28-faed528e1050 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '647d376128214cb99a002a7ecce4317c'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:27.608364 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1081/2141] 10.222.0.79 () {58 vars in 1224 bytes} [Tue Aug 30 01:14:27 2022] DELETE /identity/v3/users/647d376128214cb99a002a7ecce4317c => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:14:27.610981 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e02d18-6a8f-4b11-b258-c48b34d26ed1 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:27.611867 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e02d18-6a8f-4b11-b258-c48b34d26ed1 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:27.613021 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e02d18-6a8f-4b11-b258-c48b34d26ed1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:27.626981 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e02732-5ce1-4890-aea3-abd1b3629c3c tempest-VolumeQuotaClassesTest-821306931 tempest-VolumeQuotaClassesTest-821306931-project-admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:27.647068 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-30e02d18-6a8f-4b11-b258-c48b34d26ed1 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:14:27.649254 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-30e02d18-6a8f-4b11-b258-c48b34d26ed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:27.719609 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b427b509-bd2c-41d6-b727-fba78d011fdf tempest-VolumeQuotaClassesTest-821306931 tempest-VolumeQuotaClassesTest-821306931-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc44995d6e0d46ddba1c4482698ab3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c920e971bc854ab2af8686ec6ea68488', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:27.720036 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b427b509-bd2c-41d6-b727-fba78d011fdf tempest-VolumeQuotaClassesTest-821306931 tempest-VolumeQuotaClassesTest-821306931-project-admin] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:27.720319 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b427b509-bd2c-41d6-b727-fba78d011fdf tempest-VolumeQuotaClassesTest-821306931 tempest-VolumeQuotaClassesTest-821306931-project-admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:27.720775 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b427b509-bd2c-41d6-b727-fba78d011fdf tempest-VolumeQuotaClassesTest-821306931 tempest-VolumeQuotaClassesTest-821306931-project-admin] PATH_INFO: `/v3/projects` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:27.722551 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b427b509-bd2c-41d6-b727-fba78d011fdf tempest-VolumeQuotaClassesTest-821306931 tempest-VolumeQuotaClassesTest-821306931-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:27.724773 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b427b509-bd2c-41d6-b727-fba78d011fdf tempest-VolumeQuotaClassesTest-821306931 tempest-VolumeQuotaClassesTest-821306931-project-admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:27.771581 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1061/2142] 10.222.0.79 () {60 vars in 1153 bytes} [Tue Aug 30 01:14:27 2022] POST /identity/v3/projects => generated 354 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:14:27.773259 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b427b509-bd2c-41d6-b727-fba78d011fdf tempest-VolumeQuotaClassesTest-821306931 tempest-VolumeQuotaClassesTest-821306931-project-admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:27.800978 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1082/2143] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:14:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:14:27.818949 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e02d18-6a8f-4b11-b258-c48b34d26ed1 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:27.822311 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-30e02d18-6a8f-4b11-b258-c48b34d26ed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:27.868028 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:14:27.889762 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b427b509-bd2c-41d6-b727-fba78d011fdf tempest-VolumeQuotaClassesTest-821306931 tempest-VolumeQuotaClassesTest-821306931-project-admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:27.903611 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa84d38f-b00a-4c8b-9ee9-7269eaa5266a tempest-VolumeQuotaClassesTest-821306931 tempest-VolumeQuotaClassesTest-821306931-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc44995d6e0d46ddba1c4482698ab3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c920e971bc854ab2af8686ec6ea68488', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:27.910473 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:14:27.912485 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa84d38f-b00a-4c8b-9ee9-7269eaa5266a tempest-VolumeQuotaClassesTest-821306931 tempest-VolumeQuotaClassesTest-821306931-project-admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:27.912973 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa84d38f-b00a-4c8b-9ee9-7269eaa5266a tempest-VolumeQuotaClassesTest-821306931 tempest-VolumeQuotaClassesTest-821306931-project-admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:27.916396 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa84d38f-b00a-4c8b-9ee9-7269eaa5266a tempest-VolumeQuotaClassesTest-821306931 tempest-VolumeQuotaClassesTest-821306931-project-admin] PATH_INFO: `/v3/domains` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:27.917407 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa84d38f-b00a-4c8b-9ee9-7269eaa5266a tempest-VolumeQuotaClassesTest-821306931 tempest-VolumeQuotaClassesTest-821306931-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:14:27.918947 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa84d38f-b00a-4c8b-9ee9-7269eaa5266a tempest-VolumeQuotaClassesTest-821306931 tempest-VolumeQuotaClassesTest-821306931-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:27.932069 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa84d38f-b00a-4c8b-9ee9-7269eaa5266a tempest-VolumeQuotaClassesTest-821306931 tempest-VolumeQuotaClassesTest-821306931-project-admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:27.965863 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1062/2144] 10.222.0.79 () {58 vars in 1153 bytes} [Tue Aug 30 01:14:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:14:27.987004 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e02d18-6a8f-4b11-b258-c48b34d26ed1 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:28.028249 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa84d38f-b00a-4c8b-9ee9-7269eaa5266a tempest-VolumeQuotaClassesTest-821306931 tempest-VolumeQuotaClassesTest-821306931-project-admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:28.058102 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa84d38f-b00a-4c8b-9ee9-7269eaa5266a tempest-VolumeQuotaClassesTest-821306931 tempest-VolumeQuotaClassesTest-821306931-project-admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:28.081647 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26d3e56-1168-4652-a837-5b995cfd9329 tempest-VolumeQuotaClassesTest-821306931 tempest-VolumeQuotaClassesTest-821306931-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc44995d6e0d46ddba1c4482698ab3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c920e971bc854ab2af8686ec6ea68488', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:28.083371 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26d3e56-1168-4652-a837-5b995cfd9329 tempest-VolumeQuotaClassesTest-821306931 tempest-VolumeQuotaClassesTest-821306931-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:28.083814 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26d3e56-1168-4652-a837-5b995cfd9329 tempest-VolumeQuotaClassesTest-821306931 tempest-VolumeQuotaClassesTest-821306931-project-admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:28.087185 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26d3e56-1168-4652-a837-5b995cfd9329 tempest-VolumeQuotaClassesTest-821306931 tempest-VolumeQuotaClassesTest-821306931-project-admin] PATH_INFO: `/v3/projects/3fc124f89c7f4a46a91c4ccb64167885` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:28.088308 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26d3e56-1168-4652-a837-5b995cfd9329 tempest-VolumeQuotaClassesTest-821306931 tempest-VolumeQuotaClassesTest-821306931-project-admin] RBAC: Authorizing `identity:delete_project(project_id=3fc124f89c7f4a46a91c4ccb64167885)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:28.094932 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26d3e56-1168-4652-a837-5b995cfd9329 tempest-VolumeQuotaClassesTest-821306931 tempest-VolumeQuotaClassesTest-821306931-project-admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:28.176796 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a3e4bb-8e9d-4494-9410-bfcecc840d30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16e6a0ca26fc4ef892c188ad89a1e132', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:28.177447 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a3e4bb-8e9d-4494-9410-bfcecc840d30 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:28.177722 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a3e4bb-8e9d-4494-9410-bfcecc840d30 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:28.177988 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a3e4bb-8e9d-4494-9410-bfcecc840d30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:28.282716 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-e26d3e56-1168-4652-a837-5b995cfd9329 tempest-VolumeQuotaClassesTest-821306931 tempest-VolumeQuotaClassesTest-821306931-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3fc124f89c7f4a46a91c4ccb64167885', 'request_id': 'req-e26d3e56-1168-4652-a837-5b995cfd9329'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:28.301266 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-e26d3e56-1168-4652-a837-5b995cfd9329 tempest-VolumeQuotaClassesTest-821306931 tempest-VolumeQuotaClassesTest-821306931-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3fc124f89c7f4a46a91c4ccb64167885', 'request_id': 'req-e26d3e56-1168-4652-a837-5b995cfd9329'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:28.317579 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-e26d3e56-1168-4652-a837-5b995cfd9329 tempest-VolumeQuotaClassesTest-821306931 tempest-VolumeQuotaClassesTest-821306931-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3fc124f89c7f4a46a91c4ccb64167885', 'request_id': 'req-e26d3e56-1168-4652-a837-5b995cfd9329'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:28.349491 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-e26d3e56-1168-4652-a837-5b995cfd9329 tempest-VolumeQuotaClassesTest-821306931 tempest-VolumeQuotaClassesTest-821306931-project-admin] The token cache is being invalidate because project 3fc124f89c7f4a46a91c4ccb64167885 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81998) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:14:28.350465 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-e26d3e56-1168-4652-a837-5b995cfd9329 tempest-VolumeQuotaClassesTest-821306931 tempest-VolumeQuotaClassesTest-821306931-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:28.351800 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-e26d3e56-1168-4652-a837-5b995cfd9329 tempest-VolumeQuotaClassesTest-821306931 tempest-VolumeQuotaClassesTest-821306931-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:28.356401 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1063/2145] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 30 01:14:28 2022] DELETE /identity/v3/projects/3fc124f89c7f4a46a91c4ccb64167885 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:14:28.358398 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015beea7-2843-4426-940d-aea6775c6c71 None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:28.370446 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015beea7-2843-4426-940d-aea6775c6c71 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:28.373311 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015beea7-2843-4426-940d-aea6775c6c71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:28.387311 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a3e4bb-8e9d-4494-9410-bfcecc840d30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:28.388773 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a3e4bb-8e9d-4494-9410-bfcecc840d30 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:28.428372 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1083/2146] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:14:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 615 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:14:28.469254 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-015beea7-2843-4426-940d-aea6775c6c71 None None] MFA Rules not processed for user `ae567fa8585940bf98167103a86734de`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:14:28.472540 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-015beea7-2843-4426-940d-aea6775c6c71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:28.632148 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1064/2147] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:14:28 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:14:28.636860 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a3e4bb-8e9d-4494-9410-bfcecc840d30 service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:28.648002 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-a1a3e4bb-8e9d-4494-9410-bfcecc840d30 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:28.688598 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a3e4bb-8e9d-4494-9410-bfcecc840d30 service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:28.740575 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015beea7-2843-4426-940d-aea6775c6c71 None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:28.742979 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-015beea7-2843-4426-940d-aea6775c6c71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:28.835508 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:14:28.850502 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55af872-002c-4686-9dad-99292c7bdf5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:28.851846 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55af872-002c-4686-9dad-99292c7bdf5e admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:28.853747 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55af872-002c-4686-9dad-99292c7bdf5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:28.854691 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55af872-002c-4686-9dad-99292c7bdf5e admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:28.855870 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55af872-002c-4686-9dad-99292c7bdf5e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:28.863999 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55af872-002c-4686-9dad-99292c7bdf5e admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:28.878495 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015beea7-2843-4426-940d-aea6775c6c71 None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:28.884632 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacd0449-e127-4307-9a3a-cafe7a5a4dfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:28.885278 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacd0449-e127-4307-9a3a-cafe7a5a4dfd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:28.885552 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacd0449-e127-4307-9a3a-cafe7a5a4dfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:28.885818 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacd0449-e127-4307-9a3a-cafe7a5a4dfd admin admin] PATH_INFO: `/v3/users/fafd4dee762a4ef08844388044922418` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:28.888376 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacd0449-e127-4307-9a3a-cafe7a5a4dfd admin admin] RBAC: Authorizing `identity:delete_user(user_id=fafd4dee762a4ef08844388044922418)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:28.893637 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacd0449-e127-4307-9a3a-cafe7a5a4dfd admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:28.948709 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1084/2148] 10.222.0.79 () {60 vars in 1153 bytes} [Tue Aug 30 01:14:28 2022] POST /identity/v3/projects => generated 383 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:14:28.949856 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55af872-002c-4686-9dad-99292c7bdf5e admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:28.955588 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-d55af872-002c-4686-9dad-99292c7bdf5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:28.986545 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:14:29.002706 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-cacd0449-e127-4307-9a3a-cafe7a5a4dfd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fafd4dee762a4ef08844388044922418'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:29.016898 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-cacd0449-e127-4307-9a3a-cafe7a5a4dfd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fafd4dee762a4ef08844388044922418'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:29.044884 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-cacd0449-e127-4307-9a3a-cafe7a5a4dfd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fafd4dee762a4ef08844388044922418'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:29.047332 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-cacd0449-e127-4307-9a3a-cafe7a5a4dfd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fafd4dee762a4ef08844388044922418'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:29.065062 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-cacd0449-e127-4307-9a3a-cafe7a5a4dfd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fafd4dee762a4ef08844388044922418'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:29.069925 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55af872-002c-4686-9dad-99292c7bdf5e admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:29.074126 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1065/2149] 10.222.0.79 () {58 vars in 1224 bytes} [Tue Aug 30 01:14:28 2022] DELETE /identity/v3/users/fafd4dee762a4ef08844388044922418 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:14:29.077604 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacd0449-e127-4307-9a3a-cafe7a5a4dfd admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:29.077604 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-cacd0449-e127-4307-9a3a-cafe7a5a4dfd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:29.077860 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f3538d-7483-4a99-bda9-1d5af847ba07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:29.078036 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f3538d-7483-4a99-bda9-1d5af847ba07 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:29.078322 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f3538d-7483-4a99-bda9-1d5af847ba07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:29.078596 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f3538d-7483-4a99-bda9-1d5af847ba07 admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:29.079345 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f3538d-7483-4a99-bda9-1d5af847ba07 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:29.081548 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f3538d-7483-4a99-bda9-1d5af847ba07 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:29.114686 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1085/2150] 10.222.0.79 () {60 vars in 1144 bytes} [Tue Aug 30 01:14:28 2022] POST /identity/v3/users => generated 298 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:14:29.116246 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb0fbed-1e02-479d-9484-9203f7d3f215 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:29.116599 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb0fbed-1e02-479d-9484-9203f7d3f215 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:29.116881 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb0fbed-1e02-479d-9484-9203f7d3f215 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:29.151197 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-7fb0fbed-1e02-479d-9484-9203f7d3f215 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:14:29.152482 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-7fb0fbed-1e02-479d-9484-9203f7d3f215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:29.175350 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacd0449-e127-4307-9a3a-cafe7a5a4dfd admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:29.180430 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c643f5-6a77-4ce6-9fc8-a6fe1c185318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:29.181185 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c643f5-6a77-4ce6-9fc8-a6fe1c185318 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:29.182009 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c643f5-6a77-4ce6-9fc8-a6fe1c185318 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:29.182331 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c643f5-6a77-4ce6-9fc8-a6fe1c185318 admin admin] PATH_INFO: `/v3/projects/be16238e6ac740b99e27230d40de12cf` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:29.183934 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c643f5-6a77-4ce6-9fc8-a6fe1c185318 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be16238e6ac740b99e27230d40de12cf)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:29.186022 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c643f5-6a77-4ce6-9fc8-a6fe1c185318 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:29.264334 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-18c643f5-6a77-4ce6-9fc8-a6fe1c185318 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be16238e6ac740b99e27230d40de12cf', 'request_id': 'req-18c643f5-6a77-4ce6-9fc8-a6fe1c185318'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:29.277672 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-18c643f5-6a77-4ce6-9fc8-a6fe1c185318 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be16238e6ac740b99e27230d40de12cf', 'request_id': 'req-18c643f5-6a77-4ce6-9fc8-a6fe1c185318'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:29.296367 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-18c643f5-6a77-4ce6-9fc8-a6fe1c185318 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be16238e6ac740b99e27230d40de12cf', 'request_id': 'req-18c643f5-6a77-4ce6-9fc8-a6fe1c185318'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:29.329540 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1086/2151] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:14:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:14:29.330727 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb0fbed-1e02-479d-9484-9203f7d3f215 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:29.333971 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-18c643f5-6a77-4ce6-9fc8-a6fe1c185318 admin admin] The token cache is being invalidate because project be16238e6ac740b99e27230d40de12cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81998) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:14:29.334365 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-18c643f5-6a77-4ce6-9fc8-a6fe1c185318 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:29.336897 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-18c643f5-6a77-4ce6-9fc8-a6fe1c185318 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:29.340038 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1066/2152] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 30 01:14:29 2022] DELETE /identity/v3/projects/be16238e6ac740b99e27230d40de12cf => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:14:29.341017 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c643f5-6a77-4ce6-9fc8-a6fe1c185318 admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:29.341138 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-7fb0fbed-1e02-479d-9484-9203f7d3f215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:29.345410 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-18c643f5-6a77-4ce6-9fc8-a6fe1c185318 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:29.356907 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:14:29.360323 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb0fbed-1e02-479d-9484-9203f7d3f215 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:29.472965 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fe9dd5-85c1-45da-a817-1476fa48f5a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:29.473568 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fe9dd5-85c1-45da-a817-1476fa48f5a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:29.473854 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fe9dd5-85c1-45da-a817-1476fa48f5a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:29.474142 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fe9dd5-85c1-45da-a817-1476fa48f5a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:29.474808 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fe9dd5-85c1-45da-a817-1476fa48f5a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:29.476699 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fe9dd5-85c1-45da-a817-1476fa48f5a0 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:29.490899 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1087/2153] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:14:29 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:14:29.496054 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fe9dd5-85c1-45da-a817-1476fa48f5a0 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:29.497792 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-22fe9dd5-85c1-45da-a817-1476fa48f5a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:29.512677 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c643f5-6a77-4ce6-9fc8-a6fe1c185318 admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:29.525241 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bf8047-4306-4c07-a37b-5c8f9b88ef2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16e6a0ca26fc4ef892c188ad89a1e132', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:29.525908 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bf8047-4306-4c07-a37b-5c8f9b88ef2b service neutron] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:29.526229 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bf8047-4306-4c07-a37b-5c8f9b88ef2b service neutron] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:29.526506 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bf8047-4306-4c07-a37b-5c8f9b88ef2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:29.529606 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fe9dd5-85c1-45da-a817-1476fa48f5a0 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:29.531837 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-e7bf8047-4306-4c07-a37b-5c8f9b88ef2b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:29.548010 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b71cdc-9c86-4161-bf5b-0653e8befc57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:29.552058 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b71cdc-9c86-4161-bf5b-0653e8befc57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:29.552371 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b71cdc-9c86-4161-bf5b-0653e8befc57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:29.552698 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b71cdc-9c86-4161-bf5b-0653e8befc57 admin admin] PATH_INFO: `/v3/users/693eb5c6758d4e31ace9daecb1e3130b` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:29.555706 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b71cdc-9c86-4161-bf5b-0653e8befc57 admin admin] RBAC: Authorizing `identity:delete_user(user_id=693eb5c6758d4e31ace9daecb1e3130b)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:29.562297 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b71cdc-9c86-4161-bf5b-0653e8befc57 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:29.563973 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bf8047-4306-4c07-a37b-5c8f9b88ef2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:29.566355 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bf8047-4306-4c07-a37b-5c8f9b88ef2b service neutron] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:29.604439 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1067/2154] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:14:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:14:29.605568 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bf8047-4306-4c07-a37b-5c8f9b88ef2b service neutron] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:29.613247 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-e7bf8047-4306-4c07-a37b-5c8f9b88ef2b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:29.630606 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bf8047-4306-4c07-a37b-5c8f9b88ef2b service neutron] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:29.637923 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9aaff0-2ef6-44e2-8317-4649bf3ecb38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:29.638968 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9aaff0-2ef6-44e2-8317-4649bf3ecb38 admin admin] REQUEST_METHOD: `PUT` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:29.639961 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9aaff0-2ef6-44e2-8317-4649bf3ecb38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:29.640400 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9aaff0-2ef6-44e2-8317-4649bf3ecb38 admin admin] PATH_INFO: `/v3/projects/fffed7b4fdeb46eabb65bde68c9bb205/users/6b69223792314981a27f7d20e8a56f23/roles/d14c3070c9184d76a7b23df69bd3db07` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:29.641570 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:14:29.662988 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-40b71cdc-9c86-4161-bf5b-0653e8befc57 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '693eb5c6758d4e31ace9daecb1e3130b'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:29.680113 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-40b71cdc-9c86-4161-bf5b-0653e8befc57 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '693eb5c6758d4e31ace9daecb1e3130b'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:29.701132 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-40b71cdc-9c86-4161-bf5b-0653e8befc57 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '693eb5c6758d4e31ace9daecb1e3130b'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:29.701898 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-40b71cdc-9c86-4161-bf5b-0653e8befc57 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '693eb5c6758d4e31ace9daecb1e3130b'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:29.703397 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9aaff0-2ef6-44e2-8317-4649bf3ecb38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fffed7b4fdeb46eabb65bde68c9bb205, user_id=6b69223792314981a27f7d20e8a56f23, role_id=d14c3070c9184d76a7b23df69bd3db07)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:29.712346 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9aaff0-2ef6-44e2-8317-4649bf3ecb38 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:29.738369 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-40b71cdc-9c86-4161-bf5b-0653e8befc57 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '693eb5c6758d4e31ace9daecb1e3130b'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:29.758518 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1068/2155] 10.222.0.79 () {60 vars in 1483 bytes} [Tue Aug 30 01:14:29 2022] PUT /identity/v3/projects/fffed7b4fdeb46eabb65bde68c9bb205/users/6b69223792314981a27f7d20e8a56f23/roles/d14c3070c9184d76a7b23df69bd3db07 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:14:29.764635 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9aaff0-2ef6-44e2-8317-4649bf3ecb38 admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:29.769494 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1088/2156] 10.222.0.79 () {58 vars in 1224 bytes} [Tue Aug 30 01:14:29 2022] DELETE /identity/v3/users/693eb5c6758d4e31ace9daecb1e3130b => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:14:29.770289 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-0c9aaff0-2ef6-44e2-8317-4649bf3ecb38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:29.966581 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9aaff0-2ef6-44e2-8317-4649bf3ecb38 admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:30.137586 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc667c30-b59c-4079-bc34-8d1d20fbea99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:30.138314 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc667c30-b59c-4079-bc34-8d1d20fbea99 admin admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:30.139258 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc667c30-b59c-4079-bc34-8d1d20fbea99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:30.139611 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc667c30-b59c-4079-bc34-8d1d20fbea99 admin admin] PATH_INFO: `/v3/roles` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:30.140413 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc667c30-b59c-4079-bc34-8d1d20fbea99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:30.142574 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc667c30-b59c-4079-bc34-8d1d20fbea99 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:30.168162 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1069/2157] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:14:29 2022] GET /identity/v3/roles => generated 1420 bytes in 406 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:14:30.172348 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b71cdc-9c86-4161-bf5b-0653e8befc57 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:30.192520 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b71cdc-9c86-4161-bf5b-0653e8befc57 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:30.209441 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbe41b6-b95a-459f-9f1e-3a9333c101b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:30.210243 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbe41b6-b95a-459f-9f1e-3a9333c101b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:30.210589 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbe41b6-b95a-459f-9f1e-3a9333c101b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:30.210930 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbe41b6-b95a-459f-9f1e-3a9333c101b6 admin admin] PATH_INFO: `/v3/projects/fffed7b4fdeb46eabb65bde68c9bb205/users/6b69223792314981a27f7d20e8a56f23/roles/d14c3070c9184d76a7b23df69bd3db07` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:30.216272 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbe41b6-b95a-459f-9f1e-3a9333c101b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fffed7b4fdeb46eabb65bde68c9bb205, user_id=6b69223792314981a27f7d20e8a56f23, role_id=d14c3070c9184d76a7b23df69bd3db07)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:30.216418 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc667c30-b59c-4079-bc34-8d1d20fbea99 admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:30.218146 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-bc667c30-b59c-4079-bc34-8d1d20fbea99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:30.219867 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbe41b6-b95a-459f-9f1e-3a9333c101b6 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:30.241783 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc667c30-b59c-4079-bc34-8d1d20fbea99 admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:30.253063 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62416184-3c62-4229-9685-4642689db5fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:30.253771 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62416184-3c62-4229-9685-4642689db5fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:30.254078 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62416184-3c62-4229-9685-4642689db5fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:30.254347 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62416184-3c62-4229-9685-4642689db5fc admin admin] PATH_INFO: `/v3/projects/c15a63127d0c4f42ac454927c07684dc` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:30.256597 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62416184-3c62-4229-9685-4642689db5fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=c15a63127d0c4f42ac454927c07684dc)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:30.272654 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62416184-3c62-4229-9685-4642689db5fc admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:30.286718 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1089/2158] 10.222.0.79 () {60 vars in 1483 bytes} [Tue Aug 30 01:14:30 2022] PUT /identity/v3/projects/fffed7b4fdeb46eabb65bde68c9bb205/users/6b69223792314981a27f7d20e8a56f23/roles/d14c3070c9184d76a7b23df69bd3db07 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:14:30.352886 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:14:30.404258 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-62416184-3c62-4229-9685-4642689db5fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c15a63127d0c4f42ac454927c07684dc', 'request_id': 'req-62416184-3c62-4229-9685-4642689db5fc'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:30.421553 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-62416184-3c62-4229-9685-4642689db5fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c15a63127d0c4f42ac454927c07684dc', 'request_id': 'req-62416184-3c62-4229-9685-4642689db5fc'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:30.429751 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-62416184-3c62-4229-9685-4642689db5fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c15a63127d0c4f42ac454927c07684dc', 'request_id': 'req-62416184-3c62-4229-9685-4642689db5fc'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:30.444941 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-62416184-3c62-4229-9685-4642689db5fc admin admin] The token cache is being invalidate because project c15a63127d0c4f42ac454927c07684dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81998) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:14:30.445278 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-62416184-3c62-4229-9685-4642689db5fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:30.446148 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-62416184-3c62-4229-9685-4642689db5fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:30.448237 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1070/2159] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 30 01:14:30 2022] DELETE /identity/v3/projects/c15a63127d0c4f42ac454927c07684dc => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:14:30.452014 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbe41b6-b95a-459f-9f1e-3a9333c101b6 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:30.454382 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-abbe41b6-b95a-459f-9f1e-3a9333c101b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:30.538065 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbe41b6-b95a-459f-9f1e-3a9333c101b6 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:30.599935 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62416184-3c62-4229-9685-4642689db5fc admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:30.600835 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-62416184-3c62-4229-9685-4642689db5fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:30.657685 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824043d1-b412-41ee-92bd-6e7f1facdd15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:30.659978 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824043d1-b412-41ee-92bd-6e7f1facdd15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:30.660134 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824043d1-b412-41ee-92bd-6e7f1facdd15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:30.662354 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824043d1-b412-41ee-92bd-6e7f1facdd15 admin admin] PATH_INFO: `/v3/users/fc44995d6e0d46ddba1c4482698ab3a1` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:30.667824 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824043d1-b412-41ee-92bd-6e7f1facdd15 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc44995d6e0d46ddba1c4482698ab3a1)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:30.669887 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824043d1-b412-41ee-92bd-6e7f1facdd15 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:30.807705 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62416184-3c62-4229-9685-4642689db5fc admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:30.811774 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-824043d1-b412-41ee-92bd-6e7f1facdd15 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc44995d6e0d46ddba1c4482698ab3a1'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:30.818807 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:14:30.822829 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9209c611-c7ed-45bf-a71e-f48a41dde1c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:30.826421 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9209c611-c7ed-45bf-a71e-f48a41dde1c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:30.826756 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9209c611-c7ed-45bf-a71e-f48a41dde1c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:30.827151 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9209c611-c7ed-45bf-a71e-f48a41dde1c7 admin admin] PATH_INFO: `/v3/projects/8b00f3cf21d14ac09896e0599e9c4f5e` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:30.828485 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9209c611-c7ed-45bf-a71e-f48a41dde1c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b00f3cf21d14ac09896e0599e9c4f5e)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:30.831027 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9209c611-c7ed-45bf-a71e-f48a41dde1c7 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:30.849162 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-824043d1-b412-41ee-92bd-6e7f1facdd15 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc44995d6e0d46ddba1c4482698ab3a1'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:30.868876 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-824043d1-b412-41ee-92bd-6e7f1facdd15 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc44995d6e0d46ddba1c4482698ab3a1'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:30.869772 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-824043d1-b412-41ee-92bd-6e7f1facdd15 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc44995d6e0d46ddba1c4482698ab3a1'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:30.908074 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-824043d1-b412-41ee-92bd-6e7f1facdd15 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc44995d6e0d46ddba1c4482698ab3a1'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:30.929979 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1090/2160] 10.222.0.79 () {58 vars in 1224 bytes} [Tue Aug 30 01:14:30 2022] DELETE /identity/v3/users/fc44995d6e0d46ddba1c4482698ab3a1 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:14:30.930870 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-9209c611-c7ed-45bf-a71e-f48a41dde1c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b00f3cf21d14ac09896e0599e9c4f5e', 'request_id': 'req-9209c611-c7ed-45bf-a71e-f48a41dde1c7'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:30.959332 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-9209c611-c7ed-45bf-a71e-f48a41dde1c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b00f3cf21d14ac09896e0599e9c4f5e', 'request_id': 'req-9209c611-c7ed-45bf-a71e-f48a41dde1c7'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:30.969777 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-9209c611-c7ed-45bf-a71e-f48a41dde1c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b00f3cf21d14ac09896e0599e9c4f5e', 'request_id': 'req-9209c611-c7ed-45bf-a71e-f48a41dde1c7'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:31.002981 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-9209c611-c7ed-45bf-a71e-f48a41dde1c7 admin admin] The token cache is being invalidate because project 8b00f3cf21d14ac09896e0599e9c4f5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81998) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:14:31.003527 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-9209c611-c7ed-45bf-a71e-f48a41dde1c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:31.006185 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-9209c611-c7ed-45bf-a71e-f48a41dde1c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:31.010920 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1071/2161] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 30 01:14:30 2022] DELETE /identity/v3/projects/8b00f3cf21d14ac09896e0599e9c4f5e => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:14:31.012257 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824043d1-b412-41ee-92bd-6e7f1facdd15 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:31.013834 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-824043d1-b412-41ee-92bd-6e7f1facdd15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:31.196180 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824043d1-b412-41ee-92bd-6e7f1facdd15 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:31.205345 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c7fb4b-34a9-48a1-8596-aeff864bbb33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:31.206578 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c7fb4b-34a9-48a1-8596-aeff864bbb33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:31.206995 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c7fb4b-34a9-48a1-8596-aeff864bbb33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:31.207499 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c7fb4b-34a9-48a1-8596-aeff864bbb33 admin admin] PATH_INFO: `/v3/users/b735aab34ab84d6f9a929d23d9ae2cac` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:31.208891 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c7fb4b-34a9-48a1-8596-aeff864bbb33 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b735aab34ab84d6f9a929d23d9ae2cac)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:31.211056 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c7fb4b-34a9-48a1-8596-aeff864bbb33 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:31.327007 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-94c7fb4b-34a9-48a1-8596-aeff864bbb33 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b735aab34ab84d6f9a929d23d9ae2cac'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:31.346647 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-94c7fb4b-34a9-48a1-8596-aeff864bbb33 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b735aab34ab84d6f9a929d23d9ae2cac'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:31.364851 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-94c7fb4b-34a9-48a1-8596-aeff864bbb33 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b735aab34ab84d6f9a929d23d9ae2cac'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:31.365528 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-94c7fb4b-34a9-48a1-8596-aeff864bbb33 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b735aab34ab84d6f9a929d23d9ae2cac'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:31.389725 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-94c7fb4b-34a9-48a1-8596-aeff864bbb33 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b735aab34ab84d6f9a929d23d9ae2cac'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:31.409051 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1091/2162] 10.222.0.79 () {58 vars in 1224 bytes} [Tue Aug 30 01:14:31 2022] DELETE /identity/v3/users/b735aab34ab84d6f9a929d23d9ae2cac => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:14:32.177007 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9209c611-c7ed-45bf-a71e-f48a41dde1c7 admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:32.178837 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-9209c611-c7ed-45bf-a71e-f48a41dde1c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:32.254180 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c7fb4b-34a9-48a1-8596-aeff864bbb33 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:32.255821 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-94c7fb4b-34a9-48a1-8596-aeff864bbb33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:32.304405 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:14:32.343477 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9209c611-c7ed-45bf-a71e-f48a41dde1c7 admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:32.457264 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bb9f87-86b6-492a-8157-a9b9b8d60dbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:32.458316 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bb9f87-86b6-492a-8157-a9b9b8d60dbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:32.462085 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:14:32.462807 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bb9f87-86b6-492a-8157-a9b9b8d60dbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:32.463091 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bb9f87-86b6-492a-8157-a9b9b8d60dbb admin admin] PATH_INFO: `/v3/projects/c920e971bc854ab2af8686ec6ea68488` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:32.466571 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bb9f87-86b6-492a-8157-a9b9b8d60dbb admin admin] RBAC: Authorizing `identity:delete_project(project_id=c920e971bc854ab2af8686ec6ea68488)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:32.472661 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bb9f87-86b6-492a-8157-a9b9b8d60dbb admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:32.512757 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c7fb4b-34a9-48a1-8596-aeff864bbb33 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:32.531270 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e4fa3c-c790-4bd7-bebd-67a5b46665c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:32.543664 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e4fa3c-c790-4bd7-bebd-67a5b46665c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:32.543974 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e4fa3c-c790-4bd7-bebd-67a5b46665c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:32.544224 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e4fa3c-c790-4bd7-bebd-67a5b46665c0 admin admin] PATH_INFO: `/v3/projects/0f7c23be01d34ac9a55e7e443051f1e3` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:32.550487 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e4fa3c-c790-4bd7-bebd-67a5b46665c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f7c23be01d34ac9a55e7e443051f1e3)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:32.552437 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e4fa3c-c790-4bd7-bebd-67a5b46665c0 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:32.654456 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-29bb9f87-86b6-492a-8157-a9b9b8d60dbb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c920e971bc854ab2af8686ec6ea68488', 'request_id': 'req-29bb9f87-86b6-492a-8157-a9b9b8d60dbb'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:32.689419 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-29bb9f87-86b6-492a-8157-a9b9b8d60dbb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c920e971bc854ab2af8686ec6ea68488', 'request_id': 'req-29bb9f87-86b6-492a-8157-a9b9b8d60dbb'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:32.701170 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-29bb9f87-86b6-492a-8157-a9b9b8d60dbb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c920e971bc854ab2af8686ec6ea68488', 'request_id': 'req-29bb9f87-86b6-492a-8157-a9b9b8d60dbb'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:32.705627 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-d5e4fa3c-c790-4bd7-bebd-67a5b46665c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f7c23be01d34ac9a55e7e443051f1e3', 'request_id': 'req-d5e4fa3c-c790-4bd7-bebd-67a5b46665c0'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:32.719332 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-d5e4fa3c-c790-4bd7-bebd-67a5b46665c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f7c23be01d34ac9a55e7e443051f1e3', 'request_id': 'req-d5e4fa3c-c790-4bd7-bebd-67a5b46665c0'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:32.727785 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-d5e4fa3c-c790-4bd7-bebd-67a5b46665c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f7c23be01d34ac9a55e7e443051f1e3', 'request_id': 'req-d5e4fa3c-c790-4bd7-bebd-67a5b46665c0'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:32.729477 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-29bb9f87-86b6-492a-8157-a9b9b8d60dbb admin admin] The token cache is being invalidate because project c920e971bc854ab2af8686ec6ea68488 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81998) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:14:32.730871 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-29bb9f87-86b6-492a-8157-a9b9b8d60dbb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:32.733817 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-29bb9f87-86b6-492a-8157-a9b9b8d60dbb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:32.737583 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1072/2163] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 30 01:14:32 2022] DELETE /identity/v3/projects/c920e971bc854ab2af8686ec6ea68488 => generated 0 bytes in 561 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:14:32.742233 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd73629b-3f30-4672-9868-64b96a35f0d6 None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:32.742517 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd73629b-3f30-4672-9868-64b96a35f0d6 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:32.742788 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd73629b-3f30-4672-9868-64b96a35f0d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:32.745231 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-d5e4fa3c-c790-4bd7-bebd-67a5b46665c0 admin admin] The token cache is being invalidate because project 0f7c23be01d34ac9a55e7e443051f1e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:14:32.745529 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-d5e4fa3c-c790-4bd7-bebd-67a5b46665c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:32.746288 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-d5e4fa3c-c790-4bd7-bebd-67a5b46665c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:32.750045 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1092/2164] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 30 01:14:32 2022] DELETE /identity/v3/projects/0f7c23be01d34ac9a55e7e443051f1e3 => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:14:32.756598 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2be1dcd-b18a-4b5e-8c38-56cadfb752b8 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:32.756965 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2be1dcd-b18a-4b5e-8c38-56cadfb752b8 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:32.757359 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2be1dcd-b18a-4b5e-8c38-56cadfb752b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:32.782928 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-f2be1dcd-b18a-4b5e-8c38-56cadfb752b8 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:14:32.787668 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-f2be1dcd-b18a-4b5e-8c38-56cadfb752b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:32.809250 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-fd73629b-3f30-4672-9868-64b96a35f0d6 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:14:32.810519 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-fd73629b-3f30-4672-9868-64b96a35f0d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:32.874225 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1093/2165] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:14:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:14:32.882884 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6608cd4-52e5-4a1d-bc5c-c4e5fa661e0e None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:32.883749 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6608cd4-52e5-4a1d-bc5c-c4e5fa661e0e None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:32.884642 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6608cd4-52e5-4a1d-bc5c-c4e5fa661e0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:32.946272 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1073/2166] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:14:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:14:32.956171 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937f2037-dce9-4eef-a718-d9265c3a3d26 None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:32.957841 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937f2037-dce9-4eef-a718-d9265c3a3d26 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:32.958185 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937f2037-dce9-4eef-a718-d9265c3a3d26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:32.959752 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-c6608cd4-52e5-4a1d-bc5c-c4e5fa661e0e None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:14:32.964256 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-c6608cd4-52e5-4a1d-bc5c-c4e5fa661e0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:32.989575 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1094/2167] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:14:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:14:32.993273 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6608cd4-52e5-4a1d-bc5c-c4e5fa661e0e None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:33.010400 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-937f2037-dce9-4eef-a718-d9265c3a3d26 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:14:33.013259 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6608cd4-52e5-4a1d-bc5c-c4e5fa661e0e None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:33.016209 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-937f2037-dce9-4eef-a718-d9265c3a3d26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:33.025840 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd1521a-ffac-470e-b721-f2fd26a188fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:33.026603 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd1521a-ffac-470e-b721-f2fd26a188fe admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:33.027664 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd1521a-ffac-470e-b721-f2fd26a188fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:33.027664 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd1521a-ffac-470e-b721-f2fd26a188fe admin admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:33.029031 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd1521a-ffac-470e-b721-f2fd26a188fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:14:33.029856 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd1521a-ffac-470e-b721-f2fd26a188fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:33.036961 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd1521a-ffac-470e-b721-f2fd26a188fe admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:33.040995 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1074/2168] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:14:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:14:33.046415 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937f2037-dce9-4eef-a718-d9265c3a3d26 None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:33.064423 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937f2037-dce9-4eef-a718-d9265c3a3d26 None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:33.071987 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1095/2169] 10.222.0.79 () {58 vars in 1153 bytes} [Tue Aug 30 01:14:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:14:33.076570 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd1521a-ffac-470e-b721-f2fd26a188fe admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:33.086438 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27befa13-97ba-4580-9411-92b4f38f6b07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:33.087181 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27befa13-97ba-4580-9411-92b4f38f6b07 admin admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:33.088532 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27befa13-97ba-4580-9411-92b4f38f6b07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:33.088903 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27befa13-97ba-4580-9411-92b4f38f6b07 admin admin] PATH_INFO: `/v3/domains` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:33.089891 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27befa13-97ba-4580-9411-92b4f38f6b07 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:14:33.090005 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27befa13-97ba-4580-9411-92b4f38f6b07 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:33.092131 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27befa13-97ba-4580-9411-92b4f38f6b07 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:33.101095 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd1521a-ffac-470e-b721-f2fd26a188fe admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:33.102644 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:14:33.116864 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5745215-efa4-446d-8ef1-b263965dda7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:33.118852 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5745215-efa4-446d-8ef1-b263965dda7c admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:33.119091 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5745215-efa4-446d-8ef1-b263965dda7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:33.119690 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5745215-efa4-446d-8ef1-b263965dda7c admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:33.121415 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5745215-efa4-446d-8ef1-b263965dda7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:33.126074 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5745215-efa4-446d-8ef1-b263965dda7c admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:33.129059 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1075/2170] 10.222.0.79 () {58 vars in 1153 bytes} [Tue Aug 30 01:14:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:14:33.132987 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27befa13-97ba-4580-9411-92b4f38f6b07 admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:33.160667 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27befa13-97ba-4580-9411-92b4f38f6b07 admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:33.167033 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98691a57-2ea9-4586-a113-4c602520e4bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:33.168562 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98691a57-2ea9-4586-a113-4c602520e4bc admin admin] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:33.169109 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98691a57-2ea9-4586-a113-4c602520e4bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:33.169563 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98691a57-2ea9-4586-a113-4c602520e4bc admin admin] PATH_INFO: `/v3/projects` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:33.170595 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98691a57-2ea9-4586-a113-4c602520e4bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:33.173360 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98691a57-2ea9-4586-a113-4c602520e4bc admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:33.188879 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1096/2171] 10.222.0.79 () {60 vars in 1153 bytes} [Tue Aug 30 01:14:33 2022] POST /identity/v3/projects => generated 371 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:14:33.193894 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5745215-efa4-446d-8ef1-b263965dda7c admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:33.269088 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1076/2172] 10.222.0.79 () {60 vars in 1153 bytes} [Tue Aug 30 01:14:33 2022] POST /identity/v3/projects => generated 385 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:14:33.273235 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98691a57-2ea9-4586-a113-4c602520e4bc admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:33.310530 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:14:33.359714 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5745215-efa4-446d-8ef1-b263965dda7c admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:33.469941 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98691a57-2ea9-4586-a113-4c602520e4bc admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:33.483942 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6ed05f-de9b-405c-a904-82b93bdba4fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:33.485444 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6ed05f-de9b-405c-a904-82b93bdba4fc admin admin] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:33.485728 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6ed05f-de9b-405c-a904-82b93bdba4fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:33.487672 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6ed05f-de9b-405c-a904-82b93bdba4fc admin admin] PATH_INFO: `/v3/users` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:33.489911 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6ed05f-de9b-405c-a904-82b93bdba4fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:33.495391 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6ed05f-de9b-405c-a904-82b93bdba4fc admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:33.522620 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f9e25e-4eeb-4fc0-a782-470b67c9d54d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:33.523310 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f9e25e-4eeb-4fc0-a782-470b67c9d54d admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:33.525476 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f9e25e-4eeb-4fc0-a782-470b67c9d54d admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:33.525759 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f9e25e-4eeb-4fc0-a782-470b67c9d54d admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:33.526414 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f9e25e-4eeb-4fc0-a782-470b67c9d54d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:33.532969 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f9e25e-4eeb-4fc0-a782-470b67c9d54d admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:33.578682 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1077/2173] 10.222.0.79 () {60 vars in 1144 bytes} [Tue Aug 30 01:14:33 2022] POST /identity/v3/users => generated 293 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:14:33.583804 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6ed05f-de9b-405c-a904-82b93bdba4fc admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:33.615608 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1097/2174] 10.222.0.79 () {60 vars in 1144 bytes} [Tue Aug 30 01:14:33 2022] POST /identity/v3/users => generated 286 bytes in 420 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:14:33.619984 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f9e25e-4eeb-4fc0-a782-470b67c9d54d admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:33.624390 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6ed05f-de9b-405c-a904-82b93bdba4fc admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:33.654838 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca215ce-0eb5-47e4-8135-7e0eebe9e061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:33.655521 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca215ce-0eb5-47e4-8135-7e0eebe9e061 admin admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:33.655799 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca215ce-0eb5-47e4-8135-7e0eebe9e061 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:33.656350 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca215ce-0eb5-47e4-8135-7e0eebe9e061 admin admin] PATH_INFO: `/v3/roles` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:33.657013 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca215ce-0eb5-47e4-8135-7e0eebe9e061 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:33.663823 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f9e25e-4eeb-4fc0-a782-470b67c9d54d admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:33.664670 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca215ce-0eb5-47e4-8135-7e0eebe9e061 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:33.680116 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cde5aac-443a-4fc6-afa5-fc1f8e7fe369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:33.680819 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cde5aac-443a-4fc6-afa5-fc1f8e7fe369 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:33.681098 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cde5aac-443a-4fc6-afa5-fc1f8e7fe369 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:33.681369 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cde5aac-443a-4fc6-afa5-fc1f8e7fe369 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:33.682427 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cde5aac-443a-4fc6-afa5-fc1f8e7fe369 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:33.685207 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cde5aac-443a-4fc6-afa5-fc1f8e7fe369 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:33.713277 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1078/2175] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:14:33 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:14:33.729135 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca215ce-0eb5-47e4-8135-7e0eebe9e061 admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:33.729571 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1098/2176] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:14:33 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:14:33.731297 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cde5aac-443a-4fc6-afa5-fc1f8e7fe369 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:33.745035 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cde5aac-443a-4fc6-afa5-fc1f8e7fe369 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:33.751425 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dda69eb-feff-434c-9ab7-529f2e2848d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:33.752559 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dda69eb-feff-434c-9ab7-529f2e2848d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:33.752847 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dda69eb-feff-434c-9ab7-529f2e2848d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:33.753118 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dda69eb-feff-434c-9ab7-529f2e2848d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:33.754027 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dda69eb-feff-434c-9ab7-529f2e2848d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:33.755957 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dda69eb-feff-434c-9ab7-529f2e2848d3 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:33.761011 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca215ce-0eb5-47e4-8135-7e0eebe9e061 admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:33.776085 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1099/2177] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:14:33 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:14:33.780584 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dda69eb-feff-434c-9ab7-529f2e2848d3 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:33.799043 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dda69eb-feff-434c-9ab7-529f2e2848d3 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:33.819910 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91abe8e-4d62-49e0-9c15-89395456c524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:33.820847 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91abe8e-4d62-49e0-9c15-89395456c524 admin admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:33.821536 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a201d491-f309-4f67-810a-3de0558d4ed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:33.821890 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91abe8e-4d62-49e0-9c15-89395456c524 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:33.822389 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a201d491-f309-4f67-810a-3de0558d4ed3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:33.822602 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a201d491-f309-4f67-810a-3de0558d4ed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:33.822887 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a201d491-f309-4f67-810a-3de0558d4ed3 admin admin] PATH_INFO: `/v3/projects/dc5a0aae4ebb49149548f253ae0be95b/users/d2558e0d9c5a4bd58380ae92bd9a282c/roles/c37945a17623465f899d4f217e7af593` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:33.823336 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91abe8e-4d62-49e0-9c15-89395456c524 admin admin] PATH_INFO: `/v3/roles` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:33.824188 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91abe8e-4d62-49e0-9c15-89395456c524 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:33.826019 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91abe8e-4d62-49e0-9c15-89395456c524 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:33.848014 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a201d491-f309-4f67-810a-3de0558d4ed3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc5a0aae4ebb49149548f253ae0be95b, user_id=d2558e0d9c5a4bd58380ae92bd9a282c, role_id=c37945a17623465f899d4f217e7af593)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:33.851807 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a201d491-f309-4f67-810a-3de0558d4ed3 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:33.855209 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1079/2178] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:14:33 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:14:33.861960 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91abe8e-4d62-49e0-9c15-89395456c524 admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:33.877968 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1100/2179] 10.222.0.79 () {60 vars in 1483 bytes} [Tue Aug 30 01:14:33 2022] PUT /identity/v3/projects/dc5a0aae4ebb49149548f253ae0be95b/users/d2558e0d9c5a4bd58380ae92bd9a282c/roles/c37945a17623465f899d4f217e7af593 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:14:33.883630 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46498ffb-5a34-4c7c-813c-398c0c360af8 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:33.884678 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46498ffb-5a34-4c7c-813c-398c0c360af8 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:33.885104 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46498ffb-5a34-4c7c-813c-398c0c360af8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:33.890895 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91abe8e-4d62-49e0-9c15-89395456c524 admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:33.976069 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-46498ffb-5a34-4c7c-813c-398c0c360af8 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:14:33.977529 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-46498ffb-5a34-4c7c-813c-398c0c360af8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:34.087324 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a397521d-42e4-4c1e-b9d2-ef171d00b429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:34.088333 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a397521d-42e4-4c1e-b9d2-ef171d00b429 admin admin] REQUEST_METHOD: `PUT` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:34.088761 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a397521d-42e4-4c1e-b9d2-ef171d00b429 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:34.089363 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a397521d-42e4-4c1e-b9d2-ef171d00b429 admin admin] PATH_INFO: `/v3/projects/5b2dec19b5f2406a88b95a5b192bbf8e/users/f44f185d29bb4d239b3d6d872d358c14/roles/c37945a17623465f899d4f217e7af593` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:34.137467 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a397521d-42e4-4c1e-b9d2-ef171d00b429 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b2dec19b5f2406a88b95a5b192bbf8e, user_id=f44f185d29bb4d239b3d6d872d358c14, role_id=c37945a17623465f899d4f217e7af593)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:34.148185 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1101/2180] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:14:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:14:34.158888 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a397521d-42e4-4c1e-b9d2-ef171d00b429 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:34.210418 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1080/2181] 10.222.0.79 () {60 vars in 1483 bytes} [Tue Aug 30 01:14:33 2022] PUT /identity/v3/projects/5b2dec19b5f2406a88b95a5b192bbf8e/users/f44f185d29bb4d239b3d6d872d358c14/roles/c37945a17623465f899d4f217e7af593 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:14:34.234533 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8081a36-8bb6-4d5b-8000-888c6f1466b1 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:34.234893 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8081a36-8bb6-4d5b-8000-888c6f1466b1 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:34.236353 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8081a36-8bb6-4d5b-8000-888c6f1466b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:34.266665 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a397521d-42e4-4c1e-b9d2-ef171d00b429 admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:34.269416 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-a397521d-42e4-4c1e-b9d2-ef171d00b429 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:34.308521 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-f8081a36-8bb6-4d5b-8000-888c6f1466b1 None None] MFA Rules not processed for user `f44f185d29bb4d239b3d6d872d358c14`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:14:34.309827 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-f8081a36-8bb6-4d5b-8000-888c6f1466b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:34.355305 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:14:34.365893 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:14:34.477948 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a397521d-42e4-4c1e-b9d2-ef171d00b429 admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:34.489378 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ee1833-50c8-45e7-ae07-c6fdee563222 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16e6a0ca26fc4ef892c188ad89a1e132', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:34.490026 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ee1833-50c8-45e7-ae07-c6fdee563222 service neutron] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:34.490337 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ee1833-50c8-45e7-ae07-c6fdee563222 service neutron] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:34.490671 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ee1833-50c8-45e7-ae07-c6fdee563222 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:34.502589 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1102/2182] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:14:34 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:14:34.503807 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8081a36-8bb6-4d5b-8000-888c6f1466b1 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:34.606327 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ee1833-50c8-45e7-ae07-c6fdee563222 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:34.608418 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ee1833-50c8-45e7-ae07-c6fdee563222 service neutron] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:34.634804 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1081/2183] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:14:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 01:14:34.712753 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8081a36-8bb6-4d5b-8000-888c6f1466b1 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:34.719061 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94bdb53-f448-45e0-a519-e57bb00eb305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:34.719724 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94bdb53-f448-45e0-a519-e57bb00eb305 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:34.720001 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94bdb53-f448-45e0-a519-e57bb00eb305 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:34.720273 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94bdb53-f448-45e0-a519-e57bb00eb305 admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:34.721573 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94bdb53-f448-45e0-a519-e57bb00eb305 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:34.723538 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94bdb53-f448-45e0-a519-e57bb00eb305 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:34.774381 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1103/2184] 10.222.0.79 () {60 vars in 1153 bytes} [Tue Aug 30 01:14:34 2022] POST /identity/v3/projects => generated 387 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:14:34.775247 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ee1833-50c8-45e7-ae07-c6fdee563222 service neutron] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:34.792019 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ee1833-50c8-45e7-ae07-c6fdee563222 service neutron] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:34.905638 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a43caf3-c8ee-4191-91fd-b2351feb2c77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:34.906269 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a43caf3-c8ee-4191-91fd-b2351feb2c77 admin admin] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:34.906686 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a43caf3-c8ee-4191-91fd-b2351feb2c77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:34.906958 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a43caf3-c8ee-4191-91fd-b2351feb2c77 admin admin] PATH_INFO: `/v3/users` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:34.907912 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a43caf3-c8ee-4191-91fd-b2351feb2c77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:34.911278 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a43caf3-c8ee-4191-91fd-b2351feb2c77 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:34.945349 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1082/2185] 10.222.0.79 () {60 vars in 1144 bytes} [Tue Aug 30 01:14:34 2022] POST /identity/v3/users => generated 300 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:14:34.948759 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94bdb53-f448-45e0-a519-e57bb00eb305 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:34.961704 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94bdb53-f448-45e0-a519-e57bb00eb305 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:34.976903 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302fe272-4821-4b94-98f1-d0b42ad21976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:34.977787 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302fe272-4821-4b94-98f1-d0b42ad21976 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:34.978140 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302fe272-4821-4b94-98f1-d0b42ad21976 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:34.978479 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302fe272-4821-4b94-98f1-d0b42ad21976 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:34.979707 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302fe272-4821-4b94-98f1-d0b42ad21976 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:34.985994 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302fe272-4821-4b94-98f1-d0b42ad21976 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:35.011812 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1104/2186] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:14:34 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:14:35.016256 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a43caf3-c8ee-4191-91fd-b2351feb2c77 admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:35.038512 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a43caf3-c8ee-4191-91fd-b2351feb2c77 admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:35.047521 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22dd5a5-b021-4807-910f-5a464a8c9484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:35.048413 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22dd5a5-b021-4807-910f-5a464a8c9484 admin admin] REQUEST_METHOD: `PUT` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:35.050768 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22dd5a5-b021-4807-910f-5a464a8c9484 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:35.051062 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22dd5a5-b021-4807-910f-5a464a8c9484 admin admin] PATH_INFO: `/v3/projects/26b0146fd353421e8f60fcac0d3a70a6/users/9f47fd3176e74c568801769f6f818c01/roles/d14c3070c9184d76a7b23df69bd3db07` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:35.104939 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22dd5a5-b021-4807-910f-5a464a8c9484 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26b0146fd353421e8f60fcac0d3a70a6, user_id=9f47fd3176e74c568801769f6f818c01, role_id=d14c3070c9184d76a7b23df69bd3db07)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:35.108856 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22dd5a5-b021-4807-910f-5a464a8c9484 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:35.138953 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1083/2187] 10.222.0.79 () {60 vars in 1483 bytes} [Tue Aug 30 01:14:35 2022] PUT /identity/v3/projects/26b0146fd353421e8f60fcac0d3a70a6/users/9f47fd3176e74c568801769f6f818c01/roles/d14c3070c9184d76a7b23df69bd3db07 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:14:35.140395 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302fe272-4821-4b94-98f1-d0b42ad21976 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:35.178076 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302fe272-4821-4b94-98f1-d0b42ad21976 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:35.292135 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fc3312-e054-4679-92cc-fedc9172440f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:35.292777 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fc3312-e054-4679-92cc-fedc9172440f admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:35.293056 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fc3312-e054-4679-92cc-fedc9172440f admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:35.295449 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fc3312-e054-4679-92cc-fedc9172440f admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:35.296140 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fc3312-e054-4679-92cc-fedc9172440f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:35.300270 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fc3312-e054-4679-92cc-fedc9172440f admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:35.326944 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1105/2188] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:14:35 2022] GET /identity/v3/roles => generated 1420 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:14:35.330760 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22dd5a5-b021-4807-910f-5a464a8c9484 admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:35.348757 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22dd5a5-b021-4807-910f-5a464a8c9484 admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:35.373414 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975256f7-96b7-4136-af1e-92a669a8e95b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:35.375027 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975256f7-96b7-4136-af1e-92a669a8e95b admin admin] REQUEST_METHOD: `PUT` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:35.375027 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975256f7-96b7-4136-af1e-92a669a8e95b admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:35.375453 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975256f7-96b7-4136-af1e-92a669a8e95b admin admin] PATH_INFO: `/v3/projects/26b0146fd353421e8f60fcac0d3a70a6/users/9f47fd3176e74c568801769f6f818c01/roles/d14c3070c9184d76a7b23df69bd3db07` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:35.379681 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975256f7-96b7-4136-af1e-92a669a8e95b admin admin] RBAC: Authorizing `identity:create_grant(project_id=26b0146fd353421e8f60fcac0d3a70a6, user_id=9f47fd3176e74c568801769f6f818c01, role_id=d14c3070c9184d76a7b23df69bd3db07)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:35.383613 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975256f7-96b7-4136-af1e-92a669a8e95b admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:35.409442 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1084/2189] 10.222.0.79 () {60 vars in 1483 bytes} [Tue Aug 30 01:14:35 2022] PUT /identity/v3/projects/26b0146fd353421e8f60fcac0d3a70a6/users/9f47fd3176e74c568801769f6f818c01/roles/d14c3070c9184d76a7b23df69bd3db07 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:14:35.411436 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cea1b0-f2f0-441a-aa9d-7c01ad644102 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:35.411912 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cea1b0-f2f0-441a-aa9d-7c01ad644102 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:35.412003 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cea1b0-f2f0-441a-aa9d-7c01ad644102 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:35.484858 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-63cea1b0-f2f0-441a-aa9d-7c01ad644102 None None] MFA Rules not processed for user `9f47fd3176e74c568801769f6f818c01`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:14:35.486425 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-63cea1b0-f2f0-441a-aa9d-7c01ad644102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:35.508120 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:14:35.658983 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1106/2190] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:14:35 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:14:35.669952 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975256f7-96b7-4136-af1e-92a669a8e95b admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:35.672092 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-975256f7-96b7-4136-af1e-92a669a8e95b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:35.745233 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:14:35.805771 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975256f7-96b7-4136-af1e-92a669a8e95b admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:35.813929 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e22756b-3d10-4921-8621-1a63f7efe8ea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f827c7670b74d938ffe066ced88d1c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:35.815387 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e22756b-3d10-4921-8621-1a63f7efe8ea service cinder] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:35.815682 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e22756b-3d10-4921-8621-1a63f7efe8ea service cinder] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:35.815957 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e22756b-3d10-4921-8621-1a63f7efe8ea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:35.839799 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e22756b-3d10-4921-8621-1a63f7efe8ea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:35.841320 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e22756b-3d10-4921-8621-1a63f7efe8ea service cinder] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:35.880958 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1085/2191] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:14:35 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:14:36.157546 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5a36dd-5511-4ff7-9349-208a344c9684 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:36.157901 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5a36dd-5511-4ff7-9349-208a344c9684 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:36.158875 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5a36dd-5511-4ff7-9349-208a344c9684 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:36.201853 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-4e5a36dd-5511-4ff7-9349-208a344c9684 None None] MFA Rules not processed for user `d2558e0d9c5a4bd58380ae92bd9a282c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:14:36.203463 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-4e5a36dd-5511-4ff7-9349-208a344c9684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:36.331351 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1107/2192] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:14:36 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:14:36.342230 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e22756b-3d10-4921-8621-1a63f7efe8ea service cinder] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:36.344955 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-5e22756b-3d10-4921-8621-1a63f7efe8ea service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:36.359572 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e22756b-3d10-4921-8621-1a63f7efe8ea service cinder] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:36.364011 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0e6e74-0d4a-4ee6-8b51-ceb911b5fcf7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f827c7670b74d938ffe066ced88d1c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:36.365266 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0e6e74-0d4a-4ee6-8b51-ceb911b5fcf7 service cinder] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:36.365538 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0e6e74-0d4a-4ee6-8b51-ceb911b5fcf7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:36.365799 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0e6e74-0d4a-4ee6-8b51-ceb911b5fcf7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:36.381810 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0e6e74-0d4a-4ee6-8b51-ceb911b5fcf7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:36.388263 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0e6e74-0d4a-4ee6-8b51-ceb911b5fcf7 service cinder] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:36.417672 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1086/2193] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:14:36 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:14:36.976311 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5a36dd-5511-4ff7-9349-208a344c9684 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:37.083912 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5a36dd-5511-4ff7-9349-208a344c9684 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:37.090774 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc00f9f4-b1f3-485f-80b3-1afb12f64f58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:37.091772 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc00f9f4-b1f3-485f-80b3-1afb12f64f58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:37.092063 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc00f9f4-b1f3-485f-80b3-1afb12f64f58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:37.092324 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc00f9f4-b1f3-485f-80b3-1afb12f64f58 admin admin] PATH_INFO: `/v3/users/f44f185d29bb4d239b3d6d872d358c14` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:37.093612 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc00f9f4-b1f3-485f-80b3-1afb12f64f58 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f44f185d29bb4d239b3d6d872d358c14)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:37.097534 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc00f9f4-b1f3-485f-80b3-1afb12f64f58 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:37.171095 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:14:37.190973 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-dc00f9f4-b1f3-485f-80b3-1afb12f64f58 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f44f185d29bb4d239b3d6d872d358c14'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:37.208254 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-dc00f9f4-b1f3-485f-80b3-1afb12f64f58 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f44f185d29bb4d239b3d6d872d358c14'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:37.245508 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-dc00f9f4-b1f3-485f-80b3-1afb12f64f58 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f44f185d29bb4d239b3d6d872d358c14'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:37.246635 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-dc00f9f4-b1f3-485f-80b3-1afb12f64f58 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f44f185d29bb4d239b3d6d872d358c14'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:37.296826 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-dc00f9f4-b1f3-485f-80b3-1afb12f64f58 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f44f185d29bb4d239b3d6d872d358c14'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:37.325968 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1108/2194] 10.222.0.79 () {58 vars in 1224 bytes} [Tue Aug 30 01:14:36 2022] DELETE /identity/v3/users/f44f185d29bb4d239b3d6d872d358c14 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:14:37.331263 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9b1678-f4ad-4f5a-b634-d6f67768d1af None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:37.331843 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9b1678-f4ad-4f5a-b634-d6f67768d1af None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:37.332298 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9b1678-f4ad-4f5a-b634-d6f67768d1af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:37.364111 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-4e9b1678-f4ad-4f5a-b634-d6f67768d1af None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:14:37.366297 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-4e9b1678-f4ad-4f5a-b634-d6f67768d1af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:37.538679 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1087/2195] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:14:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:14:37.568736 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc00f9f4-b1f3-485f-80b3-1afb12f64f58 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:37.570308 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-dc00f9f4-b1f3-485f-80b3-1afb12f64f58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:37.770627 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc00f9f4-b1f3-485f-80b3-1afb12f64f58 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:37.774520 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b14a679-f649-4b16-aaff-3c2592f774a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16e6a0ca26fc4ef892c188ad89a1e132', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:37.775433 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b14a679-f649-4b16-aaff-3c2592f774a4 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:37.775845 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b14a679-f649-4b16-aaff-3c2592f774a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:37.776178 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b14a679-f649-4b16-aaff-3c2592f774a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:37.788015 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b14a679-f649-4b16-aaff-3c2592f774a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:37.792541 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b14a679-f649-4b16-aaff-3c2592f774a4 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:37.808875 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1109/2196] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:14:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:14:38.130393 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053a2631-fcba-47ae-bbd4-2ebfb0c2a091 None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:38.130677 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053a2631-fcba-47ae-bbd4-2ebfb0c2a091 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:38.131115 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053a2631-fcba-47ae-bbd4-2ebfb0c2a091 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:38.159350 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-053a2631-fcba-47ae-bbd4-2ebfb0c2a091 None None] MFA Rules not processed for user `d2558e0d9c5a4bd58380ae92bd9a282c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:14:38.162021 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-053a2631-fcba-47ae-bbd4-2ebfb0c2a091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:38.278644 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1088/2197] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:14:38 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:14:38.467833 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b14a679-f649-4b16-aaff-3c2592f774a4 service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:38.469488 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-9b14a679-f649-4b16-aaff-3c2592f774a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:38.499894 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b14a679-f649-4b16-aaff-3c2592f774a4 service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:38.507992 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5c1fb3-1478-494c-b0d9-92fa1b190592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:38.509391 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5c1fb3-1478-494c-b0d9-92fa1b190592 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:38.509884 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5c1fb3-1478-494c-b0d9-92fa1b190592 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:38.510785 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5c1fb3-1478-494c-b0d9-92fa1b190592 admin admin] PATH_INFO: `/v3/projects/5b2dec19b5f2406a88b95a5b192bbf8e` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:38.512312 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5c1fb3-1478-494c-b0d9-92fa1b190592 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b2dec19b5f2406a88b95a5b192bbf8e)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:38.515775 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5c1fb3-1478-494c-b0d9-92fa1b190592 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:38.592440 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-bc5c1fb3-1478-494c-b0d9-92fa1b190592 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b2dec19b5f2406a88b95a5b192bbf8e', 'request_id': 'req-bc5c1fb3-1478-494c-b0d9-92fa1b190592'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:38.606401 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-bc5c1fb3-1478-494c-b0d9-92fa1b190592 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b2dec19b5f2406a88b95a5b192bbf8e', 'request_id': 'req-bc5c1fb3-1478-494c-b0d9-92fa1b190592'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:38.624169 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-bc5c1fb3-1478-494c-b0d9-92fa1b190592 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b2dec19b5f2406a88b95a5b192bbf8e', 'request_id': 'req-bc5c1fb3-1478-494c-b0d9-92fa1b190592'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:38.639301 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-bc5c1fb3-1478-494c-b0d9-92fa1b190592 admin admin] The token cache is being invalidate because project 5b2dec19b5f2406a88b95a5b192bbf8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:14:38.640142 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-bc5c1fb3-1478-494c-b0d9-92fa1b190592 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:38.641204 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-bc5c1fb3-1478-494c-b0d9-92fa1b190592 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:38.643638 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1110/2198] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 30 01:14:38 2022] DELETE /identity/v3/projects/5b2dec19b5f2406a88b95a5b192bbf8e => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:14:38.647922 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053a2631-fcba-47ae-bbd4-2ebfb0c2a091 None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:38.663473 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053a2631-fcba-47ae-bbd4-2ebfb0c2a091 None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:38.760033 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed80171-5bc1-4a5c-9de8-a4900a0e2f05 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:38.760033 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed80171-5bc1-4a5c-9de8-a4900a0e2f05 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:38.760033 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed80171-5bc1-4a5c-9de8-a4900a0e2f05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:38.768268 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a431ce4-1bd6-4995-acad-2f7951203761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:38.769400 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a431ce4-1bd6-4995-acad-2f7951203761 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:38.770117 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a431ce4-1bd6-4995-acad-2f7951203761 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:38.770398 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a431ce4-1bd6-4995-acad-2f7951203761 admin admin] PATH_INFO: `/v3/users/9f47fd3176e74c568801769f6f818c01` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:38.772186 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a431ce4-1bd6-4995-acad-2f7951203761 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f47fd3176e74c568801769f6f818c01)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:38.774420 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a431ce4-1bd6-4995-acad-2f7951203761 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:38.782201 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:14:38.905907 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-6ed80171-5bc1-4a5c-9de8-a4900a0e2f05 None None] MFA Rules not processed for user `6b69223792314981a27f7d20e8a56f23`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:14:38.907042 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-6ed80171-5bc1-4a5c-9de8-a4900a0e2f05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:38.935017 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-3a431ce4-1bd6-4995-acad-2f7951203761 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f47fd3176e74c568801769f6f818c01'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:38.949968 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-3a431ce4-1bd6-4995-acad-2f7951203761 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f47fd3176e74c568801769f6f818c01'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:38.973050 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-3a431ce4-1bd6-4995-acad-2f7951203761 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f47fd3176e74c568801769f6f818c01'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:38.974269 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-3a431ce4-1bd6-4995-acad-2f7951203761 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f47fd3176e74c568801769f6f818c01'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:38.995704 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-3a431ce4-1bd6-4995-acad-2f7951203761 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f47fd3176e74c568801769f6f818c01'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:39.009509 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1089/2199] 10.222.0.79 () {58 vars in 1224 bytes} [Tue Aug 30 01:14:38 2022] DELETE /identity/v3/users/9f47fd3176e74c568801769f6f818c01 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:14:39.026637 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:14:39.123862 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1111/2200] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:14:38 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 368 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:14:39.138367 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a431ce4-1bd6-4995-acad-2f7951203761 admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:39.158385 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-3a431ce4-1bd6-4995-acad-2f7951203761 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:39.272109 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a431ce4-1bd6-4995-acad-2f7951203761 admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:39.277165 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8222ac-5e2d-4512-abcf-624036f8b8e1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e37a5c33c064c488fd4667170f7703a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:39.278524 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8222ac-5e2d-4512-abcf-624036f8b8e1 service glance] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:39.279106 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8222ac-5e2d-4512-abcf-624036f8b8e1 service glance] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:39.279755 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8222ac-5e2d-4512-abcf-624036f8b8e1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:39.295594 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-1e8222ac-5e2d-4512-abcf-624036f8b8e1 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:39.447665 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8222ac-5e2d-4512-abcf-624036f8b8e1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:39.449234 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8222ac-5e2d-4512-abcf-624036f8b8e1 service glance] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:39.461050 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1090/2201] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:14:39 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:14:39.538745 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed80171-5bc1-4a5c-9de8-a4900a0e2f05 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:39.540239 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-6ed80171-5bc1-4a5c-9de8-a4900a0e2f05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:39.563931 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed80171-5bc1-4a5c-9de8-a4900a0e2f05 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:39.661325 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ec0c45-192d-43f1-81a0-95a222d5a09b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:39.662238 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ec0c45-192d-43f1-81a0-95a222d5a09b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:39.662815 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ec0c45-192d-43f1-81a0-95a222d5a09b admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:39.663346 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ec0c45-192d-43f1-81a0-95a222d5a09b admin admin] PATH_INFO: `/v3/projects/26b0146fd353421e8f60fcac0d3a70a6` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:39.666642 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ec0c45-192d-43f1-81a0-95a222d5a09b admin admin] RBAC: Authorizing `identity:delete_project(project_id=26b0146fd353421e8f60fcac0d3a70a6)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:39.682000 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ec0c45-192d-43f1-81a0-95a222d5a09b admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:39.770091 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab0b582-0803-45ed-adfc-fd251838342c None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:39.770616 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab0b582-0803-45ed-adfc-fd251838342c None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:39.770798 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab0b582-0803-45ed-adfc-fd251838342c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:39.788321 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-e5ec0c45-192d-43f1-81a0-95a222d5a09b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26b0146fd353421e8f60fcac0d3a70a6', 'request_id': 'req-e5ec0c45-192d-43f1-81a0-95a222d5a09b'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:39.797842 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-e5ec0c45-192d-43f1-81a0-95a222d5a09b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26b0146fd353421e8f60fcac0d3a70a6', 'request_id': 'req-e5ec0c45-192d-43f1-81a0-95a222d5a09b'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:39.804403 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-8ab0b582-0803-45ed-adfc-fd251838342c None None] MFA Rules not processed for user `5cacaed93420436e8f423f96a8041401`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:14:39.805884 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-8ab0b582-0803-45ed-adfc-fd251838342c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:39.807447 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-e5ec0c45-192d-43f1-81a0-95a222d5a09b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26b0146fd353421e8f60fcac0d3a70a6', 'request_id': 'req-e5ec0c45-192d-43f1-81a0-95a222d5a09b'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:39.828166 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-e5ec0c45-192d-43f1-81a0-95a222d5a09b admin admin] The token cache is being invalidate because project 26b0146fd353421e8f60fcac0d3a70a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:14:39.828611 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-e5ec0c45-192d-43f1-81a0-95a222d5a09b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:39.829704 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-e5ec0c45-192d-43f1-81a0-95a222d5a09b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:39.832791 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1112/2202] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 30 01:14:39 2022] DELETE /identity/v3/projects/26b0146fd353421e8f60fcac0d3a70a6 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:14:39.848316 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e620d9-dd00-4da8-94ad-bcd3764ed3e4 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:39.848767 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e620d9-dd00-4da8-94ad-bcd3764ed3e4 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:39.849141 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e620d9-dd00-4da8-94ad-bcd3764ed3e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:39.867358 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:14:39.896407 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-a3e620d9-dd00-4da8-94ad-bcd3764ed3e4 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:14:39.897616 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-a3e620d9-dd00-4da8-94ad-bcd3764ed3e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:39.906559 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1091/2203] 10.222.0.79 () {58 vars in 1009 bytes} [Tue Aug 30 01:14:39 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:14:39.964501 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab0b582-0803-45ed-adfc-fd251838342c None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:39.966088 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-8ab0b582-0803-45ed-adfc-fd251838342c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:40.007301 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1113/2204] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:14:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:14:40.018008 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc353186-9978-49d8-9de0-6ccea0986dd3 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:40.018467 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc353186-9978-49d8-9de0-6ccea0986dd3 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:40.018992 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc353186-9978-49d8-9de0-6ccea0986dd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:40.030011 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:14:40.048371 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-fc353186-9978-49d8-9de0-6ccea0986dd3 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:14:40.051333 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-fc353186-9978-49d8-9de0-6ccea0986dd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:40.065459 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1114/2205] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:14:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:14:40.070047 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc353186-9978-49d8-9de0-6ccea0986dd3 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:40.084068 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc353186-9978-49d8-9de0-6ccea0986dd3 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:40.090896 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2c3a12-5c73-4784-ae30-0dac8f97069b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:40.092236 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2c3a12-5c73-4784-ae30-0dac8f97069b admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:40.092538 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2c3a12-5c73-4784-ae30-0dac8f97069b admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:40.092799 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2c3a12-5c73-4784-ae30-0dac8f97069b admin admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:40.093653 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2c3a12-5c73-4784-ae30-0dac8f97069b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:14:40.093985 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2c3a12-5c73-4784-ae30-0dac8f97069b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:40.094530 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab0b582-0803-45ed-adfc-fd251838342c None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:40.096306 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2c3a12-5c73-4784-ae30-0dac8f97069b admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:40.104356 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7489804a-a9b4-4a32-9add-ad293834570c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd556fa6ba464928b1e067325792a523', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:40.105368 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7489804a-a9b4-4a32-9add-ad293834570c service swift] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:40.105857 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7489804a-a9b4-4a32-9add-ad293834570c service swift] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:40.106203 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7489804a-a9b4-4a32-9add-ad293834570c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:40.113111 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1115/2206] 10.222.0.79 () {58 vars in 1153 bytes} [Tue Aug 30 01:14:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:14:40.116203 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2c3a12-5c73-4784-ae30-0dac8f97069b admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:40.128473 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7489804a-a9b4-4a32-9add-ad293834570c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:40.133387 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7489804a-a9b4-4a32-9add-ad293834570c service swift] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:40.149141 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2c3a12-5c73-4784-ae30-0dac8f97069b admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:40.159486 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a114f5d5-352d-4441-b8f6-734ab15cc55f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:40.174785 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1092/2207] 10.222.0.79 () {60 vars in 1384 bytes} [Tue Aug 30 01:14:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 01:14:40.175629 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a114f5d5-352d-4441-b8f6-734ab15cc55f admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:40.176425 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a114f5d5-352d-4441-b8f6-734ab15cc55f admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:40.177246 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a114f5d5-352d-4441-b8f6-734ab15cc55f admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:40.180814 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a114f5d5-352d-4441-b8f6-734ab15cc55f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:40.188754 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a114f5d5-352d-4441-b8f6-734ab15cc55f admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:40.326073 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1116/2208] 10.222.0.79 () {60 vars in 1153 bytes} [Tue Aug 30 01:14:40 2022] POST /identity/v3/projects => generated 373 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:14:40.328174 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7489804a-a9b4-4a32-9add-ad293834570c service swift] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:40.360812 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7489804a-a9b4-4a32-9add-ad293834570c service swift] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:40.460789 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bc5866-ef9e-4af1-9973-d5a261947b48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:40.461563 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bc5866-ef9e-4af1-9973-d5a261947b48 admin admin] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:40.462564 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bc5866-ef9e-4af1-9973-d5a261947b48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:40.463189 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bc5866-ef9e-4af1-9973-d5a261947b48 admin admin] PATH_INFO: `/v3/users` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:40.465235 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bc5866-ef9e-4af1-9973-d5a261947b48 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:40.472135 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bc5866-ef9e-4af1-9973-d5a261947b48 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:40.504217 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1093/2209] 10.222.0.79 () {60 vars in 1144 bytes} [Tue Aug 30 01:14:40 2022] POST /identity/v3/users => generated 287 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:14:40.508183 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a114f5d5-352d-4441-b8f6-734ab15cc55f admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:40.563963 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a114f5d5-352d-4441-b8f6-734ab15cc55f admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:40.607353 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ecb8de-6016-42cd-a35a-c3deadac36e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:40.608233 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ecb8de-6016-42cd-a35a-c3deadac36e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:40.608656 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ecb8de-6016-42cd-a35a-c3deadac36e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:40.609099 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ecb8de-6016-42cd-a35a-c3deadac36e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:40.609911 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ecb8de-6016-42cd-a35a-c3deadac36e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:40.612767 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ecb8de-6016-42cd-a35a-c3deadac36e9 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:40.641402 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1117/2210] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:14:40 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 01:14:40.645606 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bc5866-ef9e-4af1-9973-d5a261947b48 admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:40.660882 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bc5866-ef9e-4af1-9973-d5a261947b48 admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:40.680437 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926904bb-d52b-46c7-a521-681a930a1fd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:40.681300 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926904bb-d52b-46c7-a521-681a930a1fd3 admin admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:40.681583 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926904bb-d52b-46c7-a521-681a930a1fd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:40.681859 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926904bb-d52b-46c7-a521-681a930a1fd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:40.682551 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926904bb-d52b-46c7-a521-681a930a1fd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:40.684481 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926904bb-d52b-46c7-a521-681a930a1fd3 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:40.718137 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1094/2211] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:14:40 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:14:40.722480 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ecb8de-6016-42cd-a35a-c3deadac36e9 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:40.739892 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ecb8de-6016-42cd-a35a-c3deadac36e9 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:40.778495 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef008039-3618-40d1-897f-4b6abe1b552c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:40.779212 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef008039-3618-40d1-897f-4b6abe1b552c admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:40.779488 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef008039-3618-40d1-897f-4b6abe1b552c admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:40.779756 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef008039-3618-40d1-897f-4b6abe1b552c admin admin] PATH_INFO: `/v3/projects/12819c9920614efcb7789d7855ca1807/users/44ae139eada3494a86345369149ad23b/roles/c37945a17623465f899d4f217e7af593` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:40.815032 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef008039-3618-40d1-897f-4b6abe1b552c admin admin] RBAC: Authorizing `identity:create_grant(project_id=12819c9920614efcb7789d7855ca1807, user_id=44ae139eada3494a86345369149ad23b, role_id=c37945a17623465f899d4f217e7af593)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:40.822212 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef008039-3618-40d1-897f-4b6abe1b552c admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:40.852031 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1118/2212] 10.222.0.79 () {60 vars in 1483 bytes} [Tue Aug 30 01:14:40 2022] PUT /identity/v3/projects/12819c9920614efcb7789d7855ca1807/users/44ae139eada3494a86345369149ad23b/roles/c37945a17623465f899d4f217e7af593 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:14:40.857091 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ea2517-412c-4a26-9b16-25798dc8046e None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:40.857528 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ea2517-412c-4a26-9b16-25798dc8046e None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:40.857623 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ea2517-412c-4a26-9b16-25798dc8046e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:40.901267 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-e7ea2517-412c-4a26-9b16-25798dc8046e None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:14:40.903798 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-e7ea2517-412c-4a26-9b16-25798dc8046e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:41.012116 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:14:41.037905 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1095/2213] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:14:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:14:41.044441 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef008039-3618-40d1-897f-4b6abe1b552c admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:41.046417 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-ef008039-3618-40d1-897f-4b6abe1b552c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:41.172975 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef008039-3618-40d1-897f-4b6abe1b552c admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:41.177909 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a4fcb4-ce4f-4428-8499-45f5d7e848b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16e6a0ca26fc4ef892c188ad89a1e132', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:41.178544 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a4fcb4-ce4f-4428-8499-45f5d7e848b0 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:41.178816 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a4fcb4-ce4f-4428-8499-45f5d7e848b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:41.179079 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a4fcb4-ce4f-4428-8499-45f5d7e848b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:41.200971 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a4fcb4-ce4f-4428-8499-45f5d7e848b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:41.204149 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a4fcb4-ce4f-4428-8499-45f5d7e848b0 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:41.238586 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1119/2214] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:14:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:14:42.810264 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ea2517-412c-4a26-9b16-25798dc8046e None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:42.812799 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-e7ea2517-412c-4a26-9b16-25798dc8046e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:42.833619 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ea2517-412c-4a26-9b16-25798dc8046e None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:42.839828 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11a7b4d-6d8a-44c0-b5e4-1957d250910e None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:42.839828 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11a7b4d-6d8a-44c0-b5e4-1957d250910e None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:42.839828 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11a7b4d-6d8a-44c0-b5e4-1957d250910e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:42.841376 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f12a49-12ea-43c5-91d7-865d02b4bcf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:42.857274 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f12a49-12ea-43c5-91d7-865d02b4bcf1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:42.857957 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f12a49-12ea-43c5-91d7-865d02b4bcf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:42.858632 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f12a49-12ea-43c5-91d7-865d02b4bcf1 admin admin] PATH_INFO: `/v3/users/a9659e2959714d22911379452031d7e6` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:42.863805 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f12a49-12ea-43c5-91d7-865d02b4bcf1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9659e2959714d22911379452031d7e6)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:42.866512 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f12a49-12ea-43c5-91d7-865d02b4bcf1 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:42.928839 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-e11a7b4d-6d8a-44c0-b5e4-1957d250910e None None] MFA Rules not processed for user `44ae139eada3494a86345369149ad23b`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:14:42.932713 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-e11a7b4d-6d8a-44c0-b5e4-1957d250910e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:43.054860 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-94f12a49-12ea-43c5-91d7-865d02b4bcf1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9659e2959714d22911379452031d7e6'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:43.093477 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-94f12a49-12ea-43c5-91d7-865d02b4bcf1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9659e2959714d22911379452031d7e6'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:43.150453 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-94f12a49-12ea-43c5-91d7-865d02b4bcf1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9659e2959714d22911379452031d7e6'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:43.151419 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-94f12a49-12ea-43c5-91d7-865d02b4bcf1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9659e2959714d22911379452031d7e6'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:43.177843 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-94f12a49-12ea-43c5-91d7-865d02b4bcf1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9659e2959714d22911379452031d7e6'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:43.207750 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1096/2215] 10.222.0.79 () {58 vars in 1224 bytes} [Tue Aug 30 01:14:42 2022] DELETE /identity/v3/users/a9659e2959714d22911379452031d7e6 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:14:43.212754 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7b4e72-7a1d-4c1d-85ff-bdb43a61aac5 None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:43.213702 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7b4e72-7a1d-4c1d-85ff-bdb43a61aac5 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:43.213990 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7b4e72-7a1d-4c1d-85ff-bdb43a61aac5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:43.258935 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1120/2216] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:14:42 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 419 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:14:43.261339 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11a7b4d-6d8a-44c0-b5e4-1957d250910e None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:43.262955 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-e11a7b4d-6d8a-44c0-b5e4-1957d250910e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:43.294589 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-7a7b4e72-7a1d-4c1d-85ff-bdb43a61aac5 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:14:43.296633 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-7a7b4e72-7a1d-4c1d-85ff-bdb43a61aac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:43.307971 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11a7b4d-6d8a-44c0-b5e4-1957d250910e None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:43.370435 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:14:43.554177 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1097/2217] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:14:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 346 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:14:43.561757 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf7cd7c-8906-4992-853f-f09c2d273ef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:43.567586 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7b4e72-7a1d-4c1d-85ff-bdb43a61aac5 None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:43.571693 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf7cd7c-8906-4992-853f-f09c2d273ef4 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:43.572087 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf7cd7c-8906-4992-853f-f09c2d273ef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:43.573296 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf7cd7c-8906-4992-853f-f09c2d273ef4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:43.574186 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-7a7b4e72-7a1d-4c1d-85ff-bdb43a61aac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:43.574947 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf7cd7c-8906-4992-853f-f09c2d273ef4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:43.581675 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf7cd7c-8906-4992-853f-f09c2d273ef4 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:43.645688 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1121/2218] 10.222.0.79 () {60 vars in 1153 bytes} [Tue Aug 30 01:14:43 2022] POST /identity/v3/projects => generated 371 bytes in 385 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:14:43.649449 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf7cd7c-8906-4992-853f-f09c2d273ef4 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:43.745997 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7b4e72-7a1d-4c1d-85ff-bdb43a61aac5 None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:43.777516 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:14:43.850049 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf7cd7c-8906-4992-853f-f09c2d273ef4 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:43.872892 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33a1863-fd59-4bf5-a8b2-6a26bbbfd57f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:43.873569 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33a1863-fd59-4bf5-a8b2-6a26bbbfd57f admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:43.873856 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33a1863-fd59-4bf5-a8b2-6a26bbbfd57f admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:43.878766 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33a1863-fd59-4bf5-a8b2-6a26bbbfd57f admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:43.879537 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33a1863-fd59-4bf5-a8b2-6a26bbbfd57f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:43.887409 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33a1863-fd59-4bf5-a8b2-6a26bbbfd57f admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:43.918206 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ef055d-6511-4733-a911-0ad640215b31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16e6a0ca26fc4ef892c188ad89a1e132', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:43.920894 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ef055d-6511-4733-a911-0ad640215b31 service neutron] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:43.921250 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ef055d-6511-4733-a911-0ad640215b31 service neutron] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:43.922513 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ef055d-6511-4733-a911-0ad640215b31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:43.974655 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ef055d-6511-4733-a911-0ad640215b31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:43.978403 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1122/2219] 10.222.0.79 () {60 vars in 1144 bytes} [Tue Aug 30 01:14:43 2022] POST /identity/v3/users => generated 292 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:14:43.978993 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ef055d-6511-4733-a911-0ad640215b31 service neutron] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:43.980576 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33a1863-fd59-4bf5-a8b2-6a26bbbfd57f admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:44.019670 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33a1863-fd59-4bf5-a8b2-6a26bbbfd57f admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:44.022515 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1098/2220] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:14:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:14:44.032380 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe86e2ac-e155-43be-9399-2ba9ad7d2328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:44.033077 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe86e2ac-e155-43be-9399-2ba9ad7d2328 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:44.033534 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe86e2ac-e155-43be-9399-2ba9ad7d2328 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:44.033987 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe86e2ac-e155-43be-9399-2ba9ad7d2328 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:44.034665 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe86e2ac-e155-43be-9399-2ba9ad7d2328 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:44.041702 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe86e2ac-e155-43be-9399-2ba9ad7d2328 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:44.067260 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1123/2221] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:14:43 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:14:44.068770 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ef055d-6511-4733-a911-0ad640215b31 service neutron] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:44.083234 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ef055d-6511-4733-a911-0ad640215b31 service neutron] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:44.097620 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d60bba1-f035-41e8-9726-1ade3561ffd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:44.098753 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d60bba1-f035-41e8-9726-1ade3561ffd6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:44.099854 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d60bba1-f035-41e8-9726-1ade3561ffd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:44.100299 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d60bba1-f035-41e8-9726-1ade3561ffd6 admin admin] PATH_INFO: `/v3/projects/0ed9948bd4764c1aba70889f5198b7db/users/fdb5f9a79141449b9284a9546b1e8291/roles/d14c3070c9184d76a7b23df69bd3db07` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:44.142906 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d60bba1-f035-41e8-9726-1ade3561ffd6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ed9948bd4764c1aba70889f5198b7db, user_id=fdb5f9a79141449b9284a9546b1e8291, role_id=d14c3070c9184d76a7b23df69bd3db07)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:44.146128 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d60bba1-f035-41e8-9726-1ade3561ffd6 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:44.177270 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1099/2222] 10.222.0.79 () {60 vars in 1483 bytes} [Tue Aug 30 01:14:44 2022] PUT /identity/v3/projects/0ed9948bd4764c1aba70889f5198b7db/users/fdb5f9a79141449b9284a9546b1e8291/roles/d14c3070c9184d76a7b23df69bd3db07 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:14:44.181014 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe86e2ac-e155-43be-9399-2ba9ad7d2328 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:44.212153 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe86e2ac-e155-43be-9399-2ba9ad7d2328 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:44.388465 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52f5d03-ff64-40fb-bce5-48a0ce01d51f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:44.392857 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52f5d03-ff64-40fb-bce5-48a0ce01d51f admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:44.395300 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52f5d03-ff64-40fb-bce5-48a0ce01d51f admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:44.396129 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52f5d03-ff64-40fb-bce5-48a0ce01d51f admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:44.397811 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52f5d03-ff64-40fb-bce5-48a0ce01d51f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:44.405898 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52f5d03-ff64-40fb-bce5-48a0ce01d51f admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:44.445630 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1124/2223] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:14:44 2022] GET /identity/v3/roles => generated 1420 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:14:44.449807 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d60bba1-f035-41e8-9726-1ade3561ffd6 admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:44.477947 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d60bba1-f035-41e8-9726-1ade3561ffd6 admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:44.491406 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85b22e5-906c-49d7-9a66-aeb08943e8b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:44.492880 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85b22e5-906c-49d7-9a66-aeb08943e8b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:44.493792 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85b22e5-906c-49d7-9a66-aeb08943e8b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:44.494845 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85b22e5-906c-49d7-9a66-aeb08943e8b7 admin admin] PATH_INFO: `/v3/projects/0ed9948bd4764c1aba70889f5198b7db/users/fdb5f9a79141449b9284a9546b1e8291/roles/d14c3070c9184d76a7b23df69bd3db07` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:44.500542 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85b22e5-906c-49d7-9a66-aeb08943e8b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ed9948bd4764c1aba70889f5198b7db, user_id=fdb5f9a79141449b9284a9546b1e8291, role_id=d14c3070c9184d76a7b23df69bd3db07)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:44.507364 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85b22e5-906c-49d7-9a66-aeb08943e8b7 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:44.538003 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1100/2224] 10.222.0.79 () {60 vars in 1483 bytes} [Tue Aug 30 01:14:44 2022] PUT /identity/v3/projects/0ed9948bd4764c1aba70889f5198b7db/users/fdb5f9a79141449b9284a9546b1e8291/roles/d14c3070c9184d76a7b23df69bd3db07 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:14:44.925638 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52f5d03-ff64-40fb-bce5-48a0ce01d51f admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:44.930752 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-d52f5d03-ff64-40fb-bce5-48a0ce01d51f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:44.960890 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52f5d03-ff64-40fb-bce5-48a0ce01d51f admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:45.026482 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:14:45.143629 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c0e7f9-55d8-4db6-992c-17d139216c6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:45.144616 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c0e7f9-55d8-4db6-992c-17d139216c6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:45.145117 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c0e7f9-55d8-4db6-992c-17d139216c6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:45.145572 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c0e7f9-55d8-4db6-992c-17d139216c6d admin admin] PATH_INFO: `/v3/projects/5b2bd00730ab43118d77d874c9c131df` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:45.149928 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c0e7f9-55d8-4db6-992c-17d139216c6d admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b2bd00730ab43118d77d874c9c131df)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:45.152380 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c0e7f9-55d8-4db6-992c-17d139216c6d admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:45.295799 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-f5c0e7f9-55d8-4db6-992c-17d139216c6d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b2bd00730ab43118d77d874c9c131df', 'request_id': 'req-f5c0e7f9-55d8-4db6-992c-17d139216c6d'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:45.313425 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-f5c0e7f9-55d8-4db6-992c-17d139216c6d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b2bd00730ab43118d77d874c9c131df', 'request_id': 'req-f5c0e7f9-55d8-4db6-992c-17d139216c6d'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:45.330658 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-f5c0e7f9-55d8-4db6-992c-17d139216c6d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b2bd00730ab43118d77d874c9c131df', 'request_id': 'req-f5c0e7f9-55d8-4db6-992c-17d139216c6d'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:45.354221 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-f5c0e7f9-55d8-4db6-992c-17d139216c6d admin admin] The token cache is being invalidate because project 5b2bd00730ab43118d77d874c9c131df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:14:45.354588 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-f5c0e7f9-55d8-4db6-992c-17d139216c6d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:45.356805 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-f5c0e7f9-55d8-4db6-992c-17d139216c6d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:45.358707 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1125/2225] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 30 01:14:44 2022] DELETE /identity/v3/projects/5b2bd00730ab43118d77d874c9c131df => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:14:47.477281 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02305694-7f82-489f-9969-12bce2555939 None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:47.477886 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02305694-7f82-489f-9969-12bce2555939 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:47.478150 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02305694-7f82-489f-9969-12bce2555939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:47.524147 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-02305694-7f82-489f-9969-12bce2555939 None None] MFA Rules not processed for user `fdb5f9a79141449b9284a9546b1e8291`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:14:47.525479 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-02305694-7f82-489f-9969-12bce2555939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:47.713248 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1101/2226] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:14:47 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:14:47.724430 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f017e4-faff-46ad-a07f-48833175c123 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:47.724984 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f017e4-faff-46ad-a07f-48833175c123 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:47.724984 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f017e4-faff-46ad-a07f-48833175c123 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:47.794639 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-05f017e4-faff-46ad-a07f-48833175c123 None None] MFA Rules not processed for user `44ae139eada3494a86345369149ad23b`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:14:47.795947 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-05f017e4-faff-46ad-a07f-48833175c123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:47.893625 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1126/2227] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:14:47 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:14:47.909115 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02305694-7f82-489f-9969-12bce2555939 None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:47.910686 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-02305694-7f82-489f-9969-12bce2555939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:48.060301 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02305694-7f82-489f-9969-12bce2555939 None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:48.070004 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1b95e7-e271-49c1-b341-53e070f63c20 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6480b2f14c37474c89df9fba48f7cd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:48.071567 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1b95e7-e271-49c1-b341-53e070f63c20 service nova] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:48.072108 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1b95e7-e271-49c1-b341-53e070f63c20 service nova] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:48.072593 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1b95e7-e271-49c1-b341-53e070f63c20 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:48.074923 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-9a1b95e7-e271-49c1-b341-53e070f63c20 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:48.098867 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:14:48.118406 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1b95e7-e271-49c1-b341-53e070f63c20 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:48.131507 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1b95e7-e271-49c1-b341-53e070f63c20 service nova] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:48.151902 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1102/2228] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:14:47 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:14:52.727968 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c62018-ff78-46e5-9875-f92a6315981e None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:52.728862 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c62018-ff78-46e5-9875-f92a6315981e None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:52.729285 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c62018-ff78-46e5-9875-f92a6315981e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:52.758285 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-b6c62018-ff78-46e5-9875-f92a6315981e None None] MFA Rules not processed for user `3ddcdbd4269c44c9b9e8d1c109de061f`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:14:52.759944 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-b6c62018-ff78-46e5-9875-f92a6315981e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:52.836304 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:14:52.859916 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1127/2229] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:14:52 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:14:57.729772 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befe745e-fb53-4d65-8bf9-9b59473d0cfa None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:57.730352 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befe745e-fb53-4d65-8bf9-9b59473d0cfa None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:57.730352 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befe745e-fb53-4d65-8bf9-9b59473d0cfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:57.753547 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-befe745e-fb53-4d65-8bf9-9b59473d0cfa None None] MFA Rules not processed for user `ae567fa8585940bf98167103a86734de`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:14:57.754750 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-befe745e-fb53-4d65-8bf9-9b59473d0cfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:57.816822 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1103/2230] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:14:57 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:15:02.852420 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:04.345247 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da542da-51cf-4ea8-b8c7-ea5e5e81cfde None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:04.345874 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da542da-51cf-4ea8-b8c7-ea5e5e81cfde None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:04.345874 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da542da-51cf-4ea8-b8c7-ea5e5e81cfde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:04.386061 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-1da542da-51cf-4ea8-b8c7-ea5e5e81cfde None None] MFA Rules not processed for user `5cacaed93420436e8f423f96a8041401`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:15:04.387581 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-1da542da-51cf-4ea8-b8c7-ea5e5e81cfde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:04.455121 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1128/2231] 10.222.0.79 () {58 vars in 1009 bytes} [Tue Aug 30 01:15:04 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:15:04.472401 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befe745e-fb53-4d65-8bf9-9b59473d0cfa None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:04.474176 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-befe745e-fb53-4d65-8bf9-9b59473d0cfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:04.555828 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befe745e-fb53-4d65-8bf9-9b59473d0cfa None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:04.562206 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9349536-2854-4f21-b3f5-18da1f8a1616 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd556fa6ba464928b1e067325792a523', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:04.563103 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9349536-2854-4f21-b3f5-18da1f8a1616 service swift] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:04.564025 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9349536-2854-4f21-b3f5-18da1f8a1616 service swift] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:04.564509 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9349536-2854-4f21-b3f5-18da1f8a1616 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:04.574532 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9349536-2854-4f21-b3f5-18da1f8a1616 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:04.576574 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9349536-2854-4f21-b3f5-18da1f8a1616 service swift] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:04.588689 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1104/2232] 10.222.0.79 () {60 vars in 1384 bytes} [Tue Aug 30 01:15:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 01:15:05.579935 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df43fe1-ecf2-4b45-9c91-afd83d3de3e5 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:05.580494 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df43fe1-ecf2-4b45-9c91-afd83d3de3e5 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:05.580842 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df43fe1-ecf2-4b45-9c91-afd83d3de3e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:05.645438 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9349536-2854-4f21-b3f5-18da1f8a1616 service swift] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:05.646105 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-0df43fe1-ecf2-4b45-9c91-afd83d3de3e5 None None] MFA Rules not processed for user `d2558e0d9c5a4bd58380ae92bd9a282c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:15:05.647440 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-0df43fe1-ecf2-4b45-9c91-afd83d3de3e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:05.647833 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-e9349536-2854-4f21-b3f5-18da1f8a1616 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:05.757948 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1129/2233] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:15:05 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:15:05.784344 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9349536-2854-4f21-b3f5-18da1f8a1616 service swift] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:05.793767 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ca3359-5236-4e29-a933-eaebae6148b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f827c7670b74d938ffe066ced88d1c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:05.794380 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ca3359-5236-4e29-a933-eaebae6148b3 service cinder] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:05.794659 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ca3359-5236-4e29-a933-eaebae6148b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:05.795050 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ca3359-5236-4e29-a933-eaebae6148b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:05.812862 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ca3359-5236-4e29-a933-eaebae6148b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:05.815539 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ca3359-5236-4e29-a933-eaebae6148b3 service cinder] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:05.828718 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1105/2234] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:15:05 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:15:15.742295 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=50 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:15.832077 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=86 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:22.084757 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc16591-701e-4fef-98d0-92b84392f135 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:22.085216 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc16591-701e-4fef-98d0-92b84392f135 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:22.085216 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc16591-701e-4fef-98d0-92b84392f135 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:22.116979 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-3dc16591-701e-4fef-98d0-92b84392f135 None None] MFA Rules not processed for user `5cacaed93420436e8f423f96a8041401`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:15:22.118616 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-3dc16591-701e-4fef-98d0-92b84392f135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:22.129819 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1130/2235] 10.222.0.79 () {58 vars in 1009 bytes} [Tue Aug 30 01:15:22 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:15:22.147838 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ca3359-5236-4e29-a933-eaebae6148b3 service cinder] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:22.170988 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ca3359-5236-4e29-a933-eaebae6148b3 service cinder] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:22.187018 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a353ea-75a1-461f-bada-127077b9f039 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd556fa6ba464928b1e067325792a523', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:22.187681 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a353ea-75a1-461f-bada-127077b9f039 service swift] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:22.188146 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a353ea-75a1-461f-bada-127077b9f039 service swift] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:22.188426 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a353ea-75a1-461f-bada-127077b9f039 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:22.209543 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a353ea-75a1-461f-bada-127077b9f039 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:22.211450 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a353ea-75a1-461f-bada-127077b9f039 service swift] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:22.223489 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1106/2236] 10.222.0.79 () {60 vars in 1384 bytes} [Tue Aug 30 01:15:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 01:15:23.359411 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03e6465-f4e8-4093-9b56-7a763c2d415c None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:23.361015 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03e6465-f4e8-4093-9b56-7a763c2d415c None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:23.361638 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03e6465-f4e8-4093-9b56-7a763c2d415c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:23.394709 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-e03e6465-f4e8-4093-9b56-7a763c2d415c None None] MFA Rules not processed for user `3f1b91d3b73646c58cb2f49b416961f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:15:23.396525 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-e03e6465-f4e8-4093-9b56-7a763c2d415c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:23.524172 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1131/2237] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:15:23 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:15:32.217107 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=6 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:33.507044 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=28 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:39.324559 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a353ea-75a1-461f-bada-127077b9f039 service swift] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:39.326103 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-03a353ea-75a1-461f-bada-127077b9f039 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:39.397545 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a353ea-75a1-461f-bada-127077b9f039 service swift] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:39.401260 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4382f9-7a4a-4a1a-8768-9d590a0c4f97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16e6a0ca26fc4ef892c188ad89a1e132', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:39.401861 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4382f9-7a4a-4a1a-8768-9d590a0c4f97 service neutron] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:39.402130 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4382f9-7a4a-4a1a-8768-9d590a0c4f97 service neutron] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:39.402394 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4382f9-7a4a-4a1a-8768-9d590a0c4f97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:39.404617 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-0d4382f9-7a4a-4a1a-8768-9d590a0c4f97 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:39.475809 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4382f9-7a4a-4a1a-8768-9d590a0c4f97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:39.477234 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4382f9-7a4a-4a1a-8768-9d590a0c4f97 service neutron] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:39.487434 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1107/2238] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:15:39 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:15:39.902311 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c296889d-dfeb-4c6a-af95-c17a1d771a5e None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:39.902874 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c296889d-dfeb-4c6a-af95-c17a1d771a5e None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:39.903716 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c296889d-dfeb-4c6a-af95-c17a1d771a5e None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:39.906759 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1132/2239] 10.222.0.79 () {54 vars in 921 bytes} [Tue Aug 30 01:15:39 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 01:15:39.948085 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a33e54c-bbb9-48a6-ab4e-157944ad4535 None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:39.948671 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a33e54c-bbb9-48a6-ab4e-157944ad4535 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:39.949372 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a33e54c-bbb9-48a6-ab4e-157944ad4535 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:39.986018 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-4a33e54c-bbb9-48a6-ab4e-157944ad4535 None None] MFA Rules not processed for user `d68e91e4259e449797fb83de548aec1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:15:39.987688 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-4a33e54c-bbb9-48a6-ab4e-157944ad4535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:40.103208 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c296889d-dfeb-4c6a-af95-c17a1d771a5e None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:40.106525 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-c296889d-dfeb-4c6a-af95-c17a1d771a5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:40.116790 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1108/2240] 10.222.0.79 () {58 vars in 1018 bytes} [Tue Aug 30 01:15:39 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:15:40.144437 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa850be-5f18-4d64-aafd-52ce4d47eba9 None None] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:40.144910 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa850be-5f18-4d64-aafd-52ce4d47eba9 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:40.145305 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa850be-5f18-4d64-aafd-52ce4d47eba9 None None] PATH_INFO: `/` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:40.157545 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1109/2241] 10.222.0.79 () {54 vars in 961 bytes} [Tue Aug 30 01:15:40 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 01:15:40.159353 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bde51b-1e5c-4883-8b23-51fb24d03889 None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:40.159773 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bde51b-1e5c-4883-8b23-51fb24d03889 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:40.160196 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bde51b-1e5c-4883-8b23-51fb24d03889 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:40.190749 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-a1bde51b-1e5c-4883-8b23-51fb24d03889 None None] MFA Rules not processed for user `d68e91e4259e449797fb83de548aec1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:15:40.192398 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-a1bde51b-1e5c-4883-8b23-51fb24d03889 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:40.210846 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1110/2242] 10.222.0.79 () {58 vars in 1058 bytes} [Tue Aug 30 01:15:40 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:15:40.212097 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bde51b-1e5c-4883-8b23-51fb24d03889 None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:40.236907 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bde51b-1e5c-4883-8b23-51fb24d03889 None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:40.255850 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92e25c2-3b2f-4aaf-990e-a6978c3b68c2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd68e91e4259e449797fb83de548aec1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:40.256630 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92e25c2-3b2f-4aaf-990e-a6978c3b68c2 service placement] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:40.257526 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92e25c2-3b2f-4aaf-990e-a6978c3b68c2 service placement] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:40.257808 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92e25c2-3b2f-4aaf-990e-a6978c3b68c2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:40.262654 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c296889d-dfeb-4c6a-af95-c17a1d771a5e None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:40.269233 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d313dcb-9fc5-44d1-8ecc-7f932f768a0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:40.270065 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d313dcb-9fc5-44d1-8ecc-7f932f768a0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:40.270531 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d313dcb-9fc5-44d1-8ecc-7f932f768a0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:40.270967 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d313dcb-9fc5-44d1-8ecc-7f932f768a0a admin admin] PATH_INFO: `/v3/users/44ae139eada3494a86345369149ad23b` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:40.273483 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d313dcb-9fc5-44d1-8ecc-7f932f768a0a admin admin] RBAC: Authorizing `identity:delete_user(user_id=44ae139eada3494a86345369149ad23b)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:40.276743 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d313dcb-9fc5-44d1-8ecc-7f932f768a0a admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:40.279241 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92e25c2-3b2f-4aaf-990e-a6978c3b68c2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:40.280841 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92e25c2-3b2f-4aaf-990e-a6978c3b68c2 service placement] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:40.301482 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1111/2243] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:15:40 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:15:40.387920 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-5d313dcb-9fc5-44d1-8ecc-7f932f768a0a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44ae139eada3494a86345369149ad23b'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:40.409545 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-5d313dcb-9fc5-44d1-8ecc-7f932f768a0a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44ae139eada3494a86345369149ad23b'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:40.418585 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-5d313dcb-9fc5-44d1-8ecc-7f932f768a0a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44ae139eada3494a86345369149ad23b'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:40.419357 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-5d313dcb-9fc5-44d1-8ecc-7f932f768a0a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44ae139eada3494a86345369149ad23b'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:40.444630 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-5d313dcb-9fc5-44d1-8ecc-7f932f768a0a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44ae139eada3494a86345369149ad23b'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:40.451986 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1133/2244] 10.222.0.79 () {58 vars in 1224 bytes} [Tue Aug 30 01:15:40 2022] DELETE /identity/v3/users/44ae139eada3494a86345369149ad23b => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:15:40.810510 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92e25c2-3b2f-4aaf-990e-a6978c3b68c2 service placement] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:40.827547 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92e25c2-3b2f-4aaf-990e-a6978c3b68c2 service placement] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:40.871536 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:40.931527 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b786d3-4cc2-4175-a334-b9e05af84c31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:40.932542 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b786d3-4cc2-4175-a334-b9e05af84c31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:40.933056 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b786d3-4cc2-4175-a334-b9e05af84c31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:40.933569 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b786d3-4cc2-4175-a334-b9e05af84c31 admin admin] PATH_INFO: `/v3/projects/12819c9920614efcb7789d7855ca1807` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:40.935831 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b786d3-4cc2-4175-a334-b9e05af84c31 admin admin] RBAC: Authorizing `identity:delete_project(project_id=12819c9920614efcb7789d7855ca1807)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:40.940372 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b786d3-4cc2-4175-a334-b9e05af84c31 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:41.019304 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-18b786d3-4cc2-4175-a334-b9e05af84c31 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12819c9920614efcb7789d7855ca1807', 'request_id': 'req-18b786d3-4cc2-4175-a334-b9e05af84c31'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:41.032527 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-18b786d3-4cc2-4175-a334-b9e05af84c31 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12819c9920614efcb7789d7855ca1807', 'request_id': 'req-18b786d3-4cc2-4175-a334-b9e05af84c31'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:41.044882 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-18b786d3-4cc2-4175-a334-b9e05af84c31 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12819c9920614efcb7789d7855ca1807', 'request_id': 'req-18b786d3-4cc2-4175-a334-b9e05af84c31'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:41.061088 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-18b786d3-4cc2-4175-a334-b9e05af84c31 admin admin] The token cache is being invalidate because project 12819c9920614efcb7789d7855ca1807 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81998) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:15:41.061433 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-18b786d3-4cc2-4175-a334-b9e05af84c31 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:41.062725 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-18b786d3-4cc2-4175-a334-b9e05af84c31 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:41.064729 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1112/2245] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 30 01:15:40 2022] DELETE /identity/v3/projects/12819c9920614efcb7789d7855ca1807 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:15:41.070143 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d313dcb-9fc5-44d1-8ecc-7f932f768a0a admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:41.072119 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-5d313dcb-9fc5-44d1-8ecc-7f932f768a0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:41.090785 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d313dcb-9fc5-44d1-8ecc-7f932f768a0a admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:41.156802 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb5e769-9766-4087-ac6e-873f093d6a22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:41.157707 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb5e769-9766-4087-ac6e-873f093d6a22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:41.158071 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb5e769-9766-4087-ac6e-873f093d6a22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:41.158457 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb5e769-9766-4087-ac6e-873f093d6a22 admin admin] PATH_INFO: `/v3/users/fdb5f9a79141449b9284a9546b1e8291` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:41.159870 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb5e769-9766-4087-ac6e-873f093d6a22 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fdb5f9a79141449b9284a9546b1e8291)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:41.161918 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb5e769-9766-4087-ac6e-873f093d6a22 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:41.191150 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:41.228409 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-1fb5e769-9766-4087-ac6e-873f093d6a22 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fdb5f9a79141449b9284a9546b1e8291'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:41.237214 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-1fb5e769-9766-4087-ac6e-873f093d6a22 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fdb5f9a79141449b9284a9546b1e8291'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:41.250641 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-1fb5e769-9766-4087-ac6e-873f093d6a22 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fdb5f9a79141449b9284a9546b1e8291'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:41.251584 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-1fb5e769-9766-4087-ac6e-873f093d6a22 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fdb5f9a79141449b9284a9546b1e8291'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:41.266278 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-1fb5e769-9766-4087-ac6e-873f093d6a22 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fdb5f9a79141449b9284a9546b1e8291'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:41.273413 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1134/2246] 10.222.0.79 () {58 vars in 1224 bytes} [Tue Aug 30 01:15:41 2022] DELETE /identity/v3/users/fdb5f9a79141449b9284a9546b1e8291 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:15:41.738564 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b786d3-4cc2-4175-a334-b9e05af84c31 admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:41.741249 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-18b786d3-4cc2-4175-a334-b9e05af84c31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:41.772517 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b786d3-4cc2-4175-a334-b9e05af84c31 admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:41.881728 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21676748-c295-4092-9762-23c57ae41a96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:41.882710 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21676748-c295-4092-9762-23c57ae41a96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:41.883209 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21676748-c295-4092-9762-23c57ae41a96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:41.883672 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21676748-c295-4092-9762-23c57ae41a96 admin admin] PATH_INFO: `/v3/projects/0ed9948bd4764c1aba70889f5198b7db` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:41.885913 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21676748-c295-4092-9762-23c57ae41a96 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ed9948bd4764c1aba70889f5198b7db)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:41.889634 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21676748-c295-4092-9762-23c57ae41a96 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:41.980722 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-21676748-c295-4092-9762-23c57ae41a96 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ed9948bd4764c1aba70889f5198b7db', 'request_id': 'req-21676748-c295-4092-9762-23c57ae41a96'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:41.995347 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-21676748-c295-4092-9762-23c57ae41a96 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ed9948bd4764c1aba70889f5198b7db', 'request_id': 'req-21676748-c295-4092-9762-23c57ae41a96'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:41.999526 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:42.007886 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-21676748-c295-4092-9762-23c57ae41a96 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ed9948bd4764c1aba70889f5198b7db', 'request_id': 'req-21676748-c295-4092-9762-23c57ae41a96'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:42.029908 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-21676748-c295-4092-9762-23c57ae41a96 admin admin] The token cache is being invalidate because project 0ed9948bd4764c1aba70889f5198b7db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81998) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:15:42.030415 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-21676748-c295-4092-9762-23c57ae41a96 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:42.032139 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-21676748-c295-4092-9762-23c57ae41a96 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:42.034657 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1113/2247] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 30 01:15:41 2022] DELETE /identity/v3/projects/0ed9948bd4764c1aba70889f5198b7db => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:15:42.042150 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c093a4-8c7f-4246-9182-19df4db30ad5 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:42.042646 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c093a4-8c7f-4246-9182-19df4db30ad5 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:42.043179 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c093a4-8c7f-4246-9182-19df4db30ad5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:42.075711 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-78c093a4-8c7f-4246-9182-19df4db30ad5 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:15:42.077776 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-78c093a4-8c7f-4246-9182-19df4db30ad5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:42.163086 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1135/2248] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:15:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:15:42.172809 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5312e992-d24f-4d1c-b17b-c453c24582e7 None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:42.173100 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5312e992-d24f-4d1c-b17b-c453c24582e7 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:42.173354 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5312e992-d24f-4d1c-b17b-c453c24582e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:42.196352 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-5312e992-d24f-4d1c-b17b-c453c24582e7 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:15:42.197648 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-5312e992-d24f-4d1c-b17b-c453c24582e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:42.207550 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1114/2249] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:15:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:15:42.212149 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c093a4-8c7f-4246-9182-19df4db30ad5 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:42.223946 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c093a4-8c7f-4246-9182-19df4db30ad5 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:42.228937 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a01bcf9-51e5-43b0-9fb3-bb24baf7f553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:42.229615 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a01bcf9-51e5-43b0-9fb3-bb24baf7f553 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:42.229950 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a01bcf9-51e5-43b0-9fb3-bb24baf7f553 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:42.230224 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a01bcf9-51e5-43b0-9fb3-bb24baf7f553 admin admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:42.230944 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a01bcf9-51e5-43b0-9fb3-bb24baf7f553 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:15:42.231288 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a01bcf9-51e5-43b0-9fb3-bb24baf7f553 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:42.232924 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a01bcf9-51e5-43b0-9fb3-bb24baf7f553 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:42.246810 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1136/2250] 10.222.0.79 () {58 vars in 1153 bytes} [Tue Aug 30 01:15:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:15:42.252126 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5312e992-d24f-4d1c-b17b-c453c24582e7 None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:42.261476 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5312e992-d24f-4d1c-b17b-c453c24582e7 None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:42.267903 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01b1380-6ae9-4492-962d-5259752b1f6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:42.268555 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01b1380-6ae9-4492-962d-5259752b1f6f admin admin] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:42.268836 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01b1380-6ae9-4492-962d-5259752b1f6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:42.269105 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01b1380-6ae9-4492-962d-5259752b1f6f admin admin] PATH_INFO: `/v3/projects` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:42.269935 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01b1380-6ae9-4492-962d-5259752b1f6f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:42.271923 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01b1380-6ae9-4492-962d-5259752b1f6f admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:42.306940 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1115/2251] 10.222.0.79 () {60 vars in 1153 bytes} [Tue Aug 30 01:15:42 2022] POST /identity/v3/projects => generated 373 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:15:42.308455 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a01bcf9-51e5-43b0-9fb3-bb24baf7f553 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:42.319678 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a01bcf9-51e5-43b0-9fb3-bb24baf7f553 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:42.382589 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4ad099-b18f-40dd-9d6a-022a0967647a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:42.383241 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4ad099-b18f-40dd-9d6a-022a0967647a admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:42.383988 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4ad099-b18f-40dd-9d6a-022a0967647a admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:42.383988 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4ad099-b18f-40dd-9d6a-022a0967647a admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:42.384410 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4ad099-b18f-40dd-9d6a-022a0967647a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:42.386321 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4ad099-b18f-40dd-9d6a-022a0967647a admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:42.413974 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1137/2252] 10.222.0.79 () {60 vars in 1144 bytes} [Tue Aug 30 01:15:42 2022] POST /identity/v3/users => generated 287 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:15:42.418306 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01b1380-6ae9-4492-962d-5259752b1f6f admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:42.431248 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01b1380-6ae9-4492-962d-5259752b1f6f admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:42.436035 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5979a949-6531-4ffa-90dc-355baabed5d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:42.436637 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5979a949-6531-4ffa-90dc-355baabed5d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:42.436917 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5979a949-6531-4ffa-90dc-355baabed5d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:42.437224 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5979a949-6531-4ffa-90dc-355baabed5d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:42.438050 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5979a949-6531-4ffa-90dc-355baabed5d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:42.439673 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5979a949-6531-4ffa-90dc-355baabed5d3 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:42.453345 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1116/2253] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:15:42 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:15:42.454847 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4ad099-b18f-40dd-9d6a-022a0967647a admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:42.465294 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4ad099-b18f-40dd-9d6a-022a0967647a admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:42.470934 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f87f6d-d642-4ed6-b54e-3a21ded76bb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:42.471677 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f87f6d-d642-4ed6-b54e-3a21ded76bb0 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:42.472036 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f87f6d-d642-4ed6-b54e-3a21ded76bb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:42.473759 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f87f6d-d642-4ed6-b54e-3a21ded76bb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:42.474613 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f87f6d-d642-4ed6-b54e-3a21ded76bb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:42.476538 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f87f6d-d642-4ed6-b54e-3a21ded76bb0 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:42.489141 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1138/2254] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:15:42 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:15:42.493098 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5979a949-6531-4ffa-90dc-355baabed5d3 admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:42.503553 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5979a949-6531-4ffa-90dc-355baabed5d3 admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:42.508357 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf4f346-4e80-4874-b9dd-2143ebd12a47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:42.509010 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf4f346-4e80-4874-b9dd-2143ebd12a47 admin admin] REQUEST_METHOD: `PUT` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:42.509283 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf4f346-4e80-4874-b9dd-2143ebd12a47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:42.509554 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf4f346-4e80-4874-b9dd-2143ebd12a47 admin admin] PATH_INFO: `/v3/projects/878760e898984ada83b1c11caa549f92/users/3b88e3e668784a689b9ee294e30f425c/roles/c37945a17623465f899d4f217e7af593` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:42.525466 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf4f346-4e80-4874-b9dd-2143ebd12a47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=878760e898984ada83b1c11caa549f92, user_id=3b88e3e668784a689b9ee294e30f425c, role_id=c37945a17623465f899d4f217e7af593)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:42.528233 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf4f346-4e80-4874-b9dd-2143ebd12a47 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:42.553774 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1117/2255] 10.222.0.79 () {60 vars in 1483 bytes} [Tue Aug 30 01:15:42 2022] PUT /identity/v3/projects/878760e898984ada83b1c11caa549f92/users/3b88e3e668784a689b9ee294e30f425c/roles/c37945a17623465f899d4f217e7af593 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:15:42.558030 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cf7075-665f-4c38-b146-be1551a58d40 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:42.559560 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cf7075-665f-4c38-b146-be1551a58d40 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:42.559922 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cf7075-665f-4c38-b146-be1551a58d40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:42.569019 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:42.593075 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-99cf7075-665f-4c38-b146-be1551a58d40 None None] MFA Rules not processed for user `3b88e3e668784a689b9ee294e30f425c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:15:42.595076 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-99cf7075-665f-4c38-b146-be1551a58d40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:42.678416 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1139/2256] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:15:42 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:15:42.686331 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf4f346-4e80-4874-b9dd-2143ebd12a47 admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:42.688856 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-6cf4f346-4e80-4874-b9dd-2143ebd12a47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:42.767928 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf4f346-4e80-4874-b9dd-2143ebd12a47 admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:42.774620 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24a45df-46ec-4993-9eee-ffccced7e541 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f827c7670b74d938ffe066ced88d1c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:42.777079 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24a45df-46ec-4993-9eee-ffccced7e541 service cinder] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:42.777643 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24a45df-46ec-4993-9eee-ffccced7e541 service cinder] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:42.778356 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24a45df-46ec-4993-9eee-ffccced7e541 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:42.819263 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24a45df-46ec-4993-9eee-ffccced7e541 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:42.820850 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24a45df-46ec-4993-9eee-ffccced7e541 service cinder] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:42.831856 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1118/2257] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:15:42 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:15:42.866012 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cf7075-665f-4c38-b146-be1551a58d40 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:42.975476 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cf7075-665f-4c38-b146-be1551a58d40 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:42.983623 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4d8b8f-5955-4e09-bda0-96573a1798b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:42.984837 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4d8b8f-5955-4e09-bda0-96573a1798b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:42.985411 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4d8b8f-5955-4e09-bda0-96573a1798b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:42.985786 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4d8b8f-5955-4e09-bda0-96573a1798b1 admin admin] PATH_INFO: `/v3/users/3b88e3e668784a689b9ee294e30f425c` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:42.987432 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4d8b8f-5955-4e09-bda0-96573a1798b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b88e3e668784a689b9ee294e30f425c)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:42.989530 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4d8b8f-5955-4e09-bda0-96573a1798b1 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:43.069335 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-2b4d8b8f-5955-4e09-bda0-96573a1798b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b88e3e668784a689b9ee294e30f425c'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:43.083328 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-2b4d8b8f-5955-4e09-bda0-96573a1798b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b88e3e668784a689b9ee294e30f425c'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:43.093771 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-2b4d8b8f-5955-4e09-bda0-96573a1798b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b88e3e668784a689b9ee294e30f425c'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:43.094602 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-2b4d8b8f-5955-4e09-bda0-96573a1798b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b88e3e668784a689b9ee294e30f425c'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:43.113617 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-2b4d8b8f-5955-4e09-bda0-96573a1798b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b88e3e668784a689b9ee294e30f425c'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:43.121838 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1140/2258] 10.222.0.79 () {58 vars in 1224 bytes} [Tue Aug 30 01:15:42 2022] DELETE /identity/v3/users/3b88e3e668784a689b9ee294e30f425c => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:15:43.127723 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42916622-def9-4cca-8c89-b69c82a40dac None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:43.128305 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42916622-def9-4cca-8c89-b69c82a40dac None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:43.129447 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42916622-def9-4cca-8c89-b69c82a40dac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:43.163049 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-42916622-def9-4cca-8c89-b69c82a40dac None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:15:43.164922 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-42916622-def9-4cca-8c89-b69c82a40dac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:43.356326 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1119/2259] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:15:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:15:43.400664 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4d8b8f-5955-4e09-bda0-96573a1798b1 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:43.403765 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-2b4d8b8f-5955-4e09-bda0-96573a1798b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:43.429724 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:43.519113 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4d8b8f-5955-4e09-bda0-96573a1798b1 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:43.527848 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147fba17-5427-43a6-a9fb-6b052e983985 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16e6a0ca26fc4ef892c188ad89a1e132', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:43.528655 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147fba17-5427-43a6-a9fb-6b052e983985 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:43.529082 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147fba17-5427-43a6-a9fb-6b052e983985 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:43.530043 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147fba17-5427-43a6-a9fb-6b052e983985 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:43.542980 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147fba17-5427-43a6-a9fb-6b052e983985 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:43.544784 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147fba17-5427-43a6-a9fb-6b052e983985 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:43.560607 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1141/2260] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:15:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:15:44.918213 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42916622-def9-4cca-8c89-b69c82a40dac None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:44.919824 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-42916622-def9-4cca-8c89-b69c82a40dac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:44.949486 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42916622-def9-4cca-8c89-b69c82a40dac None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:44.995671 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca99448f-a839-4cef-bd13-10f28fa914fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:44.996335 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca99448f-a839-4cef-bd13-10f28fa914fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:44.996618 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca99448f-a839-4cef-bd13-10f28fa914fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:44.996891 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca99448f-a839-4cef-bd13-10f28fa914fc admin admin] PATH_INFO: `/v3/projects/878760e898984ada83b1c11caa549f92` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:45.005999 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca99448f-a839-4cef-bd13-10f28fa914fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=878760e898984ada83b1c11caa549f92)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:45.010955 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca99448f-a839-4cef-bd13-10f28fa914fc admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:45.100681 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=97,keystone:DELETE=1,keystone:INSERT=2 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:45.187879 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-ca99448f-a839-4cef-bd13-10f28fa914fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '878760e898984ada83b1c11caa549f92', 'request_id': 'req-ca99448f-a839-4cef-bd13-10f28fa914fc'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:45.206823 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-ca99448f-a839-4cef-bd13-10f28fa914fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '878760e898984ada83b1c11caa549f92', 'request_id': 'req-ca99448f-a839-4cef-bd13-10f28fa914fc'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:45.220351 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-ca99448f-a839-4cef-bd13-10f28fa914fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '878760e898984ada83b1c11caa549f92', 'request_id': 'req-ca99448f-a839-4cef-bd13-10f28fa914fc'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:45.257429 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-ca99448f-a839-4cef-bd13-10f28fa914fc admin admin] The token cache is being invalidate because project 878760e898984ada83b1c11caa549f92 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81998) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:15:45.257816 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-ca99448f-a839-4cef-bd13-10f28fa914fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:45.258563 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-ca99448f-a839-4cef-bd13-10f28fa914fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:45.264050 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1120/2261] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 30 01:15:44 2022] DELETE /identity/v3/projects/878760e898984ada83b1c11caa549f92 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:15:45.266112 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06faa4e7-a2e5-4892-b0b8-47fd2838a520 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:45.266800 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06faa4e7-a2e5-4892-b0b8-47fd2838a520 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:45.266800 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06faa4e7-a2e5-4892-b0b8-47fd2838a520 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:45.332218 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-06faa4e7-a2e5-4892-b0b8-47fd2838a520 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:15:45.333615 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-06faa4e7-a2e5-4892-b0b8-47fd2838a520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:45.461509 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1142/2262] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:15:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:15:45.467920 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b9ee68-51f3-4c5a-934e-29370a07b347 None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:45.469138 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b9ee68-51f3-4c5a-934e-29370a07b347 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:45.469619 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b9ee68-51f3-4c5a-934e-29370a07b347 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:45.506277 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-d8b9ee68-51f3-4c5a-934e-29370a07b347 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:15:45.512308 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-d8b9ee68-51f3-4c5a-934e-29370a07b347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:45.532285 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1121/2263] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:15:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:15:45.536477 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06faa4e7-a2e5-4892-b0b8-47fd2838a520 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:45.552748 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06faa4e7-a2e5-4892-b0b8-47fd2838a520 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:45.558228 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900038c1-bbaa-4fe0-890a-05c73514938b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:45.558861 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900038c1-bbaa-4fe0-890a-05c73514938b admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:45.559751 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900038c1-bbaa-4fe0-890a-05c73514938b admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:45.559751 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900038c1-bbaa-4fe0-890a-05c73514938b admin admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:45.560072 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900038c1-bbaa-4fe0-890a-05c73514938b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:15:45.560373 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900038c1-bbaa-4fe0-890a-05c73514938b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:45.562683 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900038c1-bbaa-4fe0-890a-05c73514938b admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:45.578355 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1143/2264] 10.222.0.79 () {58 vars in 1153 bytes} [Tue Aug 30 01:15:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:15:45.583400 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b9ee68-51f3-4c5a-934e-29370a07b347 None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:45.597296 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b9ee68-51f3-4c5a-934e-29370a07b347 None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:45.603782 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72f487f-13c1-48cc-a596-bfeb7f7c7dd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:45.605255 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72f487f-13c1-48cc-a596-bfeb7f7c7dd9 admin admin] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:45.605573 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72f487f-13c1-48cc-a596-bfeb7f7c7dd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:45.605848 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72f487f-13c1-48cc-a596-bfeb7f7c7dd9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:45.606502 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72f487f-13c1-48cc-a596-bfeb7f7c7dd9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:45.608490 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72f487f-13c1-48cc-a596-bfeb7f7c7dd9 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:45.667245 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1122/2265] 10.222.0.79 () {60 vars in 1153 bytes} [Tue Aug 30 01:15:45 2022] POST /identity/v3/projects => generated 381 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:15:45.672501 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900038c1-bbaa-4fe0-890a-05c73514938b admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:45.689760 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900038c1-bbaa-4fe0-890a-05c73514938b admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:45.699021 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5761617d-50c5-4d99-bad0-a3a9dc5dfaa9 None None] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:45.701395 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5761617d-50c5-4d99-bad0-a3a9dc5dfaa9 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:45.702237 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5761617d-50c5-4d99-bad0-a3a9dc5dfaa9 None None] PATH_INFO: `/` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:45.711955 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1123/2266] 10.222.0.79 () {54 vars in 921 bytes} [Tue Aug 30 01:15:45 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:15:45.745578 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6973ea-c13a-43db-b355-ee75d20938e6 None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:45.746186 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6973ea-c13a-43db-b355-ee75d20938e6 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:45.746726 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6973ea-c13a-43db-b355-ee75d20938e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:45.783992 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-df6973ea-c13a-43db-b355-ee75d20938e6 None None] MFA Rules not processed for user `6480b2f14c37474c89df9fba48f7cd91`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:15:45.785308 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-df6973ea-c13a-43db-b355-ee75d20938e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:45.830986 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62b8587-c2b9-44db-9dcb-0ecf70e98d2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:45.832350 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62b8587-c2b9-44db-9dcb-0ecf70e98d2e admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:45.832710 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62b8587-c2b9-44db-9dcb-0ecf70e98d2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:45.835108 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62b8587-c2b9-44db-9dcb-0ecf70e98d2e admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:45.835906 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62b8587-c2b9-44db-9dcb-0ecf70e98d2e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:45.837938 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62b8587-c2b9-44db-9dcb-0ecf70e98d2e admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:45.874590 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1144/2267] 10.222.0.79 () {60 vars in 1144 bytes} [Tue Aug 30 01:15:45 2022] POST /identity/v3/users => generated 291 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:15:45.880047 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62b8587-c2b9-44db-9dcb-0ecf70e98d2e admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:45.898808 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62b8587-c2b9-44db-9dcb-0ecf70e98d2e admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:45.911998 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc769fbf-462b-452e-a355-76b5ba94a453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:45.912631 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc769fbf-462b-452e-a355-76b5ba94a453 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:45.912934 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc769fbf-462b-452e-a355-76b5ba94a453 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:45.913189 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc769fbf-462b-452e-a355-76b5ba94a453 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:45.913904 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc769fbf-462b-452e-a355-76b5ba94a453 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:45.915618 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc769fbf-462b-452e-a355-76b5ba94a453 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:45.929296 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1124/2268] 10.222.0.79 () {58 vars in 1018 bytes} [Tue Aug 30 01:15:45 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:15:45.936158 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1145/2269] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:15:45 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 01:15:45.952877 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6973ea-c13a-43db-b355-ee75d20938e6 None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:45.953157 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc769fbf-462b-452e-a355-76b5ba94a453 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:45.954921 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-fc769fbf-462b-452e-a355-76b5ba94a453 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:45.966599 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6973ea-c13a-43db-b355-ee75d20938e6 None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:45.982118 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed11538-aa03-4034-bfb5-a0c09ba4da15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:45.983880 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed11538-aa03-4034-bfb5-a0c09ba4da15 admin admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:45.984917 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed11538-aa03-4034-bfb5-a0c09ba4da15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:45.985338 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed11538-aa03-4034-bfb5-a0c09ba4da15 admin admin] PATH_INFO: `/v3/roles` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:45.986510 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed11538-aa03-4034-bfb5-a0c09ba4da15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:45.988514 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed11538-aa03-4034-bfb5-a0c09ba4da15 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:46.003428 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1125/2270] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:15:45 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:15:46.006833 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed11538-aa03-4034-bfb5-a0c09ba4da15 admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:46.018790 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:46.026543 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed11538-aa03-4034-bfb5-a0c09ba4da15 admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:46.035275 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec91443-4b57-49f1-afaa-f30aa5897e92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:46.036179 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec91443-4b57-49f1-afaa-f30aa5897e92 admin admin] REQUEST_METHOD: `PUT` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:46.036606 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec91443-4b57-49f1-afaa-f30aa5897e92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:46.038094 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec91443-4b57-49f1-afaa-f30aa5897e92 admin admin] PATH_INFO: `/v3/projects/d2aa4bad874341bb95918605cf120eb7/users/111f8cc6017f42708b2c5ab85c9f68ee/roles/c37945a17623465f899d4f217e7af593` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:46.061400 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec91443-4b57-49f1-afaa-f30aa5897e92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2aa4bad874341bb95918605cf120eb7, user_id=111f8cc6017f42708b2c5ab85c9f68ee, role_id=c37945a17623465f899d4f217e7af593)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:46.066045 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec91443-4b57-49f1-afaa-f30aa5897e92 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:46.086711 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc769fbf-462b-452e-a355-76b5ba94a453 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:46.093581 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889a149f-bd93-423a-a7de-520b02f47206 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e37a5c33c064c488fd4667170f7703a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:46.094416 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889a149f-bd93-423a-a7de-520b02f47206 service glance] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:46.094937 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889a149f-bd93-423a-a7de-520b02f47206 service glance] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:46.095239 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889a149f-bd93-423a-a7de-520b02f47206 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:46.110749 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889a149f-bd93-423a-a7de-520b02f47206 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:46.112843 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889a149f-bd93-423a-a7de-520b02f47206 service glance] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:46.115230 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1126/2271] 10.222.0.79 () {60 vars in 1483 bytes} [Tue Aug 30 01:15:46 2022] PUT /identity/v3/projects/d2aa4bad874341bb95918605cf120eb7/users/111f8cc6017f42708b2c5ab85c9f68ee/roles/c37945a17623465f899d4f217e7af593 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:15:46.123238 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240217f0-2b96-4ee4-9489-09564bd37e36 None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:46.123808 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240217f0-2b96-4ee4-9489-09564bd37e36 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:46.124263 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240217f0-2b96-4ee4-9489-09564bd37e36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:46.138255 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1146/2272] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:15:45 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 01:15:46.197608 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-240217f0-2b96-4ee4-9489-09564bd37e36 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:15:46.220181 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-240217f0-2b96-4ee4-9489-09564bd37e36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:46.257451 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ff7f38-0b88-4d59-bbed-9581d5f0e232 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:46.258130 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ff7f38-0b88-4d59-bbed-9581d5f0e232 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:46.258607 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ff7f38-0b88-4d59-bbed-9581d5f0e232 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:46.294951 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-80ff7f38-0b88-4d59-bbed-9581d5f0e232 None None] MFA Rules not processed for user `5cacaed93420436e8f423f96a8041401`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:15:46.296254 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-80ff7f38-0b88-4d59-bbed-9581d5f0e232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:46.302355 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:DELETE=7,keystone:SELECT=90,keystone:INSERT=3 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:46.354947 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1127/2273] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:15:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:15:46.360965 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f035825-7d46-4aee-a362-07d88a3d3206 None None] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:46.361466 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f035825-7d46-4aee-a362-07d88a3d3206 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:46.361919 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f035825-7d46-4aee-a362-07d88a3d3206 None None] PATH_INFO: `/` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:46.364771 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1128/2274] 10.222.0.79 () {54 vars in 921 bytes} [Tue Aug 30 01:15:46 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:15:46.372092 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1b9430-0c4b-4363-897f-e3f4182e9a42 None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:46.372752 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1b9430-0c4b-4363-897f-e3f4182e9a42 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:46.373275 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1b9430-0c4b-4363-897f-e3f4182e9a42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:46.401290 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-4a1b9430-0c4b-4363-897f-e3f4182e9a42 None None] MFA Rules not processed for user `16e6a0ca26fc4ef892c188ad89a1e132`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:15:46.403027 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-4a1b9430-0c4b-4363-897f-e3f4182e9a42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:46.417905 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1147/2275] 10.222.0.79 () {58 vars in 1009 bytes} [Tue Aug 30 01:15:46 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:15:46.419899 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ff7f38-0b88-4d59-bbed-9581d5f0e232 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:46.421714 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-80ff7f38-0b88-4d59-bbed-9581d5f0e232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:46.511322 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1129/2276] 10.222.0.79 () {58 vars in 1018 bytes} [Tue Aug 30 01:15:46 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:15:46.512358 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1b9430-0c4b-4363-897f-e3f4182e9a42 None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:46.516716 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-4a1b9430-0c4b-4363-897f-e3f4182e9a42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:46.610712 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ff7f38-0b88-4d59-bbed-9581d5f0e232 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:46.624036 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2404032f-85a5-4f20-92be-c7cf827c3745 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16e6a0ca26fc4ef892c188ad89a1e132', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:46.625497 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2404032f-85a5-4f20-92be-c7cf827c3745 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:46.625876 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2404032f-85a5-4f20-92be-c7cf827c3745 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:46.626245 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2404032f-85a5-4f20-92be-c7cf827c3745 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:46.635064 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1b9430-0c4b-4363-897f-e3f4182e9a42 None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:46.644026 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2e9f8e-f8b3-4948-bbfb-fb0006be4f7d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd556fa6ba464928b1e067325792a523', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:46.644990 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2e9f8e-f8b3-4948-bbfb-fb0006be4f7d service swift] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:46.645641 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2e9f8e-f8b3-4948-bbfb-fb0006be4f7d service swift] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:46.646278 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2e9f8e-f8b3-4948-bbfb-fb0006be4f7d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:46.649750 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2404032f-85a5-4f20-92be-c7cf827c3745 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:46.651383 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2404032f-85a5-4f20-92be-c7cf827c3745 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:46.658868 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2e9f8e-f8b3-4948-bbfb-fb0006be4f7d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:46.660899 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2e9f8e-f8b3-4948-bbfb-fb0006be4f7d service swift] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:46.672370 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1130/2277] 10.222.0.79 () {60 vars in 1384 bytes} [Tue Aug 30 01:15:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 01:15:46.673511 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2e9f8e-f8b3-4948-bbfb-fb0006be4f7d service swift] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:46.674977 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-cd2e9f8e-f8b3-4948-bbfb-fb0006be4f7d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:46.691281 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2e9f8e-f8b3-4948-bbfb-fb0006be4f7d service swift] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:46.693966 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1148/2278] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:15:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:15:46.696901 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e29ddd5-1561-4448-975f-bd98cee4b3fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16e6a0ca26fc4ef892c188ad89a1e132', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:46.697786 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e29ddd5-1561-4448-975f-bd98cee4b3fc service neutron] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:46.698451 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e29ddd5-1561-4448-975f-bd98cee4b3fc service neutron] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:46.698562 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e29ddd5-1561-4448-975f-bd98cee4b3fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:46.707020 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e29ddd5-1561-4448-975f-bd98cee4b3fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:46.708711 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e29ddd5-1561-4448-975f-bd98cee4b3fc service neutron] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:46.719449 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1131/2279] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:15:46 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:15:47.007393 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43114f20-fd8b-4918-90d5-0757cd75d13a None None] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:47.007830 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43114f20-fd8b-4918-90d5-0757cd75d13a None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:47.008206 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43114f20-fd8b-4918-90d5-0757cd75d13a None None] PATH_INFO: `/` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:47.009755 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1149/2280] 10.222.0.79 () {54 vars in 921 bytes} [Tue Aug 30 01:15:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:15:47.020740 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ef8a64-ceff-4be1-9ac5-1241021e2b04 None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:47.022871 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ef8a64-ceff-4be1-9ac5-1241021e2b04 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:47.023870 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ef8a64-ceff-4be1-9ac5-1241021e2b04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:47.075192 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-b8ef8a64-ceff-4be1-9ac5-1241021e2b04 None None] MFA Rules not processed for user `6480b2f14c37474c89df9fba48f7cd91`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:15:47.085744 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-b8ef8a64-ceff-4be1-9ac5-1241021e2b04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:47.215299 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:47.295784 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1132/2281] 10.222.0.79 () {58 vars in 1018 bytes} [Tue Aug 30 01:15:47 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:15:47.319543 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43114f20-fd8b-4918-90d5-0757cd75d13a None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:47.341397 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43114f20-fd8b-4918-90d5-0757cd75d13a None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:47.346761 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a01b4cc-c4e4-4b31-8cd2-efa7762829cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16e6a0ca26fc4ef892c188ad89a1e132', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:47.348651 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a01b4cc-c4e4-4b31-8cd2-efa7762829cf service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:47.349031 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a01b4cc-c4e4-4b31-8cd2-efa7762829cf service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:47.349370 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a01b4cc-c4e4-4b31-8cd2-efa7762829cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:47.366657 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a01b4cc-c4e4-4b31-8cd2-efa7762829cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:47.368528 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a01b4cc-c4e4-4b31-8cd2-efa7762829cf service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:47.392441 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1150/2282] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:15:47 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:15:48.810399 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ee4f41-97e6-4890-9ebd-64747407dcdd None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:48.811432 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ee4f41-97e6-4890-9ebd-64747407dcdd None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:48.812602 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ee4f41-97e6-4890-9ebd-64747407dcdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:48.863948 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-69ee4f41-97e6-4890-9ebd-64747407dcdd None None] MFA Rules not processed for user `111f8cc6017f42708b2c5ab85c9f68ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:15:48.865472 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-69ee4f41-97e6-4890-9ebd-64747407dcdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:48.970804 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1133/2283] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:15:48 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:15:48.981356 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a01b4cc-c4e4-4b31-8cd2-efa7762829cf service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:48.984499 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-7a01b4cc-c4e4-4b31-8cd2-efa7762829cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:49.114614 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a01b4cc-c4e4-4b31-8cd2-efa7762829cf service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:49.119612 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d26c91-d4f8-4c91-ba7b-9a4c7b4036f4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f827c7670b74d938ffe066ced88d1c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:49.121112 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d26c91-d4f8-4c91-ba7b-9a4c7b4036f4 service cinder] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:49.121623 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d26c91-d4f8-4c91-ba7b-9a4c7b4036f4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:49.122078 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d26c91-d4f8-4c91-ba7b-9a4c7b4036f4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:49.136589 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d26c91-d4f8-4c91-ba7b-9a4c7b4036f4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:49.138736 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d26c91-d4f8-4c91-ba7b-9a4c7b4036f4 service cinder] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:49.151945 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1151/2284] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:15:48 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:15:50.745489 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1294caa-4edd-49f6-9f30-cf25c9b0ac41 None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:50.746223 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1294caa-4edd-49f6-9f30-cf25c9b0ac41 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:50.746223 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1294caa-4edd-49f6-9f30-cf25c9b0ac41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:50.770601 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-f1294caa-4edd-49f6-9f30-cf25c9b0ac41 None None] MFA Rules not processed for user `111f8cc6017f42708b2c5ab85c9f68ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:15:50.771854 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-f1294caa-4edd-49f6-9f30-cf25c9b0ac41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:50.797907 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1134/2285] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:15:50 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:15:51.125592 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3660c603-fdc4-4da9-be8c-0dfbdd56a4d2 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:51.127062 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3660c603-fdc4-4da9-be8c-0dfbdd56a4d2 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:51.127732 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3660c603-fdc4-4da9-be8c-0dfbdd56a4d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:51.146383 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:51.153950 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-3660c603-fdc4-4da9-be8c-0dfbdd56a4d2 None None] MFA Rules not processed for user `5cacaed93420436e8f423f96a8041401`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:15:51.155791 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-3660c603-fdc4-4da9-be8c-0dfbdd56a4d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:51.165975 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1152/2286] 10.222.0.79 () {58 vars in 1009 bytes} [Tue Aug 30 01:15:51 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:15:51.180544 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1294caa-4edd-49f6-9f30-cf25c9b0ac41 None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:51.197730 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1294caa-4edd-49f6-9f30-cf25c9b0ac41 None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:51.205886 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a04deae-209d-408b-80d8-a8d32696ba75 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd556fa6ba464928b1e067325792a523', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:51.206819 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a04deae-209d-408b-80d8-a8d32696ba75 service swift] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:51.207052 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a04deae-209d-408b-80d8-a8d32696ba75 service swift] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:51.207455 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a04deae-209d-408b-80d8-a8d32696ba75 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:51.226410 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a04deae-209d-408b-80d8-a8d32696ba75 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:51.242893 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a04deae-209d-408b-80d8-a8d32696ba75 service swift] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:51.252801 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1135/2287] 10.222.0.79 () {60 vars in 1384 bytes} [Tue Aug 30 01:15:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 01:16:01.160431 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=2 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:01.249762 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=43 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:04.178561 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3660c603-fdc4-4da9-be8c-0dfbdd56a4d2 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:04.181319 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-3660c603-fdc4-4da9-be8c-0dfbdd56a4d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:16:04.323659 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3660c603-fdc4-4da9-be8c-0dfbdd56a4d2 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:04.331504 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d66b71-9058-4a82-bda5-0803993e13bc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd68e91e4259e449797fb83de548aec1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:04.332270 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d66b71-9058-4a82-bda5-0803993e13bc service placement] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:04.332715 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d66b71-9058-4a82-bda5-0803993e13bc service placement] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:04.333155 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d66b71-9058-4a82-bda5-0803993e13bc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:04.335175 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-78d66b71-9058-4a82-bda5-0803993e13bc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:16:04.349538 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d66b71-9058-4a82-bda5-0803993e13bc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:04.351265 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d66b71-9058-4a82-bda5-0803993e13bc service placement] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:04.370318 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1153/2288] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:16:04 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:16:05.653379 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57c5dba-8e27-4045-8871-182e3f8cb172 None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:05.654144 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57c5dba-8e27-4045-8871-182e3f8cb172 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:05.654144 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57c5dba-8e27-4045-8871-182e3f8cb172 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:05.675186 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-f57c5dba-8e27-4045-8871-182e3f8cb172 None None] MFA Rules not processed for user `5cacaed93420436e8f423f96a8041401`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:16:05.676380 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-f57c5dba-8e27-4045-8871-182e3f8cb172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:16:05.683564 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1136/2289] 10.222.0.79 () {58 vars in 967 bytes} [Tue Aug 30 01:16:05 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:16:05.696792 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d66b71-9058-4a82-bda5-0803993e13bc service placement] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:05.710462 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d66b71-9058-4a82-bda5-0803993e13bc service placement] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:05.715512 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa7654f-1290-4b4c-9821-e2202529fed6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd556fa6ba464928b1e067325792a523', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:05.716098 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa7654f-1290-4b4c-9821-e2202529fed6 service swift] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:05.716369 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa7654f-1290-4b4c-9821-e2202529fed6 service swift] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:05.716655 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa7654f-1290-4b4c-9821-e2202529fed6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:05.726709 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa7654f-1290-4b4c-9821-e2202529fed6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:05.729463 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa7654f-1290-4b4c-9821-e2202529fed6 service swift] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:05.739207 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1154/2290] 10.222.0.79 () {60 vars in 1384 bytes} [Tue Aug 30 01:16:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 01:16:07.965100 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57c5dba-8e27-4045-8871-182e3f8cb172 None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:07.966567 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-f57c5dba-8e27-4045-8871-182e3f8cb172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:16:07.987104 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57c5dba-8e27-4045-8871-182e3f8cb172 None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:07.993167 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6aa7fc1-3ba9-47a3-bd31-2c0a9bb83cce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:07.993813 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aa7fc1-3ba9-47a3-bd31-2c0a9bb83cce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:07.994142 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aa7fc1-3ba9-47a3-bd31-2c0a9bb83cce admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:07.994506 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aa7fc1-3ba9-47a3-bd31-2c0a9bb83cce admin admin] PATH_INFO: `/v3/users/d2558e0d9c5a4bd58380ae92bd9a282c` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:07.995769 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6aa7fc1-3ba9-47a3-bd31-2c0a9bb83cce admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2558e0d9c5a4bd58380ae92bd9a282c)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:08.000653 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6aa7fc1-3ba9-47a3-bd31-2c0a9bb83cce admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:08.070478 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-b6aa7fc1-3ba9-47a3-bd31-2c0a9bb83cce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2558e0d9c5a4bd58380ae92bd9a282c'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:16:08.079875 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-b6aa7fc1-3ba9-47a3-bd31-2c0a9bb83cce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2558e0d9c5a4bd58380ae92bd9a282c'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:16:08.098774 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-b6aa7fc1-3ba9-47a3-bd31-2c0a9bb83cce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2558e0d9c5a4bd58380ae92bd9a282c'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:16:08.099670 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-b6aa7fc1-3ba9-47a3-bd31-2c0a9bb83cce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2558e0d9c5a4bd58380ae92bd9a282c'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:16:08.109879 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-b6aa7fc1-3ba9-47a3-bd31-2c0a9bb83cce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2558e0d9c5a4bd58380ae92bd9a282c'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:16:08.120457 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1137/2291] 10.222.0.79 () {58 vars in 1224 bytes} [Tue Aug 30 01:16:07 2022] DELETE /identity/v3/users/d2558e0d9c5a4bd58380ae92bd9a282c => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:16:08.367294 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa7654f-1290-4b4c-9821-e2202529fed6 service swift] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:08.381131 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa7654f-1290-4b4c-9821-e2202529fed6 service swift] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:08.447820 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e845bad-5577-453c-8e60-e0999464e1cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:08.450179 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e845bad-5577-453c-8e60-e0999464e1cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:08.450179 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e845bad-5577-453c-8e60-e0999464e1cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:08.450179 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e845bad-5577-453c-8e60-e0999464e1cb admin admin] PATH_INFO: `/v3/projects/dc5a0aae4ebb49149548f253ae0be95b` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:08.450573 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e845bad-5577-453c-8e60-e0999464e1cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc5a0aae4ebb49149548f253ae0be95b)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:08.452670 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e845bad-5577-453c-8e60-e0999464e1cb admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:08.528998 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-2e845bad-5577-453c-8e60-e0999464e1cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc5a0aae4ebb49149548f253ae0be95b', 'request_id': 'req-2e845bad-5577-453c-8e60-e0999464e1cb'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:16:08.541364 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-2e845bad-5577-453c-8e60-e0999464e1cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc5a0aae4ebb49149548f253ae0be95b', 'request_id': 'req-2e845bad-5577-453c-8e60-e0999464e1cb'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:16:08.551041 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-2e845bad-5577-453c-8e60-e0999464e1cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc5a0aae4ebb49149548f253ae0be95b', 'request_id': 'req-2e845bad-5577-453c-8e60-e0999464e1cb'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:16:08.564621 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-2e845bad-5577-453c-8e60-e0999464e1cb admin admin] The token cache is being invalidate because project dc5a0aae4ebb49149548f253ae0be95b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:16:08.567752 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-2e845bad-5577-453c-8e60-e0999464e1cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:16:08.576841 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-2e845bad-5577-453c-8e60-e0999464e1cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:16:08.581773 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1155/2292] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 30 01:16:08 2022] DELETE /identity/v3/projects/dc5a0aae4ebb49149548f253ae0be95b => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:16:08.587186 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847eda9a-c594-45bf-a4d6-72b22388c945 None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:08.587492 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847eda9a-c594-45bf-a4d6-72b22388c945 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:08.587748 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847eda9a-c594-45bf-a4d6-72b22388c945 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:08.618535 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-847eda9a-c594-45bf-a4d6-72b22388c945 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:16:08.621339 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-847eda9a-c594-45bf-a4d6-72b22388c945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:16:08.705070 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1138/2293] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:16:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:16:08.712651 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45a73c6-adf2-4a41-845a-b3ef38599657 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:08.712934 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45a73c6-adf2-4a41-845a-b3ef38599657 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:08.713209 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45a73c6-adf2-4a41-845a-b3ef38599657 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:08.750290 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:08.768580 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-a45a73c6-adf2-4a41-845a-b3ef38599657 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:16:08.770631 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-a45a73c6-adf2-4a41-845a-b3ef38599657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:16:08.794578 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1156/2294] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:16:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:16:08.800277 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847eda9a-c594-45bf-a4d6-72b22388c945 None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:08.812325 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847eda9a-c594-45bf-a4d6-72b22388c945 None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:08.818819 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b1f54b-a6e3-4001-ac21-ed3320b2cc23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:08.819484 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b1f54b-a6e3-4001-ac21-ed3320b2cc23 admin admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:08.819770 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b1f54b-a6e3-4001-ac21-ed3320b2cc23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:08.820038 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b1f54b-a6e3-4001-ac21-ed3320b2cc23 admin admin] PATH_INFO: `/v3/domains` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:08.821189 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b1f54b-a6e3-4001-ac21-ed3320b2cc23 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:16:08.821496 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b1f54b-a6e3-4001-ac21-ed3320b2cc23 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:08.823159 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b1f54b-a6e3-4001-ac21-ed3320b2cc23 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:08.839811 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1139/2295] 10.222.0.79 () {58 vars in 1153 bytes} [Tue Aug 30 01:16:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:16:08.845906 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45a73c6-adf2-4a41-845a-b3ef38599657 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:08.858085 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45a73c6-adf2-4a41-845a-b3ef38599657 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:08.864756 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75b64d4-6acb-4c19-8f22-5c09f83a5e59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:08.865455 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75b64d4-6acb-4c19-8f22-5c09f83a5e59 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:08.865802 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75b64d4-6acb-4c19-8f22-5c09f83a5e59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:08.866139 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75b64d4-6acb-4c19-8f22-5c09f83a5e59 admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:08.866882 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75b64d4-6acb-4c19-8f22-5c09f83a5e59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:08.868910 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75b64d4-6acb-4c19-8f22-5c09f83a5e59 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:08.899110 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1157/2296] 10.222.0.79 () {60 vars in 1153 bytes} [Tue Aug 30 01:16:08 2022] POST /identity/v3/projects => generated 375 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:16:08.903286 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b1f54b-a6e3-4001-ac21-ed3320b2cc23 admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:08.915388 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b1f54b-a6e3-4001-ac21-ed3320b2cc23 admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:08.973317 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:08.984024 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e837f18-3ac4-4649-9663-7b8cf3f9eec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:08.984668 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e837f18-3ac4-4649-9663-7b8cf3f9eec8 admin admin] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:08.984949 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e837f18-3ac4-4649-9663-7b8cf3f9eec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:08.985226 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e837f18-3ac4-4649-9663-7b8cf3f9eec8 admin admin] PATH_INFO: `/v3/users` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:08.985972 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e837f18-3ac4-4649-9663-7b8cf3f9eec8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:08.987946 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e837f18-3ac4-4649-9663-7b8cf3f9eec8 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:09.015285 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1140/2297] 10.222.0.79 () {60 vars in 1144 bytes} [Tue Aug 30 01:16:08 2022] POST /identity/v3/users => generated 288 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:16:09.016609 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75b64d4-6acb-4c19-8f22-5c09f83a5e59 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:09.027305 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75b64d4-6acb-4c19-8f22-5c09f83a5e59 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:09.033216 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69705017-4ab3-4569-8b56-0f31b43409af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:09.034006 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69705017-4ab3-4569-8b56-0f31b43409af admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:09.034291 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69705017-4ab3-4569-8b56-0f31b43409af admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:09.034570 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69705017-4ab3-4569-8b56-0f31b43409af admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:09.035279 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69705017-4ab3-4569-8b56-0f31b43409af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:09.036954 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69705017-4ab3-4569-8b56-0f31b43409af admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:09.052935 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1158/2298] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:16:09 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:16:09.054678 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e837f18-3ac4-4649-9663-7b8cf3f9eec8 admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:09.065269 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e837f18-3ac4-4649-9663-7b8cf3f9eec8 admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:09.070574 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e4ab9d-d3e3-4c44-968f-e17459a5295f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:09.071376 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e4ab9d-d3e3-4c44-968f-e17459a5295f admin admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:09.071657 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e4ab9d-d3e3-4c44-968f-e17459a5295f admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:09.071931 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e4ab9d-d3e3-4c44-968f-e17459a5295f admin admin] PATH_INFO: `/v3/roles` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:09.072613 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e4ab9d-d3e3-4c44-968f-e17459a5295f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:09.074246 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e4ab9d-d3e3-4c44-968f-e17459a5295f admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:09.089504 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1141/2299] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:16:09 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:16:09.090746 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69705017-4ab3-4569-8b56-0f31b43409af admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:09.102764 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69705017-4ab3-4569-8b56-0f31b43409af admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:09.107928 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20caa44-b5f0-460e-9751-c2deae600a55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:09.109261 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20caa44-b5f0-460e-9751-c2deae600a55 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:09.109621 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20caa44-b5f0-460e-9751-c2deae600a55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:09.109893 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20caa44-b5f0-460e-9751-c2deae600a55 admin admin] PATH_INFO: `/v3/projects/40e77c888dc1408f8617a4271b7d15c3/users/4bc0df52824243b19371ed04803edaf2/roles/c37945a17623465f899d4f217e7af593` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:09.126705 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20caa44-b5f0-460e-9751-c2deae600a55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40e77c888dc1408f8617a4271b7d15c3, user_id=4bc0df52824243b19371ed04803edaf2, role_id=c37945a17623465f899d4f217e7af593)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:09.129358 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20caa44-b5f0-460e-9751-c2deae600a55 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:09.146935 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1159/2300] 10.222.0.79 () {60 vars in 1483 bytes} [Tue Aug 30 01:16:09 2022] PUT /identity/v3/projects/40e77c888dc1408f8617a4271b7d15c3/users/4bc0df52824243b19371ed04803edaf2/roles/c37945a17623465f899d4f217e7af593 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:16:09.157904 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58895c9-0170-455b-b72c-f68a594377ba None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:09.158194 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58895c9-0170-455b-b72c-f68a594377ba None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:09.158472 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58895c9-0170-455b-b72c-f68a594377ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:09.188876 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-c58895c9-0170-455b-b72c-f68a594377ba None None] MFA Rules not processed for user `4bc0df52824243b19371ed04803edaf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:16:09.190104 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-c58895c9-0170-455b-b72c-f68a594377ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:16:09.265105 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1142/2301] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:16:09 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:16:09.276038 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20caa44-b5f0-460e-9751-c2deae600a55 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:09.277847 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-b20caa44-b5f0-460e-9751-c2deae600a55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:16:09.349703 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20caa44-b5f0-460e-9751-c2deae600a55 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:09.354766 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b16c68-98e7-449a-92b6-97db72ab8217 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f827c7670b74d938ffe066ced88d1c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:09.355425 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b16c68-98e7-449a-92b6-97db72ab8217 service cinder] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:09.355713 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b16c68-98e7-449a-92b6-97db72ab8217 service cinder] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:09.355988 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b16c68-98e7-449a-92b6-97db72ab8217 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:09.373394 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b16c68-98e7-449a-92b6-97db72ab8217 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:09.375423 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b16c68-98e7-449a-92b6-97db72ab8217 service cinder] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:09.385225 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1160/2302] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:16:09 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:16:15.120743 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab6b330-e5d9-4ed8-808a-47b1fa2ec775 None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:15.121281 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab6b330-e5d9-4ed8-808a-47b1fa2ec775 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:15.121635 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab6b330-e5d9-4ed8-808a-47b1fa2ec775 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:15.155917 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-cab6b330-e5d9-4ed8-808a-47b1fa2ec775 None None] MFA Rules not processed for user `5cacaed93420436e8f423f96a8041401`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:16:15.157271 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-cab6b330-e5d9-4ed8-808a-47b1fa2ec775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:16:15.228502 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1143/2303] 10.222.0.79 () {58 vars in 967 bytes} [Tue Aug 30 01:16:15 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:16:15.253557 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b16c68-98e7-449a-92b6-97db72ab8217 service cinder] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:15.255870 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-d4b16c68-98e7-449a-92b6-97db72ab8217 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:16:15.381336 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b16c68-98e7-449a-92b6-97db72ab8217 service cinder] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:15.386743 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a308b3e-0cf9-49a3-967e-58e40698125a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd556fa6ba464928b1e067325792a523', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:15.387386 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a308b3e-0cf9-49a3-967e-58e40698125a service swift] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:15.387752 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a308b3e-0cf9-49a3-967e-58e40698125a service swift] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:15.387897 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a308b3e-0cf9-49a3-967e-58e40698125a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:15.402850 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a308b3e-0cf9-49a3-967e-58e40698125a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:15.406535 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a308b3e-0cf9-49a3-967e-58e40698125a service swift] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:15.421773 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1161/2304] 10.222.0.79 () {60 vars in 1384 bytes} [Tue Aug 30 01:16:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 01:16:20.415673 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab6b330-e5d9-4ed8-808a-47b1fa2ec775 None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:20.510782 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab6b330-e5d9-4ed8-808a-47b1fa2ec775 None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:20.516377 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5b1dd7-f026-4b3d-ba0d-7f4f1c988b7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:20.517077 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5b1dd7-f026-4b3d-ba0d-7f4f1c988b7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:20.517372 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5b1dd7-f026-4b3d-ba0d-7f4f1c988b7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:20.517657 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5b1dd7-f026-4b3d-ba0d-7f4f1c988b7e admin admin] PATH_INFO: `/v3/users/4bc0df52824243b19371ed04803edaf2` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:20.518873 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5b1dd7-f026-4b3d-ba0d-7f4f1c988b7e admin admin] RBAC: Authorizing `identity:delete_user(user_id=4bc0df52824243b19371ed04803edaf2)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:20.520900 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5b1dd7-f026-4b3d-ba0d-7f4f1c988b7e admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:20.527487 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:20.580490 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-5a5b1dd7-f026-4b3d-ba0d-7f4f1c988b7e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4bc0df52824243b19371ed04803edaf2'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:16:20.588080 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-5a5b1dd7-f026-4b3d-ba0d-7f4f1c988b7e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4bc0df52824243b19371ed04803edaf2'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:16:20.603903 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-5a5b1dd7-f026-4b3d-ba0d-7f4f1c988b7e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4bc0df52824243b19371ed04803edaf2'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:16:20.604707 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-5a5b1dd7-f026-4b3d-ba0d-7f4f1c988b7e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4bc0df52824243b19371ed04803edaf2'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:16:20.614158 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-5a5b1dd7-f026-4b3d-ba0d-7f4f1c988b7e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4bc0df52824243b19371ed04803edaf2'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:16:20.620988 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1144/2305] 10.222.0.79 () {58 vars in 1224 bytes} [Tue Aug 30 01:16:20 2022] DELETE /identity/v3/users/4bc0df52824243b19371ed04803edaf2 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:16:20.628921 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dda4f7-f7cb-49ac-94ee-a4ef51c49703 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:20.629723 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dda4f7-f7cb-49ac-94ee-a4ef51c49703 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:20.629981 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dda4f7-f7cb-49ac-94ee-a4ef51c49703 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:20.661201 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-d3dda4f7-f7cb-49ac-94ee-a4ef51c49703 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:16:20.662423 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-d3dda4f7-f7cb-49ac-94ee-a4ef51c49703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:16:20.707078 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:20.743037 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1162/2306] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:16:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:16:20.754668 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5b1dd7-f026-4b3d-ba0d-7f4f1c988b7e admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:20.756683 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-5a5b1dd7-f026-4b3d-ba0d-7f4f1c988b7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:16:20.836409 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5b1dd7-f026-4b3d-ba0d-7f4f1c988b7e admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:20.840178 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459f3f8a-3da2-408b-a414-9801e22f3fb4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16e6a0ca26fc4ef892c188ad89a1e132', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:20.840804 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459f3f8a-3da2-408b-a414-9801e22f3fb4 service neutron] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:20.841076 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459f3f8a-3da2-408b-a414-9801e22f3fb4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:20.841343 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459f3f8a-3da2-408b-a414-9801e22f3fb4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:20.852861 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459f3f8a-3da2-408b-a414-9801e22f3fb4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:20.854795 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459f3f8a-3da2-408b-a414-9801e22f3fb4 service neutron] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:20.868720 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1145/2307] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:16:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 01:16:21.261808 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dda4f7-f7cb-49ac-94ee-a4ef51c49703 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:21.263630 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-d3dda4f7-f7cb-49ac-94ee-a4ef51c49703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:16:21.287012 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dda4f7-f7cb-49ac-94ee-a4ef51c49703 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:21.294984 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1a0a64-d6e4-4d46-9aa5-e9bc59e31250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:21.296387 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1a0a64-d6e4-4d46-9aa5-e9bc59e31250 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:21.296807 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1a0a64-d6e4-4d46-9aa5-e9bc59e31250 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:21.297047 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1a0a64-d6e4-4d46-9aa5-e9bc59e31250 admin admin] PATH_INFO: `/v3/projects/40e77c888dc1408f8617a4271b7d15c3` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:21.298461 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1a0a64-d6e4-4d46-9aa5-e9bc59e31250 admin admin] RBAC: Authorizing `identity:delete_project(project_id=40e77c888dc1408f8617a4271b7d15c3)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:21.307372 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1a0a64-d6e4-4d46-9aa5-e9bc59e31250 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:21.378463 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-8d1a0a64-d6e4-4d46-9aa5-e9bc59e31250 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40e77c888dc1408f8617a4271b7d15c3', 'request_id': 'req-8d1a0a64-d6e4-4d46-9aa5-e9bc59e31250'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:16:21.387834 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-8d1a0a64-d6e4-4d46-9aa5-e9bc59e31250 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40e77c888dc1408f8617a4271b7d15c3', 'request_id': 'req-8d1a0a64-d6e4-4d46-9aa5-e9bc59e31250'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:16:21.396496 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-8d1a0a64-d6e4-4d46-9aa5-e9bc59e31250 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40e77c888dc1408f8617a4271b7d15c3', 'request_id': 'req-8d1a0a64-d6e4-4d46-9aa5-e9bc59e31250'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:16:21.412478 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-8d1a0a64-d6e4-4d46-9aa5-e9bc59e31250 admin admin] The token cache is being invalidate because project 40e77c888dc1408f8617a4271b7d15c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:16:21.412782 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-8d1a0a64-d6e4-4d46-9aa5-e9bc59e31250 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:16:21.413532 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-8d1a0a64-d6e4-4d46-9aa5-e9bc59e31250 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:16:21.415100 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1163/2308] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 30 01:16:21 2022] DELETE /identity/v3/projects/40e77c888dc1408f8617a4271b7d15c3 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:16:21.420823 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c5dd81-c73a-446e-a639-d4d44e2fdcd0 None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:21.421521 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c5dd81-c73a-446e-a639-d4d44e2fdcd0 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:21.421860 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c5dd81-c73a-446e-a639-d4d44e2fdcd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:21.449215 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-61c5dd81-c73a-446e-a639-d4d44e2fdcd0 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:16:21.450590 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-61c5dd81-c73a-446e-a639-d4d44e2fdcd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:16:21.544354 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1146/2309] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:16:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:16:21.615672 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a270e15-5e74-4602-91e0-73a8beebcd88 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:21.615960 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a270e15-5e74-4602-91e0-73a8beebcd88 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:21.616254 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a270e15-5e74-4602-91e0-73a8beebcd88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:21.639501 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-4a270e15-5e74-4602-91e0-73a8beebcd88 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:16:21.640680 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-4a270e15-5e74-4602-91e0-73a8beebcd88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:16:21.649185 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1164/2310] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:16:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:16:21.653749 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c5dd81-c73a-446e-a639-d4d44e2fdcd0 None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:21.665538 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c5dd81-c73a-446e-a639-d4d44e2fdcd0 None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:21.672712 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721724ef-5c91-41b3-8820-13f04f71ff80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:21.673363 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721724ef-5c91-41b3-8820-13f04f71ff80 admin admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:21.673743 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721724ef-5c91-41b3-8820-13f04f71ff80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:21.674060 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721724ef-5c91-41b3-8820-13f04f71ff80 admin admin] PATH_INFO: `/v3/domains` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:21.674800 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721724ef-5c91-41b3-8820-13f04f71ff80 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:16:21.675165 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721724ef-5c91-41b3-8820-13f04f71ff80 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:21.677065 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721724ef-5c91-41b3-8820-13f04f71ff80 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:21.695604 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1147/2311] 10.222.0.79 () {58 vars in 1153 bytes} [Tue Aug 30 01:16:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:16:21.702327 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a270e15-5e74-4602-91e0-73a8beebcd88 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:21.713421 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a270e15-5e74-4602-91e0-73a8beebcd88 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:21.719350 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ae92fb-d107-422f-9cc9-123383d9c72d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:21.719980 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ae92fb-d107-422f-9cc9-123383d9c72d admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:21.720256 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ae92fb-d107-422f-9cc9-123383d9c72d admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:21.720529 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ae92fb-d107-422f-9cc9-123383d9c72d admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:21.721341 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ae92fb-d107-422f-9cc9-123383d9c72d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:21.723380 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ae92fb-d107-422f-9cc9-123383d9c72d admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:21.764948 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1165/2312] 10.222.0.79 () {60 vars in 1153 bytes} [Tue Aug 30 01:16:21 2022] POST /identity/v3/projects => generated 375 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:16:21.770900 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721724ef-5c91-41b3-8820-13f04f71ff80 admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:21.788208 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721724ef-5c91-41b3-8820-13f04f71ff80 admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:21.805434 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:21.875110 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fab3ccf-1557-46fa-808a-a20406724f60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:21.875864 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fab3ccf-1557-46fa-808a-a20406724f60 admin admin] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:21.876177 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fab3ccf-1557-46fa-808a-a20406724f60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:21.876535 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fab3ccf-1557-46fa-808a-a20406724f60 admin admin] PATH_INFO: `/v3/users` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:21.877240 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fab3ccf-1557-46fa-808a-a20406724f60 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:21.879453 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fab3ccf-1557-46fa-808a-a20406724f60 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:21.921012 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1148/2313] 10.222.0.79 () {60 vars in 1144 bytes} [Tue Aug 30 01:16:21 2022] POST /identity/v3/users => generated 288 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:16:21.923708 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ae92fb-d107-422f-9cc9-123383d9c72d admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:21.938066 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ae92fb-d107-422f-9cc9-123383d9c72d admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:21.944301 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72121efa-11ae-4358-b67e-e5a97bdb1842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:21.945010 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72121efa-11ae-4358-b67e-e5a97bdb1842 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:21.945367 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72121efa-11ae-4358-b67e-e5a97bdb1842 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:21.945759 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72121efa-11ae-4358-b67e-e5a97bdb1842 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:21.946567 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72121efa-11ae-4358-b67e-e5a97bdb1842 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:21.949485 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72121efa-11ae-4358-b67e-e5a97bdb1842 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:21.963653 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1166/2314] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:16:21 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:16:21.967980 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fab3ccf-1557-46fa-808a-a20406724f60 admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:21.981936 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fab3ccf-1557-46fa-808a-a20406724f60 admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:21.987393 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2c6051-a5cc-4095-9826-eb2977fa5a91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:21.988087 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2c6051-a5cc-4095-9826-eb2977fa5a91 admin admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:21.988408 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2c6051-a5cc-4095-9826-eb2977fa5a91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:21.988724 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2c6051-a5cc-4095-9826-eb2977fa5a91 admin admin] PATH_INFO: `/v3/roles` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:21.989524 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2c6051-a5cc-4095-9826-eb2977fa5a91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:21.991281 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2c6051-a5cc-4095-9826-eb2977fa5a91 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:22.005137 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1149/2315] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:16:21 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:16:22.011191 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72121efa-11ae-4358-b67e-e5a97bdb1842 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:22.027393 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72121efa-11ae-4358-b67e-e5a97bdb1842 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:22.033198 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5d2dae-e425-4e3d-b8ba-07e76afb6497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:22.034034 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5d2dae-e425-4e3d-b8ba-07e76afb6497 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:22.034416 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5d2dae-e425-4e3d-b8ba-07e76afb6497 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:22.034817 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5d2dae-e425-4e3d-b8ba-07e76afb6497 admin admin] PATH_INFO: `/v3/projects/07510e6143104e199070703996a03770/users/18443cba7b7c4e7daa93f8e3b4d917cd/roles/c37945a17623465f899d4f217e7af593` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:22.053711 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5d2dae-e425-4e3d-b8ba-07e76afb6497 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07510e6143104e199070703996a03770, user_id=18443cba7b7c4e7daa93f8e3b4d917cd, role_id=c37945a17623465f899d4f217e7af593)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:22.056728 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5d2dae-e425-4e3d-b8ba-07e76afb6497 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:22.074916 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1167/2316] 10.222.0.79 () {60 vars in 1483 bytes} [Tue Aug 30 01:16:22 2022] PUT /identity/v3/projects/07510e6143104e199070703996a03770/users/18443cba7b7c4e7daa93f8e3b4d917cd/roles/c37945a17623465f899d4f217e7af593 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:16:22.091008 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500a70d5-7fa4-4743-8d1d-4e988b8658bd None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:22.091442 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500a70d5-7fa4-4743-8d1d-4e988b8658bd None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:22.091806 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500a70d5-7fa4-4743-8d1d-4e988b8658bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:22.132822 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-500a70d5-7fa4-4743-8d1d-4e988b8658bd None None] MFA Rules not processed for user `18443cba7b7c4e7daa93f8e3b4d917cd`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:16:22.134094 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-500a70d5-7fa4-4743-8d1d-4e988b8658bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:16:22.218768 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1150/2317] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:16:22 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:16:22.231415 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5d2dae-e425-4e3d-b8ba-07e76afb6497 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:22.234006 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-2e5d2dae-e425-4e3d-b8ba-07e76afb6497 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:16:22.315173 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5d2dae-e425-4e3d-b8ba-07e76afb6497 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:22.320193 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63515c08-7230-4b97-9911-f8d24341a848 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f827c7670b74d938ffe066ced88d1c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:22.321006 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63515c08-7230-4b97-9911-f8d24341a848 service cinder] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:22.321372 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63515c08-7230-4b97-9911-f8d24341a848 service cinder] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:22.321749 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63515c08-7230-4b97-9911-f8d24341a848 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:22.332841 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63515c08-7230-4b97-9911-f8d24341a848 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:22.334497 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63515c08-7230-4b97-9911-f8d24341a848 service cinder] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:22.339792 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:22.354037 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1168/2318] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:16:22 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 01:16:24.044152 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890e333e-54bb-4562-929d-c90052307e9a None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:24.044621 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890e333e-54bb-4562-929d-c90052307e9a None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:24.044733 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890e333e-54bb-4562-929d-c90052307e9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:24.066324 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-890e333e-54bb-4562-929d-c90052307e9a None None] MFA Rules not processed for user `18443cba7b7c4e7daa93f8e3b4d917cd`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:16:24.067602 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-890e333e-54bb-4562-929d-c90052307e9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:16:24.075235 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1151/2319] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:16:24 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:16:32.356143 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:34.059927 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=62,keystone:INSERT=3 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:41.722109 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74222676-5267-4519-8692-0b2fbc02a6f5 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:41.723466 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74222676-5267-4519-8692-0b2fbc02a6f5 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:41.723918 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74222676-5267-4519-8692-0b2fbc02a6f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:41.751435 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-74222676-5267-4519-8692-0b2fbc02a6f5 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:16:41.753278 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-74222676-5267-4519-8692-0b2fbc02a6f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:16:41.878895 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1169/2320] 10.222.0.58 () {58 vars in 1016 bytes} [Tue Aug 30 01:16:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:16:41.899281 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890e333e-54bb-4562-929d-c90052307e9a None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:41.901054 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-890e333e-54bb-4562-929d-c90052307e9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:16:41.995479 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890e333e-54bb-4562-929d-c90052307e9a None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:42.003949 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03466186-99a9-4911-8501-216b429f8311 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6480b2f14c37474c89df9fba48f7cd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:42.004429 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03466186-99a9-4911-8501-216b429f8311 service nova] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:42.004706 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03466186-99a9-4911-8501-216b429f8311 service nova] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:42.005093 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03466186-99a9-4911-8501-216b429f8311 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:42.015086 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03466186-99a9-4911-8501-216b429f8311 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:42.016815 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03466186-99a9-4911-8501-216b429f8311 service nova] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:42.028493 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1152/2321] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:16:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:16:48.099080 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f88af1-4773-4474-b2d7-74dc0ac7ec95 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:48.100277 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f88af1-4773-4474-b2d7-74dc0ac7ec95 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:48.100277 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f88af1-4773-4474-b2d7-74dc0ac7ec95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:48.136497 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-08f88af1-4773-4474-b2d7-74dc0ac7ec95 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:16:48.139004 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-08f88af1-4773-4474-b2d7-74dc0ac7ec95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:16:48.154521 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1170/2322] 10.222.0.58 () {58 vars in 1016 bytes} [Tue Aug 30 01:16:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:16:48.192773 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03466186-99a9-4911-8501-216b429f8311 service nova] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:48.210244 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03466186-99a9-4911-8501-216b429f8311 service nova] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:48.219852 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5573149a-02be-4101-bc8b-f7ff39958ce0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6480b2f14c37474c89df9fba48f7cd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:48.221073 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5573149a-02be-4101-bc8b-f7ff39958ce0 service nova] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:48.221983 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5573149a-02be-4101-bc8b-f7ff39958ce0 service nova] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:48.222458 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5573149a-02be-4101-bc8b-f7ff39958ce0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:48.235646 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5573149a-02be-4101-bc8b-f7ff39958ce0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:48.239343 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5573149a-02be-4101-bc8b-f7ff39958ce0 service nova] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:48.263117 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1153/2323] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:16:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 01:16:48.335258 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b0265d-a41a-43b7-8d64-540c9dd026e1 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:48.335906 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b0265d-a41a-43b7-8d64-540c9dd026e1 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:48.336193 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b0265d-a41a-43b7-8d64-540c9dd026e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:48.428840 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-99b0265d-a41a-43b7-8d64-540c9dd026e1 None None] MFA Rules not processed for user `3ddcdbd4269c44c9b9e8d1c109de061f`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:16:48.431866 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-99b0265d-a41a-43b7-8d64-540c9dd026e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:16:48.564527 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1171/2324] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:16:48 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:16:49.445301 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65d771c-3ba2-448e-826b-6fbee935cbf5 None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:49.446000 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65d771c-3ba2-448e-826b-6fbee935cbf5 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:49.446646 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65d771c-3ba2-448e-826b-6fbee935cbf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:49.480578 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-d65d771c-3ba2-448e-826b-6fbee935cbf5 None None] MFA Rules not processed for user `5cacaed93420436e8f423f96a8041401`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:16:49.483166 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-d65d771c-3ba2-448e-826b-6fbee935cbf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:16:49.613268 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1154/2325] 10.222.0.79 () {58 vars in 1009 bytes} [Tue Aug 30 01:16:49 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:16:49.652378 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b0265d-a41a-43b7-8d64-540c9dd026e1 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:49.655563 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-99b0265d-a41a-43b7-8d64-540c9dd026e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:16:49.779704 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b0265d-a41a-43b7-8d64-540c9dd026e1 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:49.789585 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3a60ed-cd8b-4154-bcaa-211c4ea0ed7e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd556fa6ba464928b1e067325792a523', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:49.790542 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3a60ed-cd8b-4154-bcaa-211c4ea0ed7e service swift] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:49.791015 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3a60ed-cd8b-4154-bcaa-211c4ea0ed7e service swift] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:49.791614 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3a60ed-cd8b-4154-bcaa-211c4ea0ed7e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:49.806484 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3a60ed-cd8b-4154-bcaa-211c4ea0ed7e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:49.809486 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3a60ed-cd8b-4154-bcaa-211c4ea0ed7e service swift] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:49.826880 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1172/2326] 10.222.0.79 () {60 vars in 1384 bytes} [Tue Aug 30 01:16:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 01:16:50.722179 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c511454-dd34-4664-a16e-b4faf266b310 None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:50.722770 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c511454-dd34-4664-a16e-b4faf266b310 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:50.722770 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c511454-dd34-4664-a16e-b4faf266b310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:50.747782 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-6c511454-dd34-4664-a16e-b4faf266b310 None None] MFA Rules not processed for user `5cacaed93420436e8f423f96a8041401`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:16:50.749943 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-6c511454-dd34-4664-a16e-b4faf266b310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:16:50.759347 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1155/2327] 10.222.0.79 () {58 vars in 967 bytes} [Tue Aug 30 01:16:50 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:16:50.776725 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3a60ed-cd8b-4154-bcaa-211c4ea0ed7e service swift] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:50.788712 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3a60ed-cd8b-4154-bcaa-211c4ea0ed7e service swift] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:50.795454 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e55587a-0c32-4aa1-af61-bd6af152e24a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd556fa6ba464928b1e067325792a523', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:50.796079 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e55587a-0c32-4aa1-af61-bd6af152e24a service swift] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:50.796360 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e55587a-0c32-4aa1-af61-bd6af152e24a service swift] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:50.796637 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e55587a-0c32-4aa1-af61-bd6af152e24a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:50.806949 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e55587a-0c32-4aa1-af61-bd6af152e24a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:50.808824 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e55587a-0c32-4aa1-af61-bd6af152e24a service swift] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:50.818830 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1173/2328] 10.222.0.79 () {60 vars in 1384 bytes} [Tue Aug 30 01:16:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 30 01:16:51.126016 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1249ffa-9d7e-41d0-9e23-21232bab97f9 None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:51.126470 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1249ffa-9d7e-41d0-9e23-21232bab97f9 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:51.126918 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1249ffa-9d7e-41d0-9e23-21232bab97f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:51.158324 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-d1249ffa-9d7e-41d0-9e23-21232bab97f9 None None] MFA Rules not processed for user `5cacaed93420436e8f423f96a8041401`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:16:51.160356 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-d1249ffa-9d7e-41d0-9e23-21232bab97f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:16:51.172961 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1156/2329] 10.222.0.79 () {58 vars in 1009 bytes} [Tue Aug 30 01:16:51 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:16:51.210599 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e55587a-0c32-4aa1-af61-bd6af152e24a service swift] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:51.233493 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e55587a-0c32-4aa1-af61-bd6af152e24a service swift] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:51.244605 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c618888f-8139-4ad6-b797-c339bce302b7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd556fa6ba464928b1e067325792a523', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:51.246381 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c618888f-8139-4ad6-b797-c339bce302b7 service swift] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:51.247498 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c618888f-8139-4ad6-b797-c339bce302b7 service swift] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:51.248390 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c618888f-8139-4ad6-b797-c339bce302b7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:51.271086 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c618888f-8139-4ad6-b797-c339bce302b7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:51.275909 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c618888f-8139-4ad6-b797-c339bce302b7 service swift] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:51.297904 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1174/2330] 10.222.0.79 () {60 vars in 1384 bytes} [Tue Aug 30 01:16:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 01:16:51.648175 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe6c3bc-fb48-40eb-918e-1fe77c5789f5 None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:51.648456 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe6c3bc-fb48-40eb-918e-1fe77c5789f5 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:51.648715 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe6c3bc-fb48-40eb-918e-1fe77c5789f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:51.680692 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-0fe6c3bc-fb48-40eb-918e-1fe77c5789f5 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:16:51.682930 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-0fe6c3bc-fb48-40eb-918e-1fe77c5789f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:16:51.696198 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1157/2331] 10.222.0.58 () {58 vars in 1016 bytes} [Tue Aug 30 01:16:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:16:51.722021 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c618888f-8139-4ad6-b797-c339bce302b7 service swift] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:51.730534 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:51.744052 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c618888f-8139-4ad6-b797-c339bce302b7 service swift] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:51.759118 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6645d926-714b-4c1d-b989-72fece9cdd52 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6480b2f14c37474c89df9fba48f7cd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:51.760808 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6645d926-714b-4c1d-b989-72fece9cdd52 service nova] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:51.762453 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6645d926-714b-4c1d-b989-72fece9cdd52 service nova] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:51.763782 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6645d926-714b-4c1d-b989-72fece9cdd52 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:51.788193 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6645d926-714b-4c1d-b989-72fece9cdd52 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:51.791984 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6645d926-714b-4c1d-b989-72fece9cdd52 service nova] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:51.829050 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1175/2332] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:16:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:16:51.872867 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6053c6-8cec-4b76-aa4c-78123e99752e None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:51.874034 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6053c6-8cec-4b76-aa4c-78123e99752e None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:51.874475 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6053c6-8cec-4b76-aa4c-78123e99752e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:51.897220 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-ad6053c6-8cec-4b76-aa4c-78123e99752e None None] MFA Rules not processed for user `5cacaed93420436e8f423f96a8041401`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:16:51.898462 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-ad6053c6-8cec-4b76-aa4c-78123e99752e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:16:51.907336 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1158/2333] 10.222.0.79 () {58 vars in 967 bytes} [Tue Aug 30 01:16:51 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:16:51.921508 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6645d926-714b-4c1d-b989-72fece9cdd52 service nova] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:51.943426 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6645d926-714b-4c1d-b989-72fece9cdd52 service nova] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:51.952332 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdcb184-3438-45b0-bd28-05fdc6087cfd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd556fa6ba464928b1e067325792a523', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:51.953049 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdcb184-3438-45b0-bd28-05fdc6087cfd service swift] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:51.953415 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdcb184-3438-45b0-bd28-05fdc6087cfd service swift] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:51.953800 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdcb184-3438-45b0-bd28-05fdc6087cfd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:51.964173 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdcb184-3438-45b0-bd28-05fdc6087cfd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:51.966216 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdcb184-3438-45b0-bd28-05fdc6087cfd service swift] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:51.976719 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1176/2334] 10.222.0.79 () {60 vars in 1384 bytes} [Tue Aug 30 01:16:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 30 01:16:54.765223 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6053c6-8cec-4b76-aa4c-78123e99752e None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:54.768591 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7482dfcd-c648-4b5d-8d5d-8321cc1912bb None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:54.769409 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7482dfcd-c648-4b5d-8d5d-8321cc1912bb None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:54.769616 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7482dfcd-c648-4b5d-8d5d-8321cc1912bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:54.779803 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6053c6-8cec-4b76-aa4c-78123e99752e None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:54.787256 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd14030-3397-4626-b9c6-636d3a4a5d81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:54.787918 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd14030-3397-4626-b9c6-636d3a4a5d81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:54.788198 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd14030-3397-4626-b9c6-636d3a4a5d81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:54.788473 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd14030-3397-4626-b9c6-636d3a4a5d81 admin admin] PATH_INFO: `/v3/users/18443cba7b7c4e7daa93f8e3b4d917cd` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:54.790436 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd14030-3397-4626-b9c6-636d3a4a5d81 admin admin] RBAC: Authorizing `identity:delete_user(user_id=18443cba7b7c4e7daa93f8e3b4d917cd)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:54.792484 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd14030-3397-4626-b9c6-636d3a4a5d81 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:54.796609 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-7482dfcd-c648-4b5d-8d5d-8321cc1912bb None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:16:54.798502 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-7482dfcd-c648-4b5d-8d5d-8321cc1912bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:16:54.812922 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1177/2335] 10.222.0.58 () {58 vars in 1016 bytes} [Tue Aug 30 01:16:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:16:54.833760 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7482dfcd-c648-4b5d-8d5d-8321cc1912bb None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:54.836239 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-7482dfcd-c648-4b5d-8d5d-8321cc1912bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:16:54.856058 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:54.859224 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7482dfcd-c648-4b5d-8d5d-8321cc1912bb None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:54.861014 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-cdd14030-3397-4626-b9c6-636d3a4a5d81 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18443cba7b7c4e7daa93f8e3b4d917cd'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:16:54.866644 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6e24eb-a2c9-4e58-894e-0cd81b762e9e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6480b2f14c37474c89df9fba48f7cd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:54.867522 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6e24eb-a2c9-4e58-894e-0cd81b762e9e service nova] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:54.868043 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6e24eb-a2c9-4e58-894e-0cd81b762e9e service nova] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:54.868505 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6e24eb-a2c9-4e58-894e-0cd81b762e9e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:54.876754 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-cdd14030-3397-4626-b9c6-636d3a4a5d81 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18443cba7b7c4e7daa93f8e3b4d917cd'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:16:54.884235 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6e24eb-a2c9-4e58-894e-0cd81b762e9e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:54.886942 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6e24eb-a2c9-4e58-894e-0cd81b762e9e service nova] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:54.900248 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-cdd14030-3397-4626-b9c6-636d3a4a5d81 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18443cba7b7c4e7daa93f8e3b4d917cd'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:16:54.901517 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-cdd14030-3397-4626-b9c6-636d3a4a5d81 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18443cba7b7c4e7daa93f8e3b4d917cd'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:16:54.902747 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1178/2336] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:16:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 01:16:54.915776 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-cdd14030-3397-4626-b9c6-636d3a4a5d81 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18443cba7b7c4e7daa93f8e3b4d917cd'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:16:54.927736 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1159/2337] 10.222.0.79 () {58 vars in 1224 bytes} [Tue Aug 30 01:16:54 2022] DELETE /identity/v3/users/18443cba7b7c4e7daa93f8e3b4d917cd => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:16:54.936167 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46917dff-caea-4c6c-ac63-237ec1e5dfe9 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:54.936735 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46917dff-caea-4c6c-ac63-237ec1e5dfe9 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:54.937285 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46917dff-caea-4c6c-ac63-237ec1e5dfe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:54.969934 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-46917dff-caea-4c6c-ac63-237ec1e5dfe9 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:16:54.972063 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-46917dff-caea-4c6c-ac63-237ec1e5dfe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:16:55.066353 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1179/2338] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:16:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:16:55.077997 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd14030-3397-4626-b9c6-636d3a4a5d81 admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:55.079738 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-cdd14030-3397-4626-b9c6-636d3a4a5d81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:16:55.154855 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd14030-3397-4626-b9c6-636d3a4a5d81 admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:55.161586 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bcc98e-a256-45ce-b2df-7d767bf8c02c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16e6a0ca26fc4ef892c188ad89a1e132', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:55.162975 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bcc98e-a256-45ce-b2df-7d767bf8c02c service neutron] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:55.163509 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bcc98e-a256-45ce-b2df-7d767bf8c02c service neutron] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:55.164003 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bcc98e-a256-45ce-b2df-7d767bf8c02c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:55.182761 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bcc98e-a256-45ce-b2df-7d767bf8c02c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:55.186277 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bcc98e-a256-45ce-b2df-7d767bf8c02c service neutron] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:55.206460 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1160/2339] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:16:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:16:55.492014 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46917dff-caea-4c6c-ac63-237ec1e5dfe9 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:55.493349 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-46917dff-caea-4c6c-ac63-237ec1e5dfe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:16:55.507828 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46917dff-caea-4c6c-ac63-237ec1e5dfe9 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:55.514173 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c6d1bc-7363-47df-b16e-8a1a584e95ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:55.514947 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c6d1bc-7363-47df-b16e-8a1a584e95ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:55.515337 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c6d1bc-7363-47df-b16e-8a1a584e95ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:55.515675 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c6d1bc-7363-47df-b16e-8a1a584e95ac admin admin] PATH_INFO: `/v3/projects/07510e6143104e199070703996a03770` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:55.517007 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c6d1bc-7363-47df-b16e-8a1a584e95ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=07510e6143104e199070703996a03770)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:55.519268 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c6d1bc-7363-47df-b16e-8a1a584e95ac admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:55.587400 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-75c6d1bc-7363-47df-b16e-8a1a584e95ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07510e6143104e199070703996a03770', 'request_id': 'req-75c6d1bc-7363-47df-b16e-8a1a584e95ac'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:16:55.601464 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-75c6d1bc-7363-47df-b16e-8a1a584e95ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07510e6143104e199070703996a03770', 'request_id': 'req-75c6d1bc-7363-47df-b16e-8a1a584e95ac'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:16:55.610247 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-75c6d1bc-7363-47df-b16e-8a1a584e95ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07510e6143104e199070703996a03770', 'request_id': 'req-75c6d1bc-7363-47df-b16e-8a1a584e95ac'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:16:55.624186 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-75c6d1bc-7363-47df-b16e-8a1a584e95ac admin admin] The token cache is being invalidate because project 07510e6143104e199070703996a03770 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:16:55.624557 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-75c6d1bc-7363-47df-b16e-8a1a584e95ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:16:55.625628 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-75c6d1bc-7363-47df-b16e-8a1a584e95ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:16:55.627835 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1180/2340] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 30 01:16:55 2022] DELETE /identity/v3/projects/07510e6143104e199070703996a03770 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:16:59.074733 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee5c3a5-7262-4cc3-86f9-c94fef20656c None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:59.076405 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee5c3a5-7262-4cc3-86f9-c94fef20656c None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:59.076405 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee5c3a5-7262-4cc3-86f9-c94fef20656c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:59.103739 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-3ee5c3a5-7262-4cc3-86f9-c94fef20656c None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:16:59.105670 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-3ee5c3a5-7262-4cc3-86f9-c94fef20656c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:16:59.208812 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1161/2341] 10.222.0.58 () {58 vars in 1016 bytes} [Tue Aug 30 01:16:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:16:59.224328 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c6d1bc-7363-47df-b16e-8a1a584e95ac admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:59.226296 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-75c6d1bc-7363-47df-b16e-8a1a584e95ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:16:59.300111 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:59.351084 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c6d1bc-7363-47df-b16e-8a1a584e95ac admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:59.359321 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bb3a36-8110-4ef0-9fca-96c6f00df0f2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6480b2f14c37474c89df9fba48f7cd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:59.359958 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bb3a36-8110-4ef0-9fca-96c6f00df0f2 service nova] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:59.360274 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bb3a36-8110-4ef0-9fca-96c6f00df0f2 service nova] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:59.360568 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bb3a36-8110-4ef0-9fca-96c6f00df0f2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:59.378721 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bb3a36-8110-4ef0-9fca-96c6f00df0f2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:59.380837 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bb3a36-8110-4ef0-9fca-96c6f00df0f2 service nova] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:59.397628 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1181/2342] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:16:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:17:03.439243 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858bbb1c-96ba-401a-ba5d-14d2b7b0b929 None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:03.439864 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858bbb1c-96ba-401a-ba5d-14d2b7b0b929 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:03.439864 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858bbb1c-96ba-401a-ba5d-14d2b7b0b929 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:03.461603 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-858bbb1c-96ba-401a-ba5d-14d2b7b0b929 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:17:03.462838 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-858bbb1c-96ba-401a-ba5d-14d2b7b0b929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:17:03.472164 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1162/2343] 10.222.0.58 () {58 vars in 1016 bytes} [Tue Aug 30 01:17:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:17:03.491436 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bb3a36-8110-4ef0-9fca-96c6f00df0f2 service nova] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:03.493343 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-97bb3a36-8110-4ef0-9fca-96c6f00df0f2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:17:03.517517 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bb3a36-8110-4ef0-9fca-96c6f00df0f2 service nova] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:03.524499 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09140ec-9d57-4dc2-84ec-e39b336b231b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6480b2f14c37474c89df9fba48f7cd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:03.525273 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09140ec-9d57-4dc2-84ec-e39b336b231b service nova] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:03.525512 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09140ec-9d57-4dc2-84ec-e39b336b231b service nova] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:03.525848 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09140ec-9d57-4dc2-84ec-e39b336b231b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:03.536467 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09140ec-9d57-4dc2-84ec-e39b336b231b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:03.538074 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09140ec-9d57-4dc2-84ec-e39b336b231b service nova] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:03.550325 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1182/2344] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:17:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:17:04.131404 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305cbb40-8ffb-4823-b812-f8644b8e3726 None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:04.132151 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305cbb40-8ffb-4823-b812-f8644b8e3726 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:04.132936 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305cbb40-8ffb-4823-b812-f8644b8e3726 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:04.179083 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-305cbb40-8ffb-4823-b812-f8644b8e3726 None None] MFA Rules not processed for user `3f1b91d3b73646c58cb2f49b416961f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:17:04.181857 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-305cbb40-8ffb-4823-b812-f8644b8e3726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:17:04.286532 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1163/2345] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:17:04 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:17:13.545213 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=22 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:14.278436 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=94,keystone:DELETE=3,keystone:INSERT=1 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:23.256736 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2857e31a-7c44-46f5-bd11-7512230e7bfe None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:23.257386 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2857e31a-7c44-46f5-bd11-7512230e7bfe None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:23.257386 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2857e31a-7c44-46f5-bd11-7512230e7bfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:23.284973 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-2857e31a-7c44-46f5-bd11-7512230e7bfe None None] MFA Rules not processed for user `ef92b49bac944122b2a24db6da89d7f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:17:23.286197 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-2857e31a-7c44-46f5-bd11-7512230e7bfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:17:23.368280 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1183/2346] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:17:23 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:17:26.313570 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5083d29-f211-468f-9f58-4b8f3806f879 None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:26.314100 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5083d29-f211-468f-9f58-4b8f3806f879 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:26.314100 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5083d29-f211-468f-9f58-4b8f3806f879 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:26.333243 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-e5083d29-f211-468f-9f58-4b8f3806f879 None None] MFA Rules not processed for user `111f8cc6017f42708b2c5ab85c9f68ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:17:26.334446 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-e5083d29-f211-468f-9f58-4b8f3806f879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:17:26.392379 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1164/2347] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:17:26 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:17:33.361681 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=25 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:36.388255 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=25 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:42.222868 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e88f6a-940e-4166-9eb5-b8cc5421dd11 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:42.223459 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e88f6a-940e-4166-9eb5-b8cc5421dd11 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:42.223459 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e88f6a-940e-4166-9eb5-b8cc5421dd11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:42.246283 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-35e88f6a-940e-4166-9eb5-b8cc5421dd11 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:17:42.247534 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-35e88f6a-940e-4166-9eb5-b8cc5421dd11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:17:42.255419 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1184/2348] 10.222.0.58 () {58 vars in 1016 bytes} [Tue Aug 30 01:17:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:17:42.270510 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5083d29-f211-468f-9f58-4b8f3806f879 None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:42.284572 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5083d29-f211-468f-9f58-4b8f3806f879 None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:42.290374 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2238e8d0-7b6c-474d-bf90-d23607c87f59 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6480b2f14c37474c89df9fba48f7cd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:42.290790 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2238e8d0-7b6c-474d-bf90-d23607c87f59 service nova] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:42.291001 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2238e8d0-7b6c-474d-bf90-d23607c87f59 service nova] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:42.291306 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2238e8d0-7b6c-474d-bf90-d23607c87f59 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:42.301227 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2238e8d0-7b6c-474d-bf90-d23607c87f59 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:42.302889 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2238e8d0-7b6c-474d-bf90-d23607c87f59 service nova] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:42.314107 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1165/2349] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:17:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:17:45.502410 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdaf615-8483-4bdd-89aa-88b3472c5d9f None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:45.503033 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdaf615-8483-4bdd-89aa-88b3472c5d9f None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:45.503033 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdaf615-8483-4bdd-89aa-88b3472c5d9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:45.523374 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-bfdaf615-8483-4bdd-89aa-88b3472c5d9f None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:17:45.524678 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-bfdaf615-8483-4bdd-89aa-88b3472c5d9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:17:45.533102 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1185/2350] 10.222.0.58 () {58 vars in 1016 bytes} [Tue Aug 30 01:17:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:17:45.552176 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2238e8d0-7b6c-474d-bf90-d23607c87f59 service nova] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:45.572923 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2238e8d0-7b6c-474d-bf90-d23607c87f59 service nova] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:45.582386 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57364603-90f0-48be-9afb-29fabae9a4f5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6480b2f14c37474c89df9fba48f7cd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:45.583307 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57364603-90f0-48be-9afb-29fabae9a4f5 service nova] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:45.583816 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57364603-90f0-48be-9afb-29fabae9a4f5 service nova] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:45.584328 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57364603-90f0-48be-9afb-29fabae9a4f5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:45.595986 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57364603-90f0-48be-9afb-29fabae9a4f5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:45.597731 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57364603-90f0-48be-9afb-29fabae9a4f5 service nova] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:45.609805 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1166/2351] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:17:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:17:48.658316 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bcf96d-6758-412c-8f87-118435b28462 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:48.659277 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bcf96d-6758-412c-8f87-118435b28462 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:48.659277 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bcf96d-6758-412c-8f87-118435b28462 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:48.684945 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-a7bcf96d-6758-412c-8f87-118435b28462 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:17:48.687280 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-a7bcf96d-6758-412c-8f87-118435b28462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:17:48.701416 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1186/2352] 10.222.0.58 () {58 vars in 1016 bytes} [Tue Aug 30 01:17:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:17:48.727886 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57364603-90f0-48be-9afb-29fabae9a4f5 service nova] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:48.741096 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57364603-90f0-48be-9afb-29fabae9a4f5 service nova] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:48.749181 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619893f6-a4cf-4d5b-9911-5b54135522c7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6480b2f14c37474c89df9fba48f7cd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:48.749814 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619893f6-a4cf-4d5b-9911-5b54135522c7 service nova] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:48.750093 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619893f6-a4cf-4d5b-9911-5b54135522c7 service nova] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:48.750364 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619893f6-a4cf-4d5b-9911-5b54135522c7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:48.759893 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619893f6-a4cf-4d5b-9911-5b54135522c7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:48.762281 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619893f6-a4cf-4d5b-9911-5b54135522c7 service nova] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:48.774079 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1167/2353] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:17:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:17:51.829948 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf660617-ca19-48c5-93ef-98b6725ebda7 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:51.830480 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf660617-ca19-48c5-93ef-98b6725ebda7 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:51.830480 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf660617-ca19-48c5-93ef-98b6725ebda7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:51.851561 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-cf660617-ca19-48c5-93ef-98b6725ebda7 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:17:51.852805 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-cf660617-ca19-48c5-93ef-98b6725ebda7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:17:51.862315 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1187/2354] 10.222.0.58 () {58 vars in 1016 bytes} [Tue Aug 30 01:17:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:17:51.884178 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619893f6-a4cf-4d5b-9911-5b54135522c7 service nova] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:51.897101 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619893f6-a4cf-4d5b-9911-5b54135522c7 service nova] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:51.903598 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44be567-4733-4636-a86a-12e14dd621da service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6480b2f14c37474c89df9fba48f7cd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:51.904221 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44be567-4733-4636-a86a-12e14dd621da service nova] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:51.904503 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44be567-4733-4636-a86a-12e14dd621da service nova] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:51.904780 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44be567-4733-4636-a86a-12e14dd621da service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:51.915120 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44be567-4733-4636-a86a-12e14dd621da service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:51.916837 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44be567-4733-4636-a86a-12e14dd621da service nova] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:51.930670 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1168/2355] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:17:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:17:58.121166 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051e3dbe-ed65-42b9-9e12-a091d2f68591 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:58.121682 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051e3dbe-ed65-42b9-9e12-a091d2f68591 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:58.121875 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051e3dbe-ed65-42b9-9e12-a091d2f68591 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:58.143959 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-051e3dbe-ed65-42b9-9e12-a091d2f68591 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:17:58.145174 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-051e3dbe-ed65-42b9-9e12-a091d2f68591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:17:58.156956 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1188/2356] 10.222.0.58 () {58 vars in 1016 bytes} [Tue Aug 30 01:17:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:17:58.174620 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44be567-4733-4636-a86a-12e14dd621da service nova] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:58.187305 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44be567-4733-4636-a86a-12e14dd621da service nova] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:58.193906 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fbd8c4-e7d9-431f-b243-a5cb04c7a83d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6480b2f14c37474c89df9fba48f7cd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:58.194520 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fbd8c4-e7d9-431f-b243-a5cb04c7a83d service nova] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:58.194793 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fbd8c4-e7d9-431f-b243-a5cb04c7a83d service nova] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:58.195066 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fbd8c4-e7d9-431f-b243-a5cb04c7a83d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:58.205315 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fbd8c4-e7d9-431f-b243-a5cb04c7a83d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:58.206907 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fbd8c4-e7d9-431f-b243-a5cb04c7a83d service nova] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:58.218007 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1169/2357] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:17:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:18:03.628442 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051e3dbe-ed65-42b9-9e12-a091d2f68591 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:18:03.633615 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-051e3dbe-ed65-42b9-9e12-a091d2f68591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:18:03.646854 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=16 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:18:03.795693 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051e3dbe-ed65-42b9-9e12-a091d2f68591 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:18:03.801193 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa17ed41-2a21-49c1-941a-8a385c9fced8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16e6a0ca26fc4ef892c188ad89a1e132', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:18:03.802070 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa17ed41-2a21-49c1-941a-8a385c9fced8 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:03.802628 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa17ed41-2a21-49c1-941a-8a385c9fced8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:03.803330 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa17ed41-2a21-49c1-941a-8a385c9fced8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:03.805585 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-aa17ed41-2a21-49c1-941a-8a385c9fced8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:18:03.825917 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa17ed41-2a21-49c1-941a-8a385c9fced8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:18:03.827911 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa17ed41-2a21-49c1-941a-8a385c9fced8 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:18:03.852819 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1189/2358] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:18:03 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:18:04.047013 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2f33ac-3e58-417c-b0ae-cf9fb22fc2d6 None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:04.049045 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2f33ac-3e58-417c-b0ae-cf9fb22fc2d6 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:04.049587 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2f33ac-3e58-417c-b0ae-cf9fb22fc2d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:04.086546 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-8e2f33ac-3e58-417c-b0ae-cf9fb22fc2d6 None None] MFA Rules not processed for user `5cacaed93420436e8f423f96a8041401`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:18:04.088577 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-8e2f33ac-3e58-417c-b0ae-cf9fb22fc2d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:18:04.188566 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1170/2359] 10.222.0.79 () {58 vars in 967 bytes} [Tue Aug 30 01:18:04 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:18:04.257901 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa17ed41-2a21-49c1-941a-8a385c9fced8 service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:18:04.259845 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-aa17ed41-2a21-49c1-941a-8a385c9fced8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:18:04.369416 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa17ed41-2a21-49c1-941a-8a385c9fced8 service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:18:04.375827 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c52bfc2-f7ac-4cb9-9451-d8975c5aee3f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd556fa6ba464928b1e067325792a523', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:18:04.376444 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c52bfc2-f7ac-4cb9-9451-d8975c5aee3f service swift] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:04.376721 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c52bfc2-f7ac-4cb9-9451-d8975c5aee3f service swift] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:04.376979 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c52bfc2-f7ac-4cb9-9451-d8975c5aee3f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:04.386791 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c52bfc2-f7ac-4cb9-9451-d8975c5aee3f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:18:04.388558 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c52bfc2-f7ac-4cb9-9451-d8975c5aee3f service swift] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:18:04.401722 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1190/2360] 10.222.0.79 () {60 vars in 1384 bytes} [Tue Aug 30 01:18:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 01:18:04.420560 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2f33ac-3e58-417c-b0ae-cf9fb22fc2d6 None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:18:04.422168 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-8e2f33ac-3e58-417c-b0ae-cf9fb22fc2d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:18:04.538974 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2f33ac-3e58-417c-b0ae-cf9fb22fc2d6 None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:18:04.546858 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ada84e-d27d-4d3e-b91b-dfa3f05f5a5a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f827c7670b74d938ffe066ced88d1c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:18:04.548200 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ada84e-d27d-4d3e-b91b-dfa3f05f5a5a service cinder] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:04.548708 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ada84e-d27d-4d3e-b91b-dfa3f05f5a5a service cinder] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:04.549195 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ada84e-d27d-4d3e-b91b-dfa3f05f5a5a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:04.553116 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-04ada84e-d27d-4d3e-b91b-dfa3f05f5a5a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:18:04.582793 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ada84e-d27d-4d3e-b91b-dfa3f05f5a5a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:18:04.586614 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ada84e-d27d-4d3e-b91b-dfa3f05f5a5a service cinder] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:18:04.610070 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1171/2361] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:18:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:18:14.394805 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=57 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:18:14.599065 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=81 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:18:17.095978 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c52bfc2-f7ac-4cb9-9451-d8975c5aee3f service swift] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:18:17.098700 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-9c52bfc2-f7ac-4cb9-9451-d8975c5aee3f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:18:17.129370 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c52bfc2-f7ac-4cb9-9451-d8975c5aee3f service swift] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:18:17.136790 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8fa6a4-cd2f-462b-bee6-cb1bed0d1e80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:18:17.137467 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8fa6a4-cd2f-462b-bee6-cb1bed0d1e80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:17.137728 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8fa6a4-cd2f-462b-bee6-cb1bed0d1e80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:17.138200 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8fa6a4-cd2f-462b-bee6-cb1bed0d1e80 admin admin] PATH_INFO: `/v3/users/ae567fa8585940bf98167103a86734de` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:17.139607 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8fa6a4-cd2f-462b-bee6-cb1bed0d1e80 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae567fa8585940bf98167103a86734de)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:18:17.142064 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8fa6a4-cd2f-462b-bee6-cb1bed0d1e80 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:18:17.205345 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-9f8fa6a4-cd2f-462b-bee6-cb1bed0d1e80 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae567fa8585940bf98167103a86734de'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:18:17.213674 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-9f8fa6a4-cd2f-462b-bee6-cb1bed0d1e80 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae567fa8585940bf98167103a86734de'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:18:17.223057 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-9f8fa6a4-cd2f-462b-bee6-cb1bed0d1e80 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae567fa8585940bf98167103a86734de'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:18:17.223992 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-9f8fa6a4-cd2f-462b-bee6-cb1bed0d1e80 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae567fa8585940bf98167103a86734de'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:18:17.245199 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-9f8fa6a4-cd2f-462b-bee6-cb1bed0d1e80 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae567fa8585940bf98167103a86734de'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:18:17.273200 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1191/2362] 10.222.0.79 () {58 vars in 1224 bytes} [Tue Aug 30 01:18:17 2022] DELETE /identity/v3/users/ae567fa8585940bf98167103a86734de => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:18:17.587721 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ada84e-d27d-4d3e-b91b-dfa3f05f5a5a service cinder] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:18:17.601607 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ada84e-d27d-4d3e-b91b-dfa3f05f5a5a service cinder] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:18:17.657490 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8fa6a4-cd2f-462b-bee6-cb1bed0d1e80 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:18:17.661636 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-9f8fa6a4-cd2f-462b-bee6-cb1bed0d1e80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:18:17.713664 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8285c32-4473-45a4-9437-829550617c06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:18:17.714540 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8285c32-4473-45a4-9437-829550617c06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:17.715570 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8285c32-4473-45a4-9437-829550617c06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:17.716055 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8285c32-4473-45a4-9437-829550617c06 admin admin] PATH_INFO: `/v3/projects/d0496703c1b04f2393bad32f8f36786d` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:17.717950 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8285c32-4473-45a4-9437-829550617c06 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0496703c1b04f2393bad32f8f36786d)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:18:17.723163 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8285c32-4473-45a4-9437-829550617c06 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:18:17.803796 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-e8285c32-4473-45a4-9437-829550617c06 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0496703c1b04f2393bad32f8f36786d', 'request_id': 'req-e8285c32-4473-45a4-9437-829550617c06'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:18:17.816641 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-e8285c32-4473-45a4-9437-829550617c06 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0496703c1b04f2393bad32f8f36786d', 'request_id': 'req-e8285c32-4473-45a4-9437-829550617c06'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:18:17.835319 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-e8285c32-4473-45a4-9437-829550617c06 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0496703c1b04f2393bad32f8f36786d', 'request_id': 'req-e8285c32-4473-45a4-9437-829550617c06'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:18:17.837654 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8fa6a4-cd2f-462b-bee6-cb1bed0d1e80 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:18:17.887719 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-e8285c32-4473-45a4-9437-829550617c06 admin admin] The token cache is being invalidate because project d0496703c1b04f2393bad32f8f36786d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81998) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:18:17.888591 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-e8285c32-4473-45a4-9437-829550617c06 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:18:17.891939 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-e8285c32-4473-45a4-9437-829550617c06 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:18:17.896102 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1172/2363] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 30 01:18:17 2022] DELETE /identity/v3/projects/d0496703c1b04f2393bad32f8f36786d => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:18:17.903116 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8285c32-4473-45a4-9437-829550617c06 admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:18:17.906045 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-e8285c32-4473-45a4-9437-829550617c06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:18:18.002818 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138dee09-1f27-4a18-a877-e7feae8d4508 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16e6a0ca26fc4ef892c188ad89a1e132', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:18:18.003496 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138dee09-1f27-4a18-a877-e7feae8d4508 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:18.003778 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138dee09-1f27-4a18-a877-e7feae8d4508 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:18.004048 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138dee09-1f27-4a18-a877-e7feae8d4508 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:18.011176 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-138dee09-1f27-4a18-a877-e7feae8d4508 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:18:18.116858 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8285c32-4473-45a4-9437-829550617c06 admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:18:18.138019 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5a826a-c4bf-464a-9985-f46ab3ed1d23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:18:18.139315 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5a826a-c4bf-464a-9985-f46ab3ed1d23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:18.140688 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5a826a-c4bf-464a-9985-f46ab3ed1d23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:18.142207 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5a826a-c4bf-464a-9985-f46ab3ed1d23 admin admin] PATH_INFO: `/v3/users/6b69223792314981a27f7d20e8a56f23` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:18.144607 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5a826a-c4bf-464a-9985-f46ab3ed1d23 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b69223792314981a27f7d20e8a56f23)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:18:18.147758 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5a826a-c4bf-464a-9985-f46ab3ed1d23 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:18:18.184750 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:18:18.230874 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138dee09-1f27-4a18-a877-e7feae8d4508 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:18:18.233558 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138dee09-1f27-4a18-a877-e7feae8d4508 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:18:18.239791 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:18:18.261890 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-1e5a826a-c4bf-464a-9985-f46ab3ed1d23 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b69223792314981a27f7d20e8a56f23'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:18:18.266332 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1192/2364] 10.222.0.79 () {60 vars in 1396 bytes} [Tue Aug 30 01:18:17 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3270 bytes in 609 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:18:18.279609 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-1e5a826a-c4bf-464a-9985-f46ab3ed1d23 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b69223792314981a27f7d20e8a56f23'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:18:18.323789 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-1e5a826a-c4bf-464a-9985-f46ab3ed1d23 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b69223792314981a27f7d20e8a56f23'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:18:18.326270 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-1e5a826a-c4bf-464a-9985-f46ab3ed1d23 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b69223792314981a27f7d20e8a56f23'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:18:18.360793 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-1e5a826a-c4bf-464a-9985-f46ab3ed1d23 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b69223792314981a27f7d20e8a56f23'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:18:18.369620 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1173/2365] 10.222.0.79 () {58 vars in 1224 bytes} [Tue Aug 30 01:18:17 2022] DELETE /identity/v3/users/6b69223792314981a27f7d20e8a56f23 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:18:18.844293 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138dee09-1f27-4a18-a877-e7feae8d4508 service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:18:18.873053 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138dee09-1f27-4a18-a877-e7feae8d4508 service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:18:19.026580 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5a826a-c4bf-464a-9985-f46ab3ed1d23 admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:18:19.028836 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-1e5a826a-c4bf-464a-9985-f46ab3ed1d23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:18:19.113857 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bf94d3-bb78-46f7-af77-7e32faf4ef99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:18:19.114770 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bf94d3-bb78-46f7-af77-7e32faf4ef99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:19.115170 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bf94d3-bb78-46f7-af77-7e32faf4ef99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:19.115551 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bf94d3-bb78-46f7-af77-7e32faf4ef99 admin admin] PATH_INFO: `/v3/projects/fffed7b4fdeb46eabb65bde68c9bb205` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:19.116956 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bf94d3-bb78-46f7-af77-7e32faf4ef99 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fffed7b4fdeb46eabb65bde68c9bb205)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:18:19.119115 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bf94d3-bb78-46f7-af77-7e32faf4ef99 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:18:19.129455 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5a826a-c4bf-464a-9985-f46ab3ed1d23 admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:18:19.138692 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288b591b-c76f-4006-a7a8-9209cb5d962a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6480b2f14c37474c89df9fba48f7cd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:18:19.139654 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288b591b-c76f-4006-a7a8-9209cb5d962a service nova] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:19.140122 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288b591b-c76f-4006-a7a8-9209cb5d962a service nova] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:19.140569 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288b591b-c76f-4006-a7a8-9209cb5d962a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:19.143014 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-288b591b-c76f-4006-a7a8-9209cb5d962a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:18:19.195754 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-15bf94d3-bb78-46f7-af77-7e32faf4ef99 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fffed7b4fdeb46eabb65bde68c9bb205', 'request_id': 'req-15bf94d3-bb78-46f7-af77-7e32faf4ef99'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:18:19.208025 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-15bf94d3-bb78-46f7-af77-7e32faf4ef99 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fffed7b4fdeb46eabb65bde68c9bb205', 'request_id': 'req-15bf94d3-bb78-46f7-af77-7e32faf4ef99'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:18:19.215911 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-15bf94d3-bb78-46f7-af77-7e32faf4ef99 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fffed7b4fdeb46eabb65bde68c9bb205', 'request_id': 'req-15bf94d3-bb78-46f7-af77-7e32faf4ef99'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:18:19.246199 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288b591b-c76f-4006-a7a8-9209cb5d962a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:18:19.248083 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288b591b-c76f-4006-a7a8-9209cb5d962a service nova] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:18:19.250681 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-15bf94d3-bb78-46f7-af77-7e32faf4ef99 admin admin] The token cache is being invalidate because project fffed7b4fdeb46eabb65bde68c9bb205 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:18:19.250984 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-15bf94d3-bb78-46f7-af77-7e32faf4ef99 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:18:19.253708 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-15bf94d3-bb78-46f7-af77-7e32faf4ef99 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:18:19.256438 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1193/2366] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 30 01:18:18 2022] DELETE /identity/v3/projects/fffed7b4fdeb46eabb65bde68c9bb205 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:18:19.279936 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1174/2367] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:18:19 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:18:22.314142 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d0d764-4116-4de8-aba5-9391f9f02f5f None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:22.315097 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d0d764-4116-4de8-aba5-9391f9f02f5f None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:22.315097 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d0d764-4116-4de8-aba5-9391f9f02f5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:22.341141 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-61d0d764-4116-4de8-aba5-9391f9f02f5f None None] MFA Rules not processed for user `3ddcdbd4269c44c9b9e8d1c109de061f`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:18:22.342403 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-61d0d764-4116-4de8-aba5-9391f9f02f5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:18:22.448055 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1194/2368] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:18:22 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:18:22.461577 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288b591b-c76f-4006-a7a8-9209cb5d962a service nova] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:18:22.463898 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-288b591b-c76f-4006-a7a8-9209cb5d962a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:18:22.504279 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288b591b-c76f-4006-a7a8-9209cb5d962a service nova] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:18:22.610687 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:18:22.668569 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8329537-5023-4019-bc47-900ee55ea22f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6480b2f14c37474c89df9fba48f7cd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:18:22.669433 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8329537-5023-4019-bc47-900ee55ea22f service nova] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:22.669843 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8329537-5023-4019-bc47-900ee55ea22f service nova] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:22.670473 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8329537-5023-4019-bc47-900ee55ea22f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:22.674623 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-f8329537-5023-4019-bc47-900ee55ea22f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:18:22.696366 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8329537-5023-4019-bc47-900ee55ea22f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:18:22.698887 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8329537-5023-4019-bc47-900ee55ea22f service nova] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:18:22.712030 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1175/2369] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:18:22 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:18:23.322977 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d0d764-4116-4de8-aba5-9391f9f02f5f None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:18:23.324471 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-61d0d764-4116-4de8-aba5-9391f9f02f5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:18:23.374041 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:18:23.435355 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d0d764-4116-4de8-aba5-9391f9f02f5f None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:18:23.442883 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10416d7b-28bd-4831-afec-1503d436e1ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16e6a0ca26fc4ef892c188ad89a1e132', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:18:23.443694 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10416d7b-28bd-4831-afec-1503d436e1ae service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:23.444374 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10416d7b-28bd-4831-afec-1503d436e1ae service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:23.444886 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10416d7b-28bd-4831-afec-1503d436e1ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:23.456058 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-10416d7b-28bd-4831-afec-1503d436e1ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:18:23.470198 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10416d7b-28bd-4831-afec-1503d436e1ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:18:23.472170 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10416d7b-28bd-4831-afec-1503d436e1ae service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:18:23.485695 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1195/2370] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:18:23 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:18:24.053803 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8329537-5023-4019-bc47-900ee55ea22f service nova] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:18:24.056450 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-f8329537-5023-4019-bc47-900ee55ea22f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:18:24.248750 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8329537-5023-4019-bc47-900ee55ea22f service nova] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:18:24.269144 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b86c69a-8ae9-40b2-ad60-4bb85acb6c08 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd68e91e4259e449797fb83de548aec1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:18:24.270173 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b86c69a-8ae9-40b2-ad60-4bb85acb6c08 service placement] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:24.270647 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b86c69a-8ae9-40b2-ad60-4bb85acb6c08 service placement] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:24.271252 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b86c69a-8ae9-40b2-ad60-4bb85acb6c08 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:24.276876 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-8b86c69a-8ae9-40b2-ad60-4bb85acb6c08 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:18:24.335297 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b86c69a-8ae9-40b2-ad60-4bb85acb6c08 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:18:24.337988 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b86c69a-8ae9-40b2-ad60-4bb85acb6c08 service placement] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:18:24.350332 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1176/2371] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:18:24 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:18:24.819634 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496d2280-d578-4897-ba3c-458a625a94c9 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:24.821111 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496d2280-d578-4897-ba3c-458a625a94c9 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:24.821955 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496d2280-d578-4897-ba3c-458a625a94c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:24.861519 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-496d2280-d578-4897-ba3c-458a625a94c9 None None] MFA Rules not processed for user `d8445faa3bd6407986d739614cdd3a67`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:18:24.862969 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-496d2280-d578-4897-ba3c-458a625a94c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:18:24.986399 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1196/2372] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:18:24 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:18:25.403444 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b86c69a-8ae9-40b2-ad60-4bb85acb6c08 service placement] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:18:25.414523 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b86c69a-8ae9-40b2-ad60-4bb85acb6c08 service placement] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:18:25.419971 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85eb34ae-e86b-44e8-a45b-9687529036d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16e6a0ca26fc4ef892c188ad89a1e132', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:18:25.420743 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eb34ae-e86b-44e8-a45b-9687529036d9 service neutron] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:25.421015 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eb34ae-e86b-44e8-a45b-9687529036d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:25.421531 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eb34ae-e86b-44e8-a45b-9687529036d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:25.423848 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-85eb34ae-e86b-44e8-a45b-9687529036d9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:18:25.503944 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85eb34ae-e86b-44e8-a45b-9687529036d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:18:25.505432 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85eb34ae-e86b-44e8-a45b-9687529036d9 service neutron] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:18:25.522081 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1177/2373] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:18:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:18:25.687289 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496d2280-d578-4897-ba3c-458a625a94c9 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:18:25.690175 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-496d2280-d578-4897-ba3c-458a625a94c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:18:25.707545 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496d2280-d578-4897-ba3c-458a625a94c9 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:18:25.713834 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4d8830-61f2-4bb6-9d20-22c753c2ca5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16e6a0ca26fc4ef892c188ad89a1e132', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:18:25.714928 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4d8830-61f2-4bb6-9d20-22c753c2ca5f service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:25.715404 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4d8830-61f2-4bb6-9d20-22c753c2ca5f service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:25.715799 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4d8830-61f2-4bb6-9d20-22c753c2ca5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:25.718594 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-8d4d8830-61f2-4bb6-9d20-22c753c2ca5f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:18:25.756326 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4d8830-61f2-4bb6-9d20-22c753c2ca5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:18:25.761958 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4d8830-61f2-4bb6-9d20-22c753c2ca5f service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:18:25.782540 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1197/2374] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:18:25 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:18:32.508475 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85eb34ae-e86b-44e8-a45b-9687529036d9 service neutron] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:18:32.511486 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-85eb34ae-e86b-44e8-a45b-9687529036d9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:18:32.542966 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85eb34ae-e86b-44e8-a45b-9687529036d9 service neutron] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:18:32.563717 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8b691e-d932-41fd-b50f-0f0692be1ac1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd68e91e4259e449797fb83de548aec1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:18:32.564841 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8b691e-d932-41fd-b50f-0f0692be1ac1 service placement] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:32.565319 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8b691e-d932-41fd-b50f-0f0692be1ac1 service placement] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:32.565813 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8b691e-d932-41fd-b50f-0f0692be1ac1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:32.570599 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-0f8b691e-d932-41fd-b50f-0f0692be1ac1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:18:32.597891 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8b691e-d932-41fd-b50f-0f0692be1ac1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:18:32.604754 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8b691e-d932-41fd-b50f-0f0692be1ac1 service placement] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:18:32.630699 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1178/2375] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:18:32 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:18:32.638781 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4d8830-61f2-4bb6-9d20-22c753c2ca5f service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:18:32.640472 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-8d4d8830-61f2-4bb6-9d20-22c753c2ca5f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:18:32.656894 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4d8830-61f2-4bb6-9d20-22c753c2ca5f service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:18:32.662995 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3b588e-4512-49cc-85cb-c1ba424a9ccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:18:32.663687 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3b588e-4512-49cc-85cb-c1ba424a9ccb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:32.663967 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3b588e-4512-49cc-85cb-c1ba424a9ccb admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:32.664238 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3b588e-4512-49cc-85cb-c1ba424a9ccb admin admin] PATH_INFO: `/v3/users/3f1b91d3b73646c58cb2f49b416961f4` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:32.665510 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3b588e-4512-49cc-85cb-c1ba424a9ccb admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f1b91d3b73646c58cb2f49b416961f4)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:18:32.668047 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3b588e-4512-49cc-85cb-c1ba424a9ccb admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:18:32.759151 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-ed3b588e-4512-49cc-85cb-c1ba424a9ccb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f1b91d3b73646c58cb2f49b416961f4'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:18:32.770941 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-ed3b588e-4512-49cc-85cb-c1ba424a9ccb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f1b91d3b73646c58cb2f49b416961f4'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:18:32.782836 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-ed3b588e-4512-49cc-85cb-c1ba424a9ccb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f1b91d3b73646c58cb2f49b416961f4'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:18:32.784292 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-ed3b588e-4512-49cc-85cb-c1ba424a9ccb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f1b91d3b73646c58cb2f49b416961f4'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:18:32.822139 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-ed3b588e-4512-49cc-85cb-c1ba424a9ccb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f1b91d3b73646c58cb2f49b416961f4'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:18:32.839315 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1198/2376] 10.222.0.79 () {58 vars in 1224 bytes} [Tue Aug 30 01:18:32 2022] DELETE /identity/v3/users/3f1b91d3b73646c58cb2f49b416961f4 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:18:33.212082 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8b691e-d932-41fd-b50f-0f0692be1ac1 service placement] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:18:33.231743 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8b691e-d932-41fd-b50f-0f0692be1ac1 service placement] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:18:33.294597 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:18:33.322794 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f82cea9-a7dd-442e-a84c-5c4a8c5e4dd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:18:33.323947 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f82cea9-a7dd-442e-a84c-5c4a8c5e4dd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:33.324432 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f82cea9-a7dd-442e-a84c-5c4a8c5e4dd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:33.324903 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f82cea9-a7dd-442e-a84c-5c4a8c5e4dd6 admin admin] PATH_INFO: `/v3/projects/749a5392b9e249dbbd2966645062d8c6` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:33.327074 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f82cea9-a7dd-442e-a84c-5c4a8c5e4dd6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=749a5392b9e249dbbd2966645062d8c6)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:18:33.330996 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f82cea9-a7dd-442e-a84c-5c4a8c5e4dd6 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:18:33.397188 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-8f82cea9-a7dd-442e-a84c-5c4a8c5e4dd6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '749a5392b9e249dbbd2966645062d8c6', 'request_id': 'req-8f82cea9-a7dd-442e-a84c-5c4a8c5e4dd6'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:18:33.409195 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-8f82cea9-a7dd-442e-a84c-5c4a8c5e4dd6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '749a5392b9e249dbbd2966645062d8c6', 'request_id': 'req-8f82cea9-a7dd-442e-a84c-5c4a8c5e4dd6'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:18:33.411861 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3b588e-4512-49cc-85cb-c1ba424a9ccb admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:18:33.414826 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-ed3b588e-4512-49cc-85cb-c1ba424a9ccb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:18:33.418845 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-8f82cea9-a7dd-442e-a84c-5c4a8c5e4dd6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '749a5392b9e249dbbd2966645062d8c6', 'request_id': 'req-8f82cea9-a7dd-442e-a84c-5c4a8c5e4dd6'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:18:33.436139 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-8f82cea9-a7dd-442e-a84c-5c4a8c5e4dd6 admin admin] The token cache is being invalidate because project 749a5392b9e249dbbd2966645062d8c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81998) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:18:33.436864 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-8f82cea9-a7dd-442e-a84c-5c4a8c5e4dd6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:18:33.437682 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-8f82cea9-a7dd-442e-a84c-5c4a8c5e4dd6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:18:33.440683 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1179/2377] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 30 01:18:33 2022] DELETE /identity/v3/projects/749a5392b9e249dbbd2966645062d8c6 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:18:33.453186 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a80751-c424-4360-9a97-e57e800dedd1 None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:33.453806 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a80751-c424-4360-9a97-e57e800dedd1 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:33.454437 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a80751-c424-4360-9a97-e57e800dedd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:33.477854 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:18:33.493556 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-a2a80751-c424-4360-9a97-e57e800dedd1 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:18:33.495953 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-a2a80751-c424-4360-9a97-e57e800dedd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:18:33.530570 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3b588e-4512-49cc-85cb-c1ba424a9ccb admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:18:33.626279 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b93ec08-08ea-42d4-ab51-5f6ccc324e5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16e6a0ca26fc4ef892c188ad89a1e132', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:18:33.627656 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b93ec08-08ea-42d4-ab51-5f6ccc324e5f service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:33.628119 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b93ec08-08ea-42d4-ab51-5f6ccc324e5f service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:33.628664 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b93ec08-08ea-42d4-ab51-5f6ccc324e5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:33.632429 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-9b93ec08-08ea-42d4-ab51-5f6ccc324e5f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:18:33.638356 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1180/2378] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:18:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:18:33.647453 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b93ec08-08ea-42d4-ab51-5f6ccc324e5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:18:33.652046 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92df1e13-ef8b-4304-aafb-ddd3bf9ce8f9 None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:33.652459 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92df1e13-ef8b-4304-aafb-ddd3bf9ce8f9 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:33.652625 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92df1e13-ef8b-4304-aafb-ddd3bf9ce8f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:33.656772 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b93ec08-08ea-42d4-ab51-5f6ccc324e5f service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:18:33.667736 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1199/2379] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:18:33 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 01:18:33.680718 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-92df1e13-ef8b-4304-aafb-ddd3bf9ce8f9 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:18:33.683319 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-92df1e13-ef8b-4304-aafb-ddd3bf9ce8f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:18:33.700492 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1181/2380] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:18:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:18:33.705653 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b93ec08-08ea-42d4-ab51-5f6ccc324e5f service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:18:33.731451 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b93ec08-08ea-42d4-ab51-5f6ccc324e5f service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:18:33.741854 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1d906e-7939-4644-ba31-7247a1ac681d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:18:33.743798 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1d906e-7939-4644-ba31-7247a1ac681d admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:33.743798 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1d906e-7939-4644-ba31-7247a1ac681d admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:33.745702 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1d906e-7939-4644-ba31-7247a1ac681d admin admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:33.747119 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1d906e-7939-4644-ba31-7247a1ac681d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:18:33.747980 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1d906e-7939-4644-ba31-7247a1ac681d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:18:33.752491 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1d906e-7939-4644-ba31-7247a1ac681d admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:18:33.771200 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1200/2381] 10.222.0.79 () {58 vars in 1153 bytes} [Tue Aug 30 01:18:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:18:33.773720 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92df1e13-ef8b-4304-aafb-ddd3bf9ce8f9 None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:18:33.787845 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92df1e13-ef8b-4304-aafb-ddd3bf9ce8f9 None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:18:33.796415 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf73a7e-881f-448c-9bd9-231555625abd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:18:33.796638 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf73a7e-881f-448c-9bd9-231555625abd admin admin] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:33.797017 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf73a7e-881f-448c-9bd9-231555625abd admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:33.797409 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf73a7e-881f-448c-9bd9-231555625abd admin admin] PATH_INFO: `/v3/projects` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:33.798167 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf73a7e-881f-448c-9bd9-231555625abd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:18:33.800475 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf73a7e-881f-448c-9bd9-231555625abd admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:18:33.868509 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1182/2382] 10.222.0.79 () {60 vars in 1153 bytes} [Tue Aug 30 01:18:33 2022] POST /identity/v3/projects => generated 365 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:18:33.871359 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1d906e-7939-4644-ba31-7247a1ac681d admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:18:33.882159 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1d906e-7939-4644-ba31-7247a1ac681d admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:18:34.026530 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7af239-71f4-4934-bf61-c299ae581117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:18:34.028811 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7af239-71f4-4934-bf61-c299ae581117 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:34.029511 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7af239-71f4-4934-bf61-c299ae581117 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:34.030754 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7af239-71f4-4934-bf61-c299ae581117 admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:34.031497 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7af239-71f4-4934-bf61-c299ae581117 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:18:34.035614 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7af239-71f4-4934-bf61-c299ae581117 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:18:34.078273 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1201/2383] 10.222.0.79 () {60 vars in 1144 bytes} [Tue Aug 30 01:18:33 2022] POST /identity/v3/users => generated 283 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:18:34.084721 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf73a7e-881f-448c-9bd9-231555625abd admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:18:34.102448 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf73a7e-881f-448c-9bd9-231555625abd admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:18:34.111374 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95da32f-3fa1-40a6-8eeb-76dda26e7f58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:18:34.112286 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95da32f-3fa1-40a6-8eeb-76dda26e7f58 admin admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:34.112750 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95da32f-3fa1-40a6-8eeb-76dda26e7f58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:34.113202 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95da32f-3fa1-40a6-8eeb-76dda26e7f58 admin admin] PATH_INFO: `/v3/roles` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:34.114283 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95da32f-3fa1-40a6-8eeb-76dda26e7f58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:18:34.116746 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95da32f-3fa1-40a6-8eeb-76dda26e7f58 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:18:34.132177 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1183/2384] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:18:34 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:18:34.138978 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7af239-71f4-4934-bf61-c299ae581117 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:18:34.152617 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7af239-71f4-4934-bf61-c299ae581117 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:18:34.159946 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ba5efa-e9ba-499f-b13b-0c0ffa3b52ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:18:34.160910 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ba5efa-e9ba-499f-b13b-0c0ffa3b52ad admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:34.161379 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ba5efa-e9ba-499f-b13b-0c0ffa3b52ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:34.166406 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ba5efa-e9ba-499f-b13b-0c0ffa3b52ad admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:34.170029 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ba5efa-e9ba-499f-b13b-0c0ffa3b52ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:18:34.185765 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ba5efa-e9ba-499f-b13b-0c0ffa3b52ad admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:18:34.217084 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1202/2385] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:18:34 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:18:34.221358 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95da32f-3fa1-40a6-8eeb-76dda26e7f58 admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:18:34.235611 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95da32f-3fa1-40a6-8eeb-76dda26e7f58 admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:18:34.243414 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9032b7f-16ab-4498-b8e8-caf4796398a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:18:34.259118 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9032b7f-16ab-4498-b8e8-caf4796398a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:34.260024 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9032b7f-16ab-4498-b8e8-caf4796398a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:34.260302 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9032b7f-16ab-4498-b8e8-caf4796398a3 admin admin] PATH_INFO: `/v3/projects/603880c4ccf348dea0ffac49788ec15e/users/9bed68dfaed04193802ba90f0908f748/roles/c37945a17623465f899d4f217e7af593` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:34.317776 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9032b7f-16ab-4498-b8e8-caf4796398a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=603880c4ccf348dea0ffac49788ec15e, user_id=9bed68dfaed04193802ba90f0908f748, role_id=c37945a17623465f899d4f217e7af593)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:18:34.326393 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9032b7f-16ab-4498-b8e8-caf4796398a3 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:18:34.359736 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1184/2386] 10.222.0.79 () {60 vars in 1483 bytes} [Tue Aug 30 01:18:34 2022] PUT /identity/v3/projects/603880c4ccf348dea0ffac49788ec15e/users/9bed68dfaed04193802ba90f0908f748/roles/c37945a17623465f899d4f217e7af593 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:18:34.377310 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f105d9f-f5ff-4098-bb38-982f7dac3c25 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:34.377723 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f105d9f-f5ff-4098-bb38-982f7dac3c25 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:34.378127 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f105d9f-f5ff-4098-bb38-982f7dac3c25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:34.422462 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-4f105d9f-f5ff-4098-bb38-982f7dac3c25 None None] MFA Rules not processed for user `9bed68dfaed04193802ba90f0908f748`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:18:34.424099 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-4f105d9f-f5ff-4098-bb38-982f7dac3c25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:18:34.507611 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:18:34.565116 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1203/2387] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:18:34 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:18:34.570282 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9032b7f-16ab-4498-b8e8-caf4796398a3 admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:18:34.583532 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:18:34.646189 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9032b7f-16ab-4498-b8e8-caf4796398a3 admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:18:34.651599 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe569a8-4a9a-4471-95fc-6260ef400621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:18:34.652220 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe569a8-4a9a-4471-95fc-6260ef400621 admin admin] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:34.652501 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe569a8-4a9a-4471-95fc-6260ef400621 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:34.652779 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe569a8-4a9a-4471-95fc-6260ef400621 admin admin] PATH_INFO: `/v3/projects` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:34.653426 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe569a8-4a9a-4471-95fc-6260ef400621 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:18:34.655412 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe569a8-4a9a-4471-95fc-6260ef400621 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:18:34.698928 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1185/2388] 10.222.0.79 () {60 vars in 1153 bytes} [Tue Aug 30 01:18:34 2022] POST /identity/v3/projects => generated 363 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:18:34.704252 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f105d9f-f5ff-4098-bb38-982f7dac3c25 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:18:34.720539 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f105d9f-f5ff-4098-bb38-982f7dac3c25 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:18:34.819200 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c5f791-373e-450c-bad9-93d18ba2f373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:18:34.820160 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c5f791-373e-450c-bad9-93d18ba2f373 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:34.820569 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c5f791-373e-450c-bad9-93d18ba2f373 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:34.822529 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c5f791-373e-450c-bad9-93d18ba2f373 admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:34.823406 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c5f791-373e-450c-bad9-93d18ba2f373 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:18:34.826309 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c5f791-373e-450c-bad9-93d18ba2f373 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:18:34.864066 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1204/2389] 10.222.0.79 () {60 vars in 1144 bytes} [Tue Aug 30 01:18:34 2022] POST /identity/v3/users => generated 288 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:18:34.866347 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe569a8-4a9a-4471-95fc-6260ef400621 admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:18:34.888165 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe569a8-4a9a-4471-95fc-6260ef400621 admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:18:34.897923 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307c6df3-83c9-441b-a60d-568bdc96f411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:18:34.899626 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307c6df3-83c9-441b-a60d-568bdc96f411 admin admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:34.900294 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307c6df3-83c9-441b-a60d-568bdc96f411 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:34.900966 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307c6df3-83c9-441b-a60d-568bdc96f411 admin admin] PATH_INFO: `/v3/roles` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:34.902059 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307c6df3-83c9-441b-a60d-568bdc96f411 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:18:34.904555 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307c6df3-83c9-441b-a60d-568bdc96f411 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:18:34.936389 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1186/2390] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:18:34 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:18:34.937969 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c5f791-373e-450c-bad9-93d18ba2f373 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:18:34.967225 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c5f791-373e-450c-bad9-93d18ba2f373 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:18:34.977123 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a10f3d7-daac-40b7-9ca5-1886b658b696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:18:34.978946 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a10f3d7-daac-40b7-9ca5-1886b658b696 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:34.979555 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a10f3d7-daac-40b7-9ca5-1886b658b696 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:34.980153 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a10f3d7-daac-40b7-9ca5-1886b658b696 admin admin] PATH_INFO: `/v3/projects/0af0efb3c4604d7e9a02792f6ac977eb/users/7b8d2bdefa3f4fe0b2fc2aa562b46ed8/roles/d14c3070c9184d76a7b23df69bd3db07` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:35.002384 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a10f3d7-daac-40b7-9ca5-1886b658b696 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0af0efb3c4604d7e9a02792f6ac977eb, user_id=7b8d2bdefa3f4fe0b2fc2aa562b46ed8, role_id=d14c3070c9184d76a7b23df69bd3db07)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:18:35.005983 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a10f3d7-daac-40b7-9ca5-1886b658b696 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:18:35.022347 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1205/2391] 10.222.0.79 () {60 vars in 1483 bytes} [Tue Aug 30 01:18:34 2022] PUT /identity/v3/projects/0af0efb3c4604d7e9a02792f6ac977eb/users/7b8d2bdefa3f4fe0b2fc2aa562b46ed8/roles/d14c3070c9184d76a7b23df69bd3db07 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:18:35.026940 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307c6df3-83c9-441b-a60d-568bdc96f411 admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:18:35.039634 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307c6df3-83c9-441b-a60d-568bdc96f411 admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:18:35.124752 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708e4e66-4021-485a-be30-e54ba39b68aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:18:35.125675 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708e4e66-4021-485a-be30-e54ba39b68aa admin admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:35.126210 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708e4e66-4021-485a-be30-e54ba39b68aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:35.126779 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708e4e66-4021-485a-be30-e54ba39b68aa admin admin] PATH_INFO: `/v3/roles` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:35.128218 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708e4e66-4021-485a-be30-e54ba39b68aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:18:35.131641 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708e4e66-4021-485a-be30-e54ba39b68aa admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:18:35.148358 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1187/2392] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:18:35 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 01:18:35.153167 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a10f3d7-daac-40b7-9ca5-1886b658b696 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:18:35.165295 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a10f3d7-daac-40b7-9ca5-1886b658b696 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:18:35.172394 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201c1070-769e-4ad4-8766-54462a2efe27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:18:35.173093 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201c1070-769e-4ad4-8766-54462a2efe27 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:35.173494 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201c1070-769e-4ad4-8766-54462a2efe27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:35.173673 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201c1070-769e-4ad4-8766-54462a2efe27 admin admin] PATH_INFO: `/v3/projects/0af0efb3c4604d7e9a02792f6ac977eb/users/7b8d2bdefa3f4fe0b2fc2aa562b46ed8/roles/d14c3070c9184d76a7b23df69bd3db07` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:35.176102 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201c1070-769e-4ad4-8766-54462a2efe27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0af0efb3c4604d7e9a02792f6ac977eb, user_id=7b8d2bdefa3f4fe0b2fc2aa562b46ed8, role_id=d14c3070c9184d76a7b23df69bd3db07)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:18:35.179104 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201c1070-769e-4ad4-8766-54462a2efe27 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:18:35.208946 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1206/2393] 10.222.0.79 () {60 vars in 1483 bytes} [Tue Aug 30 01:18:35 2022] PUT /identity/v3/projects/0af0efb3c4604d7e9a02792f6ac977eb/users/7b8d2bdefa3f4fe0b2fc2aa562b46ed8/roles/d14c3070c9184d76a7b23df69bd3db07 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:18:35.222462 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864ce20d-ca26-4faf-bd27-7adc870b42cc None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:35.222725 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864ce20d-ca26-4faf-bd27-7adc870b42cc None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:35.223157 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864ce20d-ca26-4faf-bd27-7adc870b42cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:35.267735 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-864ce20d-ca26-4faf-bd27-7adc870b42cc None None] MFA Rules not processed for user `7b8d2bdefa3f4fe0b2fc2aa562b46ed8`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:18:35.269703 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-864ce20d-ca26-4faf-bd27-7adc870b42cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:18:35.366020 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1188/2394] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:18:35 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:18:35.381699 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201c1070-769e-4ad4-8766-54462a2efe27 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:18:35.385181 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-201c1070-769e-4ad4-8766-54462a2efe27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:18:35.490190 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201c1070-769e-4ad4-8766-54462a2efe27 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:18:35.496240 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bfebfa-4d53-4b1d-82e2-c03f77f1b1cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f827c7670b74d938ffe066ced88d1c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:18:35.496922 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bfebfa-4d53-4b1d-82e2-c03f77f1b1cd service cinder] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:35.497200 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bfebfa-4d53-4b1d-82e2-c03f77f1b1cd service cinder] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:35.497475 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bfebfa-4d53-4b1d-82e2-c03f77f1b1cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:35.508370 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bfebfa-4d53-4b1d-82e2-c03f77f1b1cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:18:35.510732 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bfebfa-4d53-4b1d-82e2-c03f77f1b1cd service cinder] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:18:35.522579 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1207/2395] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:18:35 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:18:36.130615 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4be28c0-e300-46fa-8591-9c6d310e84b8 None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:36.130615 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4be28c0-e300-46fa-8591-9c6d310e84b8 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:36.130615 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4be28c0-e300-46fa-8591-9c6d310e84b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:36.140091 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:18:36.165323 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-f4be28c0-e300-46fa-8591-9c6d310e84b8 None None] MFA Rules not processed for user `5cacaed93420436e8f423f96a8041401`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:18:36.170142 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-f4be28c0-e300-46fa-8591-9c6d310e84b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:18:36.282665 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bfebfa-4d53-4b1d-82e2-c03f77f1b1cd service cinder] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:18:36.351623 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1189/2396] 10.222.0.79 () {58 vars in 1009 bytes} [Tue Aug 30 01:18:36 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:18:36.357841 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:18:36.360842 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4be28c0-e300-46fa-8591-9c6d310e84b8 None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:18:36.363670 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-f4be28c0-e300-46fa-8591-9c6d310e84b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:18:36.419667 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bfebfa-4d53-4b1d-82e2-c03f77f1b1cd service cinder] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:18:36.426503 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebd04e0-3e2f-4547-b815-a00e14302d59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:18:36.427736 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebd04e0-3e2f-4547-b815-a00e14302d59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:36.428013 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebd04e0-3e2f-4547-b815-a00e14302d59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:36.428412 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebd04e0-3e2f-4547-b815-a00e14302d59 admin admin] PATH_INFO: `/v3/users/9bed68dfaed04193802ba90f0908f748` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:36.429827 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebd04e0-3e2f-4547-b815-a00e14302d59 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9bed68dfaed04193802ba90f0908f748)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:18:36.433247 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebd04e0-3e2f-4547-b815-a00e14302d59 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:18:36.520354 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-eebd04e0-3e2f-4547-b815-a00e14302d59 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9bed68dfaed04193802ba90f0908f748'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:18:36.530275 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-eebd04e0-3e2f-4547-b815-a00e14302d59 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9bed68dfaed04193802ba90f0908f748'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:18:36.543229 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-eebd04e0-3e2f-4547-b815-a00e14302d59 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9bed68dfaed04193802ba90f0908f748'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:18:36.544675 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-eebd04e0-3e2f-4547-b815-a00e14302d59 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9bed68dfaed04193802ba90f0908f748'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:18:36.563169 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-eebd04e0-3e2f-4547-b815-a00e14302d59 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9bed68dfaed04193802ba90f0908f748'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:18:36.575876 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1208/2397] 10.222.0.79 () {58 vars in 1224 bytes} [Tue Aug 30 01:18:36 2022] DELETE /identity/v3/users/9bed68dfaed04193802ba90f0908f748 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:18:36.576821 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4be28c0-e300-46fa-8591-9c6d310e84b8 None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:18:36.577741 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54e15f7-9e7e-45d1-bb44-f0487372afbd None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:36.578081 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54e15f7-9e7e-45d1-bb44-f0487372afbd None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:36.578434 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54e15f7-9e7e-45d1-bb44-f0487372afbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:36.610528 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-c54e15f7-9e7e-45d1-bb44-f0487372afbd None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:18:36.611941 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-c54e15f7-9e7e-45d1-bb44-f0487372afbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:18:36.767806 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290f87c3-b816-4455-b8eb-3917e19119ad service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd556fa6ba464928b1e067325792a523', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:18:36.771426 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290f87c3-b816-4455-b8eb-3917e19119ad service swift] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:36.771813 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290f87c3-b816-4455-b8eb-3917e19119ad service swift] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:36.772245 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290f87c3-b816-4455-b8eb-3917e19119ad service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:36.778516 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-290f87c3-b816-4455-b8eb-3917e19119ad service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:18:36.840985 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1209/2398] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:18:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:18:36.851777 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54e15f7-9e7e-45d1-bb44-f0487372afbd None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:18:36.856664 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-c54e15f7-9e7e-45d1-bb44-f0487372afbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:18:36.981597 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:18:36.989594 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290f87c3-b816-4455-b8eb-3917e19119ad service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:18:36.992982 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290f87c3-b816-4455-b8eb-3917e19119ad service swift] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:18:37.014260 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1190/2399] 10.222.0.79 () {60 vars in 1384 bytes} [Tue Aug 30 01:18:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 657 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 01:18:37.023668 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54e15f7-9e7e-45d1-bb44-f0487372afbd None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:18:37.027773 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f871ade5-89ab-4c77-b094-42fca2d18539 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16e6a0ca26fc4ef892c188ad89a1e132', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:18:37.028399 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f871ade5-89ab-4c77-b094-42fca2d18539 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:37.028675 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f871ade5-89ab-4c77-b094-42fca2d18539 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:37.028944 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f871ade5-89ab-4c77-b094-42fca2d18539 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:37.039088 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:18:37.046446 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f871ade5-89ab-4c77-b094-42fca2d18539 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:18:37.048325 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f871ade5-89ab-4c77-b094-42fca2d18539 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:18:37.063985 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1210/2400] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:18:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:18:37.960630 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290f87c3-b816-4455-b8eb-3917e19119ad service swift] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:18:37.970269 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-290f87c3-b816-4455-b8eb-3917e19119ad service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:18:38.034245 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290f87c3-b816-4455-b8eb-3917e19119ad service swift] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:18:38.068712 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdc9756-2f27-4f68-83c7-024be8ddb625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:18:38.071042 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdc9756-2f27-4f68-83c7-024be8ddb625 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:38.077310 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdc9756-2f27-4f68-83c7-024be8ddb625 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:38.078160 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdc9756-2f27-4f68-83c7-024be8ddb625 admin admin] PATH_INFO: `/v3/projects/603880c4ccf348dea0ffac49788ec15e` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:38.086469 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdc9756-2f27-4f68-83c7-024be8ddb625 admin admin] RBAC: Authorizing `identity:delete_project(project_id=603880c4ccf348dea0ffac49788ec15e)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:18:38.092958 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdc9756-2f27-4f68-83c7-024be8ddb625 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:18:38.249452 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-3cdc9756-2f27-4f68-83c7-024be8ddb625 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '603880c4ccf348dea0ffac49788ec15e', 'request_id': 'req-3cdc9756-2f27-4f68-83c7-024be8ddb625'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:18:38.279812 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-3cdc9756-2f27-4f68-83c7-024be8ddb625 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '603880c4ccf348dea0ffac49788ec15e', 'request_id': 'req-3cdc9756-2f27-4f68-83c7-024be8ddb625'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:18:38.300754 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-3cdc9756-2f27-4f68-83c7-024be8ddb625 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '603880c4ccf348dea0ffac49788ec15e', 'request_id': 'req-3cdc9756-2f27-4f68-83c7-024be8ddb625'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:18:38.328646 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-3cdc9756-2f27-4f68-83c7-024be8ddb625 admin admin] The token cache is being invalidate because project 603880c4ccf348dea0ffac49788ec15e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81998) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:18:38.329083 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-3cdc9756-2f27-4f68-83c7-024be8ddb625 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:18:38.330398 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-3cdc9756-2f27-4f68-83c7-024be8ddb625 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:18:38.338207 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1191/2401] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 30 01:18:37 2022] DELETE /identity/v3/projects/603880c4ccf348dea0ffac49788ec15e => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:18:38.339598 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f871ade5-89ab-4c77-b094-42fca2d18539 service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:18:38.350974 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f871ade5-89ab-4c77-b094-42fca2d18539 service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:18:38.484609 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872f79ae-9ba9-4a99-a014-79e0bb6cb3b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:18:38.485512 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872f79ae-9ba9-4a99-a014-79e0bb6cb3b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:38.485798 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872f79ae-9ba9-4a99-a014-79e0bb6cb3b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:38.486178 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872f79ae-9ba9-4a99-a014-79e0bb6cb3b2 admin admin] PATH_INFO: `/v3/users/7b8d2bdefa3f4fe0b2fc2aa562b46ed8` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:38.487675 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872f79ae-9ba9-4a99-a014-79e0bb6cb3b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b8d2bdefa3f4fe0b2fc2aa562b46ed8)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:18:38.489918 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872f79ae-9ba9-4a99-a014-79e0bb6cb3b2 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:18:38.606449 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-872f79ae-9ba9-4a99-a014-79e0bb6cb3b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b8d2bdefa3f4fe0b2fc2aa562b46ed8'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:18:38.618373 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-872f79ae-9ba9-4a99-a014-79e0bb6cb3b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b8d2bdefa3f4fe0b2fc2aa562b46ed8'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:18:38.636837 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-872f79ae-9ba9-4a99-a014-79e0bb6cb3b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b8d2bdefa3f4fe0b2fc2aa562b46ed8'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:18:38.638117 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-872f79ae-9ba9-4a99-a014-79e0bb6cb3b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b8d2bdefa3f4fe0b2fc2aa562b46ed8'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:18:38.659935 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-872f79ae-9ba9-4a99-a014-79e0bb6cb3b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b8d2bdefa3f4fe0b2fc2aa562b46ed8'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:18:38.671948 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1211/2402] 10.222.0.79 () {58 vars in 1224 bytes} [Tue Aug 30 01:18:38 2022] DELETE /identity/v3/users/7b8d2bdefa3f4fe0b2fc2aa562b46ed8 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:18:39.216679 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdc9756-2f27-4f68-83c7-024be8ddb625 admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:18:39.220654 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-3cdc9756-2f27-4f68-83c7-024be8ddb625 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:18:39.279247 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdc9756-2f27-4f68-83c7-024be8ddb625 admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:18:39.457506 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ad46af-eca2-42a2-91e9-58e90751beaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:18:39.459245 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ad46af-eca2-42a2-91e9-58e90751beaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:39.460780 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ad46af-eca2-42a2-91e9-58e90751beaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:39.461339 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ad46af-eca2-42a2-91e9-58e90751beaf admin admin] PATH_INFO: `/v3/projects/0af0efb3c4604d7e9a02792f6ac977eb` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:39.473557 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ad46af-eca2-42a2-91e9-58e90751beaf admin admin] RBAC: Authorizing `identity:delete_project(project_id=0af0efb3c4604d7e9a02792f6ac977eb)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:18:39.483219 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ad46af-eca2-42a2-91e9-58e90751beaf admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:18:39.622437 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-41ad46af-eca2-42a2-91e9-58e90751beaf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0af0efb3c4604d7e9a02792f6ac977eb', 'request_id': 'req-41ad46af-eca2-42a2-91e9-58e90751beaf'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:18:39.637441 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-41ad46af-eca2-42a2-91e9-58e90751beaf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0af0efb3c4604d7e9a02792f6ac977eb', 'request_id': 'req-41ad46af-eca2-42a2-91e9-58e90751beaf'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:18:39.659308 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-41ad46af-eca2-42a2-91e9-58e90751beaf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0af0efb3c4604d7e9a02792f6ac977eb', 'request_id': 'req-41ad46af-eca2-42a2-91e9-58e90751beaf'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:18:39.680887 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-41ad46af-eca2-42a2-91e9-58e90751beaf admin admin] The token cache is being invalidate because project 0af0efb3c4604d7e9a02792f6ac977eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81998) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:18:39.682051 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-41ad46af-eca2-42a2-91e9-58e90751beaf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:18:39.682962 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-41ad46af-eca2-42a2-91e9-58e90751beaf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:18:39.685422 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1192/2403] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 30 01:18:39 2022] DELETE /identity/v3/projects/0af0efb3c4604d7e9a02792f6ac977eb => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:18:39.692949 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c8b88b-dc05-467a-b237-410bebac62f1 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:39.694667 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c8b88b-dc05-467a-b237-410bebac62f1 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:39.695567 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c8b88b-dc05-467a-b237-410bebac62f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:39.778317 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-23c8b88b-dc05-467a-b237-410bebac62f1 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:18:39.780410 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-23c8b88b-dc05-467a-b237-410bebac62f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:18:39.882177 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1212/2404] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:18:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:18:39.895366 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec3a12b-ee29-4c42-962d-9f26e758fbbf None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:39.895794 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec3a12b-ee29-4c42-962d-9f26e758fbbf None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:39.896247 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec3a12b-ee29-4c42-962d-9f26e758fbbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:39.930791 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:18:39.947587 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-eec3a12b-ee29-4c42-962d-9f26e758fbbf None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:18:39.950204 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-eec3a12b-ee29-4c42-962d-9f26e758fbbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:18:39.964978 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1193/2405] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:18:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:18:39.971834 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c8b88b-dc05-467a-b237-410bebac62f1 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:18:39.998493 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c8b88b-dc05-467a-b237-410bebac62f1 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:18:40.004414 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321d6396-92b6-4c47-b31d-d0ae4da9a307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:18:40.005333 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321d6396-92b6-4c47-b31d-d0ae4da9a307 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:40.005583 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321d6396-92b6-4c47-b31d-d0ae4da9a307 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:40.005859 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321d6396-92b6-4c47-b31d-d0ae4da9a307 admin admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:40.006713 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321d6396-92b6-4c47-b31d-d0ae4da9a307 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:18:40.007114 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321d6396-92b6-4c47-b31d-d0ae4da9a307 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:18:40.009934 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321d6396-92b6-4c47-b31d-d0ae4da9a307 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:18:40.028980 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1213/2406] 10.222.0.79 () {58 vars in 1153 bytes} [Tue Aug 30 01:18:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:18:40.037238 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec3a12b-ee29-4c42-962d-9f26e758fbbf None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:18:40.058268 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec3a12b-ee29-4c42-962d-9f26e758fbbf None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:18:40.077493 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9ec8da-0497-44e0-99f7-cf489660a7f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:18:40.078613 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9ec8da-0497-44e0-99f7-cf489660a7f2 admin admin] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:40.079162 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9ec8da-0497-44e0-99f7-cf489660a7f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:40.079612 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9ec8da-0497-44e0-99f7-cf489660a7f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:40.080722 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9ec8da-0497-44e0-99f7-cf489660a7f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:18:40.084006 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9ec8da-0497-44e0-99f7-cf489660a7f2 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:18:40.150633 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1194/2407] 10.222.0.79 () {60 vars in 1153 bytes} [Tue Aug 30 01:18:40 2022] POST /identity/v3/projects => generated 369 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:18:40.152044 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321d6396-92b6-4c47-b31d-d0ae4da9a307 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:18:40.162408 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:18:40.177408 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321d6396-92b6-4c47-b31d-d0ae4da9a307 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:18:40.343589 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc6b7b0-94eb-403f-a759-47d788a778d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:18:40.344803 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc6b7b0-94eb-403f-a759-47d788a778d9 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:40.345385 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc6b7b0-94eb-403f-a759-47d788a778d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:40.345840 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc6b7b0-94eb-403f-a759-47d788a778d9 admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:40.346733 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc6b7b0-94eb-403f-a759-47d788a778d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:18:40.349938 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc6b7b0-94eb-403f-a759-47d788a778d9 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:18:40.381255 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1214/2408] 10.222.0.79 () {60 vars in 1144 bytes} [Tue Aug 30 01:18:40 2022] POST /identity/v3/users => generated 285 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:18:40.388236 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9ec8da-0497-44e0-99f7-cf489660a7f2 admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:18:40.413478 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9ec8da-0497-44e0-99f7-cf489660a7f2 admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:18:40.424723 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1a88ae-b818-4cad-978e-a410beb3b16d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:18:40.429049 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1a88ae-b818-4cad-978e-a410beb3b16d admin admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:40.429795 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1a88ae-b818-4cad-978e-a410beb3b16d admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:40.430396 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1a88ae-b818-4cad-978e-a410beb3b16d admin admin] PATH_INFO: `/v3/roles` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:40.434475 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1a88ae-b818-4cad-978e-a410beb3b16d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:18:40.437780 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1a88ae-b818-4cad-978e-a410beb3b16d admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:18:40.461578 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1195/2409] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:18:40 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:18:40.466787 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc6b7b0-94eb-403f-a759-47d788a778d9 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:18:40.486870 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc6b7b0-94eb-403f-a759-47d788a778d9 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:18:40.500186 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba9a444-4f7d-4921-be3d-60959837c15a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:18:40.501187 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba9a444-4f7d-4921-be3d-60959837c15a admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:40.501651 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba9a444-4f7d-4921-be3d-60959837c15a admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:40.502245 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba9a444-4f7d-4921-be3d-60959837c15a admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:40.503255 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba9a444-4f7d-4921-be3d-60959837c15a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:18:40.507625 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba9a444-4f7d-4921-be3d-60959837c15a admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:18:40.530782 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1215/2410] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:18:40 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:18:40.533875 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1a88ae-b818-4cad-978e-a410beb3b16d admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:18:40.555219 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1a88ae-b818-4cad-978e-a410beb3b16d admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:18:40.569477 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1aa919-4df8-4a7d-81ee-0894b68ec1b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:18:40.571082 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1aa919-4df8-4a7d-81ee-0894b68ec1b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:40.572774 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1aa919-4df8-4a7d-81ee-0894b68ec1b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:40.573161 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1aa919-4df8-4a7d-81ee-0894b68ec1b4 admin admin] PATH_INFO: `/v3/projects/f1e9354ce5424a55a2d6961753a608d7/users/1069b3ec8d1541dd92cb7715c4f6cb1b/roles/c37945a17623465f899d4f217e7af593` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:40.621474 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1aa919-4df8-4a7d-81ee-0894b68ec1b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1e9354ce5424a55a2d6961753a608d7, user_id=1069b3ec8d1541dd92cb7715c4f6cb1b, role_id=c37945a17623465f899d4f217e7af593)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:18:40.629980 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1aa919-4df8-4a7d-81ee-0894b68ec1b4 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:18:40.658528 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1196/2411] 10.222.0.79 () {60 vars in 1483 bytes} [Tue Aug 30 01:18:40 2022] PUT /identity/v3/projects/f1e9354ce5424a55a2d6961753a608d7/users/1069b3ec8d1541dd92cb7715c4f6cb1b/roles/c37945a17623465f899d4f217e7af593 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:18:40.690809 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46106f40-55f2-4790-aec7-1b7f8800bea7 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:40.692967 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46106f40-55f2-4790-aec7-1b7f8800bea7 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:40.698867 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46106f40-55f2-4790-aec7-1b7f8800bea7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:40.801337 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-46106f40-55f2-4790-aec7-1b7f8800bea7 None None] MFA Rules not processed for user `1069b3ec8d1541dd92cb7715c4f6cb1b`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:18:40.802989 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-46106f40-55f2-4790-aec7-1b7f8800bea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:18:40.950457 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1216/2412] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:18:40 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:18:40.953481 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1aa919-4df8-4a7d-81ee-0894b68ec1b4 admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:18:41.101931 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1aa919-4df8-4a7d-81ee-0894b68ec1b4 admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:18:41.114349 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104c96d4-3f80-4c16-affe-f8328d61b125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:18:41.115239 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104c96d4-3f80-4c16-affe-f8328d61b125 admin admin] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:41.115626 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104c96d4-3f80-4c16-affe-f8328d61b125 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:41.116001 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104c96d4-3f80-4c16-affe-f8328d61b125 admin admin] PATH_INFO: `/v3/projects` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:41.117655 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104c96d4-3f80-4c16-affe-f8328d61b125 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:18:41.121206 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104c96d4-3f80-4c16-affe-f8328d61b125 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:18:41.178118 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1197/2413] 10.222.0.79 () {60 vars in 1153 bytes} [Tue Aug 30 01:18:40 2022] POST /identity/v3/projects => generated 367 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:18:41.183924 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46106f40-55f2-4790-aec7-1b7f8800bea7 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:18:41.227360 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46106f40-55f2-4790-aec7-1b7f8800bea7 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:18:41.418027 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9bcf2a-2eb0-461b-8379-cc78b9c43d03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:18:41.419765 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9bcf2a-2eb0-461b-8379-cc78b9c43d03 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:41.420328 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9bcf2a-2eb0-461b-8379-cc78b9c43d03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:41.421381 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9bcf2a-2eb0-461b-8379-cc78b9c43d03 admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:41.422268 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9bcf2a-2eb0-461b-8379-cc78b9c43d03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:18:41.425824 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9bcf2a-2eb0-461b-8379-cc78b9c43d03 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:18:41.460618 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:18:41.473246 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1217/2414] 10.222.0.79 () {60 vars in 1144 bytes} [Tue Aug 30 01:18:41 2022] POST /identity/v3/users => generated 290 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:18:41.477289 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104c96d4-3f80-4c16-affe-f8328d61b125 admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:18:41.500122 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104c96d4-3f80-4c16-affe-f8328d61b125 admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:18:41.510592 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7611b90-d370-4b5e-a10b-67e4e85f0415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:18:41.511877 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7611b90-d370-4b5e-a10b-67e4e85f0415 admin admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:41.512360 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7611b90-d370-4b5e-a10b-67e4e85f0415 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:41.512832 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7611b90-d370-4b5e-a10b-67e4e85f0415 admin admin] PATH_INFO: `/v3/roles` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:41.514052 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7611b90-d370-4b5e-a10b-67e4e85f0415 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:18:41.517232 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7611b90-d370-4b5e-a10b-67e4e85f0415 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:18:41.549309 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1198/2415] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:18:41 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:18:41.550613 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9bcf2a-2eb0-461b-8379-cc78b9c43d03 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:18:41.564417 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9bcf2a-2eb0-461b-8379-cc78b9c43d03 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:18:41.579762 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef9568b-22f2-4e03-b880-2a23c039e72e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:18:41.580728 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef9568b-22f2-4e03-b880-2a23c039e72e admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:41.581085 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef9568b-22f2-4e03-b880-2a23c039e72e admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:41.581462 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef9568b-22f2-4e03-b880-2a23c039e72e admin admin] PATH_INFO: `/v3/projects/413aff28689047efa8a0559ac4606171/users/4dc610e4d25445d9820683758fedeb7e/roles/d14c3070c9184d76a7b23df69bd3db07` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:41.603875 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef9568b-22f2-4e03-b880-2a23c039e72e admin admin] RBAC: Authorizing `identity:create_grant(project_id=413aff28689047efa8a0559ac4606171, user_id=4dc610e4d25445d9820683758fedeb7e, role_id=d14c3070c9184d76a7b23df69bd3db07)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:18:41.607117 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef9568b-22f2-4e03-b880-2a23c039e72e admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:18:41.672115 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1218/2416] 10.222.0.79 () {60 vars in 1483 bytes} [Tue Aug 30 01:18:41 2022] PUT /identity/v3/projects/413aff28689047efa8a0559ac4606171/users/4dc610e4d25445d9820683758fedeb7e/roles/d14c3070c9184d76a7b23df69bd3db07 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:18:41.672645 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7611b90-d370-4b5e-a10b-67e4e85f0415 admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:18:41.688022 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7611b90-d370-4b5e-a10b-67e4e85f0415 admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:18:41.901569 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70df56e0-2e29-4fa2-b7fc-58c72793a72e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:18:41.902579 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70df56e0-2e29-4fa2-b7fc-58c72793a72e admin admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:41.903003 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70df56e0-2e29-4fa2-b7fc-58c72793a72e admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:41.903459 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70df56e0-2e29-4fa2-b7fc-58c72793a72e admin admin] PATH_INFO: `/v3/roles` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:41.904338 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70df56e0-2e29-4fa2-b7fc-58c72793a72e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:18:41.906790 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70df56e0-2e29-4fa2-b7fc-58c72793a72e admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:18:41.934431 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1199/2417] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:18:41 2022] GET /identity/v3/roles => generated 1420 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:18:41.939781 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef9568b-22f2-4e03-b880-2a23c039e72e admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:18:41.983568 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef9568b-22f2-4e03-b880-2a23c039e72e admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:18:41.994656 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ef64c8-3420-46e3-8a9a-ac2ef9e5f919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:18:41.995987 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ef64c8-3420-46e3-8a9a-ac2ef9e5f919 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:41.996898 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ef64c8-3420-46e3-8a9a-ac2ef9e5f919 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:41.997397 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ef64c8-3420-46e3-8a9a-ac2ef9e5f919 admin admin] PATH_INFO: `/v3/projects/413aff28689047efa8a0559ac4606171/users/4dc610e4d25445d9820683758fedeb7e/roles/d14c3070c9184d76a7b23df69bd3db07` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:42.000123 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ef64c8-3420-46e3-8a9a-ac2ef9e5f919 admin admin] RBAC: Authorizing `identity:create_grant(project_id=413aff28689047efa8a0559ac4606171, user_id=4dc610e4d25445d9820683758fedeb7e, role_id=d14c3070c9184d76a7b23df69bd3db07)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:18:42.003500 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ef64c8-3420-46e3-8a9a-ac2ef9e5f919 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:18:42.020676 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1219/2418] 10.222.0.79 () {60 vars in 1483 bytes} [Tue Aug 30 01:18:41 2022] PUT /identity/v3/projects/413aff28689047efa8a0559ac4606171/users/4dc610e4d25445d9820683758fedeb7e/roles/d14c3070c9184d76a7b23df69bd3db07 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:18:42.042917 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2827cfb-a898-43d5-bd72-7c70990b4fac None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:42.043448 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2827cfb-a898-43d5-bd72-7c70990b4fac None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:42.043928 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2827cfb-a898-43d5-bd72-7c70990b4fac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:42.086469 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ef64c8-3420-46e3-8a9a-ac2ef9e5f919 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:18:42.090526 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-88ef64c8-3420-46e3-8a9a-ac2ef9e5f919 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:18:42.125939 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:18:42.135786 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-b2827cfb-a898-43d5-bd72-7c70990b4fac None None] MFA Rules not processed for user `4dc610e4d25445d9820683758fedeb7e`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:18:42.139659 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-b2827cfb-a898-43d5-bd72-7c70990b4fac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:18:42.301812 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ef64c8-3420-46e3-8a9a-ac2ef9e5f919 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:18:42.310983 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507b4944-f308-447e-8f83-22244e216439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:18:42.312183 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507b4944-f308-447e-8f83-22244e216439 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:42.312866 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507b4944-f308-447e-8f83-22244e216439 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:42.313373 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507b4944-f308-447e-8f83-22244e216439 admin admin] PATH_INFO: `/v3/users/111f8cc6017f42708b2c5ab85c9f68ee` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:42.316322 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507b4944-f308-447e-8f83-22244e216439 admin admin] RBAC: Authorizing `identity:delete_user(user_id=111f8cc6017f42708b2c5ab85c9f68ee)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:18:42.322076 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507b4944-f308-447e-8f83-22244e216439 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:18:42.337091 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1200/2419] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:18:42 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:18:42.357227 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2827cfb-a898-43d5-bd72-7c70990b4fac None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:18:42.359936 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-b2827cfb-a898-43d5-bd72-7c70990b4fac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:18:42.448228 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-507b4944-f308-447e-8f83-22244e216439 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '111f8cc6017f42708b2c5ab85c9f68ee'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:18:42.473683 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-507b4944-f308-447e-8f83-22244e216439 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '111f8cc6017f42708b2c5ab85c9f68ee'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:18:42.510792 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-507b4944-f308-447e-8f83-22244e216439 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '111f8cc6017f42708b2c5ab85c9f68ee'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:18:42.512601 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-507b4944-f308-447e-8f83-22244e216439 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '111f8cc6017f42708b2c5ab85c9f68ee'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:18:42.531683 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2827cfb-a898-43d5-bd72-7c70990b4fac None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:18:42.535700 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-507b4944-f308-447e-8f83-22244e216439 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '111f8cc6017f42708b2c5ab85c9f68ee'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:18:42.543970 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6166b6-e2a4-41ef-af06-12ae3fcf965f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f827c7670b74d938ffe066ced88d1c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:18:42.545594 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6166b6-e2a4-41ef-af06-12ae3fcf965f service cinder] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:42.546235 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6166b6-e2a4-41ef-af06-12ae3fcf965f service cinder] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:42.546808 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6166b6-e2a4-41ef-af06-12ae3fcf965f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:42.547008 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1220/2420] 10.222.0.79 () {58 vars in 1224 bytes} [Tue Aug 30 01:18:42 2022] DELETE /identity/v3/users/111f8cc6017f42708b2c5ab85c9f68ee => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:18:42.571170 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-7a6166b6-e2a4-41ef-af06-12ae3fcf965f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:18:42.624837 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6166b6-e2a4-41ef-af06-12ae3fcf965f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:18:42.628131 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6166b6-e2a4-41ef-af06-12ae3fcf965f service cinder] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:18:42.653358 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1201/2421] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:18:42 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:18:42.754038 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507b4944-f308-447e-8f83-22244e216439 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:18:42.757570 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-507b4944-f308-447e-8f83-22244e216439 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:18:42.870155 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:18:42.888966 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507b4944-f308-447e-8f83-22244e216439 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:18:42.894871 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0400f457-adbf-4264-a797-fdf4a65f2620 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f827c7670b74d938ffe066ced88d1c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:18:42.895823 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0400f457-adbf-4264-a797-fdf4a65f2620 service cinder] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:42.896257 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0400f457-adbf-4264-a797-fdf4a65f2620 service cinder] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:42.896706 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0400f457-adbf-4264-a797-fdf4a65f2620 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:42.898849 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-0400f457-adbf-4264-a797-fdf4a65f2620 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:18:42.946078 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6166b6-e2a4-41ef-af06-12ae3fcf965f service cinder] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:18:42.948741 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-7a6166b6-e2a4-41ef-af06-12ae3fcf965f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:18:42.997643 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6166b6-e2a4-41ef-af06-12ae3fcf965f service cinder] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:18:43.081439 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0400f457-adbf-4264-a797-fdf4a65f2620 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:18:43.082907 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0400f457-adbf-4264-a797-fdf4a65f2620 service cinder] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:18:43.122560 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1221/2422] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:18:42 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:18:43.273966 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2705f2fb-4a9d-4d2a-b12f-3541b9e35690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:18:43.274528 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2705f2fb-4a9d-4d2a-b12f-3541b9e35690 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:43.275782 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2705f2fb-4a9d-4d2a-b12f-3541b9e35690 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:43.275782 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2705f2fb-4a9d-4d2a-b12f-3541b9e35690 admin admin] PATH_INFO: `/v3/projects/d2aa4bad874341bb95918605cf120eb7` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:43.278869 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2705f2fb-4a9d-4d2a-b12f-3541b9e35690 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2aa4bad874341bb95918605cf120eb7)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:18:43.281016 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2705f2fb-4a9d-4d2a-b12f-3541b9e35690 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:18:43.356067 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:18:43.363340 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-2705f2fb-4a9d-4d2a-b12f-3541b9e35690 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2aa4bad874341bb95918605cf120eb7', 'request_id': 'req-2705f2fb-4a9d-4d2a-b12f-3541b9e35690'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:18:43.387938 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-2705f2fb-4a9d-4d2a-b12f-3541b9e35690 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2aa4bad874341bb95918605cf120eb7', 'request_id': 'req-2705f2fb-4a9d-4d2a-b12f-3541b9e35690'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:18:43.443542 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-2705f2fb-4a9d-4d2a-b12f-3541b9e35690 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2aa4bad874341bb95918605cf120eb7', 'request_id': 'req-2705f2fb-4a9d-4d2a-b12f-3541b9e35690'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:18:43.480753 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-2705f2fb-4a9d-4d2a-b12f-3541b9e35690 admin admin] The token cache is being invalidate because project d2aa4bad874341bb95918605cf120eb7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81998) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:18:43.481073 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-2705f2fb-4a9d-4d2a-b12f-3541b9e35690 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:18:43.482263 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-2705f2fb-4a9d-4d2a-b12f-3541b9e35690 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:18:43.499314 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1202/2423] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 30 01:18:42 2022] DELETE /identity/v3/projects/d2aa4bad874341bb95918605cf120eb7 => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:18:44.309209 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0400f457-adbf-4264-a797-fdf4a65f2620 service cinder] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:18:44.312000 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-0400f457-adbf-4264-a797-fdf4a65f2620 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:18:44.507038 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0400f457-adbf-4264-a797-fdf4a65f2620 service cinder] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:18:44.662879 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd839e04-f6ae-4496-b6ba-e8a921870d76 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6480b2f14c37474c89df9fba48f7cd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:18:44.663552 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd839e04-f6ae-4496-b6ba-e8a921870d76 service nova] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:44.663844 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd839e04-f6ae-4496-b6ba-e8a921870d76 service nova] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:44.664101 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd839e04-f6ae-4496-b6ba-e8a921870d76 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:44.667325 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-bd839e04-f6ae-4496-b6ba-e8a921870d76 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:18:44.687617 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd839e04-f6ae-4496-b6ba-e8a921870d76 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:18:44.689746 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd839e04-f6ae-4496-b6ba-e8a921870d76 service nova] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:18:44.704918 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1222/2424] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:18:44 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:18:48.376388 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2705f2fb-4a9d-4d2a-b12f-3541b9e35690 admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:18:48.379532 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-2705f2fb-4a9d-4d2a-b12f-3541b9e35690 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:18:48.561141 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2705f2fb-4a9d-4d2a-b12f-3541b9e35690 admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:18:48.577228 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bccde0-c7ce-4f51-8ce1-c5052bfdbc2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:18:48.578530 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bccde0-c7ce-4f51-8ce1-c5052bfdbc2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:48.579165 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bccde0-c7ce-4f51-8ce1-c5052bfdbc2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:48.580018 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bccde0-c7ce-4f51-8ce1-c5052bfdbc2e admin admin] PATH_INFO: `/v3/users/1069b3ec8d1541dd92cb7715c4f6cb1b` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:48.582526 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bccde0-c7ce-4f51-8ce1-c5052bfdbc2e admin admin] RBAC: Authorizing `identity:delete_user(user_id=1069b3ec8d1541dd92cb7715c4f6cb1b)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:18:48.588847 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bccde0-c7ce-4f51-8ce1-c5052bfdbc2e admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:18:48.731030 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-c4bccde0-c7ce-4f51-8ce1-c5052bfdbc2e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1069b3ec8d1541dd92cb7715c4f6cb1b'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:18:48.742594 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-c4bccde0-c7ce-4f51-8ce1-c5052bfdbc2e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1069b3ec8d1541dd92cb7715c4f6cb1b'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:18:48.767089 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-c4bccde0-c7ce-4f51-8ce1-c5052bfdbc2e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1069b3ec8d1541dd92cb7715c4f6cb1b'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:18:48.767908 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-c4bccde0-c7ce-4f51-8ce1-c5052bfdbc2e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1069b3ec8d1541dd92cb7715c4f6cb1b'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:18:48.780975 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-c4bccde0-c7ce-4f51-8ce1-c5052bfdbc2e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1069b3ec8d1541dd92cb7715c4f6cb1b'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:18:48.797955 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1203/2425] 10.222.0.79 () {58 vars in 1224 bytes} [Tue Aug 30 01:18:48 2022] DELETE /identity/v3/users/1069b3ec8d1541dd92cb7715c4f6cb1b => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:18:48.800570 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce43ad7b-7502-4556-a361-4292438aef7e None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:48.800951 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce43ad7b-7502-4556-a361-4292438aef7e None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:48.800951 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce43ad7b-7502-4556-a361-4292438aef7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:48.828182 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-ce43ad7b-7502-4556-a361-4292438aef7e None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:18:48.829769 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-ce43ad7b-7502-4556-a361-4292438aef7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:18:48.853007 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:18:48.950307 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1223/2426] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:18:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:18:48.963942 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bccde0-c7ce-4f51-8ce1-c5052bfdbc2e admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:18:48.966019 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-c4bccde0-c7ce-4f51-8ce1-c5052bfdbc2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:18:49.049354 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce43ad7b-7502-4556-a361-4292438aef7e None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:18:49.050858 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bccde0-c7ce-4f51-8ce1-c5052bfdbc2e admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:18:49.051517 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-ce43ad7b-7502-4556-a361-4292438aef7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:18:49.055472 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e94ebe-e0bb-4bc8-acb2-f2a2e93b445d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16e6a0ca26fc4ef892c188ad89a1e132', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:18:49.056485 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e94ebe-e0bb-4bc8-acb2-f2a2e93b445d service neutron] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:49.056761 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e94ebe-e0bb-4bc8-acb2-f2a2e93b445d service neutron] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:49.057275 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e94ebe-e0bb-4bc8-acb2-f2a2e93b445d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:49.064256 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:18:49.079731 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e94ebe-e0bb-4bc8-acb2-f2a2e93b445d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:18:49.083236 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e94ebe-e0bb-4bc8-acb2-f2a2e93b445d service neutron] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:18:49.097049 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1204/2427] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:18:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 01:18:49.253196 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce43ad7b-7502-4556-a361-4292438aef7e None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:18:49.271956 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95565af6-852f-42ab-b6ed-ec4476a656e8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6480b2f14c37474c89df9fba48f7cd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:18:49.275199 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95565af6-852f-42ab-b6ed-ec4476a656e8 service nova] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:49.278645 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95565af6-852f-42ab-b6ed-ec4476a656e8 service nova] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:49.280989 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95565af6-852f-42ab-b6ed-ec4476a656e8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:49.287301 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-95565af6-852f-42ab-b6ed-ec4476a656e8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:18:49.332820 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95565af6-852f-42ab-b6ed-ec4476a656e8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:18:49.334816 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95565af6-852f-42ab-b6ed-ec4476a656e8 service nova] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:18:49.356438 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1224/2428] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:18:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 01:18:50.038654 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e94ebe-e0bb-4bc8-acb2-f2a2e93b445d service neutron] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:18:50.041583 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-a0e94ebe-e0bb-4bc8-acb2-f2a2e93b445d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:18:50.073171 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e94ebe-e0bb-4bc8-acb2-f2a2e93b445d service neutron] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:18:50.090781 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a005128-ed31-4d05-ba00-99b856d3b6aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:18:50.093068 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a005128-ed31-4d05-ba00-99b856d3b6aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:50.093586 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a005128-ed31-4d05-ba00-99b856d3b6aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:50.094021 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a005128-ed31-4d05-ba00-99b856d3b6aa admin admin] PATH_INFO: `/v3/projects/f1e9354ce5424a55a2d6961753a608d7` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:50.096926 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a005128-ed31-4d05-ba00-99b856d3b6aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1e9354ce5424a55a2d6961753a608d7)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:18:50.099503 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a005128-ed31-4d05-ba00-99b856d3b6aa admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:18:50.199578 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-0a005128-ed31-4d05-ba00-99b856d3b6aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1e9354ce5424a55a2d6961753a608d7', 'request_id': 'req-0a005128-ed31-4d05-ba00-99b856d3b6aa'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:18:50.214477 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-0a005128-ed31-4d05-ba00-99b856d3b6aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1e9354ce5424a55a2d6961753a608d7', 'request_id': 'req-0a005128-ed31-4d05-ba00-99b856d3b6aa'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:18:50.227098 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-0a005128-ed31-4d05-ba00-99b856d3b6aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1e9354ce5424a55a2d6961753a608d7', 'request_id': 'req-0a005128-ed31-4d05-ba00-99b856d3b6aa'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:18:50.259566 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-0a005128-ed31-4d05-ba00-99b856d3b6aa admin admin] The token cache is being invalidate because project f1e9354ce5424a55a2d6961753a608d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81998) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:18:50.260087 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-0a005128-ed31-4d05-ba00-99b856d3b6aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:18:50.260881 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-0a005128-ed31-4d05-ba00-99b856d3b6aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:18:50.262851 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1205/2429] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 30 01:18:50 2022] DELETE /identity/v3/projects/f1e9354ce5424a55a2d6961753a608d7 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:18:50.268606 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95565af6-852f-42ab-b6ed-ec4476a656e8 service nova] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:18:50.286702 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95565af6-852f-42ab-b6ed-ec4476a656e8 service nova] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:18:50.425000 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2047a6-d999-47f1-8eb5-196786f707f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:18:50.425677 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2047a6-d999-47f1-8eb5-196786f707f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:50.426451 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2047a6-d999-47f1-8eb5-196786f707f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:50.426933 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2047a6-d999-47f1-8eb5-196786f707f4 admin admin] PATH_INFO: `/v3/users/4dc610e4d25445d9820683758fedeb7e` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:50.428278 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2047a6-d999-47f1-8eb5-196786f707f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4dc610e4d25445d9820683758fedeb7e)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:18:50.432709 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2047a6-d999-47f1-8eb5-196786f707f4 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:18:50.571021 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-1d2047a6-d999-47f1-8eb5-196786f707f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4dc610e4d25445d9820683758fedeb7e'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:18:50.573055 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:18:50.585559 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-1d2047a6-d999-47f1-8eb5-196786f707f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4dc610e4d25445d9820683758fedeb7e'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:18:50.609859 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-1d2047a6-d999-47f1-8eb5-196786f707f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4dc610e4d25445d9820683758fedeb7e'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:18:50.610883 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-1d2047a6-d999-47f1-8eb5-196786f707f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4dc610e4d25445d9820683758fedeb7e'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:18:50.632375 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-1d2047a6-d999-47f1-8eb5-196786f707f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4dc610e4d25445d9820683758fedeb7e'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:18:50.642168 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1225/2430] 10.222.0.79 () {58 vars in 1224 bytes} [Tue Aug 30 01:18:50 2022] DELETE /identity/v3/users/4dc610e4d25445d9820683758fedeb7e => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:18:51.382069 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a005128-ed31-4d05-ba00-99b856d3b6aa admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:18:51.384455 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-0a005128-ed31-4d05-ba00-99b856d3b6aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:18:51.413580 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a005128-ed31-4d05-ba00-99b856d3b6aa admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:18:51.517167 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a478cd0e-1ff9-475d-af47-cd54484dd89c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:18:51.517861 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a478cd0e-1ff9-475d-af47-cd54484dd89c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:51.518115 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a478cd0e-1ff9-475d-af47-cd54484dd89c admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:51.518395 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a478cd0e-1ff9-475d-af47-cd54484dd89c admin admin] PATH_INFO: `/v3/projects/413aff28689047efa8a0559ac4606171` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:51.519746 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a478cd0e-1ff9-475d-af47-cd54484dd89c admin admin] RBAC: Authorizing `identity:delete_project(project_id=413aff28689047efa8a0559ac4606171)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:18:51.521777 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a478cd0e-1ff9-475d-af47-cd54484dd89c admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:18:51.591175 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-a478cd0e-1ff9-475d-af47-cd54484dd89c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '413aff28689047efa8a0559ac4606171', 'request_id': 'req-a478cd0e-1ff9-475d-af47-cd54484dd89c'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:18:51.601032 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-a478cd0e-1ff9-475d-af47-cd54484dd89c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '413aff28689047efa8a0559ac4606171', 'request_id': 'req-a478cd0e-1ff9-475d-af47-cd54484dd89c'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:18:51.610627 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-a478cd0e-1ff9-475d-af47-cd54484dd89c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '413aff28689047efa8a0559ac4606171', 'request_id': 'req-a478cd0e-1ff9-475d-af47-cd54484dd89c'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:18:51.633496 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-a478cd0e-1ff9-475d-af47-cd54484dd89c admin admin] The token cache is being invalidate because project 413aff28689047efa8a0559ac4606171 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81998) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:18:51.634551 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-a478cd0e-1ff9-475d-af47-cd54484dd89c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:18:51.636075 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-a478cd0e-1ff9-475d-af47-cd54484dd89c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:18:51.638343 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1206/2431] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 30 01:18:51 2022] DELETE /identity/v3/projects/413aff28689047efa8a0559ac4606171 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:18:51.645598 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0e0190-62e2-4f9f-9452-01a7c399b308 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:51.646143 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0e0190-62e2-4f9f-9452-01a7c399b308 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:51.646385 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0e0190-62e2-4f9f-9452-01a7c399b308 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:51.683521 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-0e0e0190-62e2-4f9f-9452-01a7c399b308 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:18:51.685097 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-0e0e0190-62e2-4f9f-9452-01a7c399b308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:18:51.810578 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1226/2432] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:18:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:18:51.813355 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787fd184-5129-4889-9df2-b6f473d155c0 None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:51.813726 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787fd184-5129-4889-9df2-b6f473d155c0 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:51.814118 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787fd184-5129-4889-9df2-b6f473d155c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:51.832555 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:18:51.840278 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-787fd184-5129-4889-9df2-b6f473d155c0 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:18:51.844824 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-787fd184-5129-4889-9df2-b6f473d155c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:18:51.857071 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1207/2433] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:18:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:18:51.862218 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0e0190-62e2-4f9f-9452-01a7c399b308 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:18:51.878514 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0e0190-62e2-4f9f-9452-01a7c399b308 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:18:51.887991 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de26d65-5432-4e65-8f6d-271f8e3bacb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:18:51.888902 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de26d65-5432-4e65-8f6d-271f8e3bacb9 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:51.889373 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de26d65-5432-4e65-8f6d-271f8e3bacb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:51.890019 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de26d65-5432-4e65-8f6d-271f8e3bacb9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:51.891239 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de26d65-5432-4e65-8f6d-271f8e3bacb9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:18:51.891771 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de26d65-5432-4e65-8f6d-271f8e3bacb9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:18:51.894607 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de26d65-5432-4e65-8f6d-271f8e3bacb9 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:18:51.921751 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1227/2434] 10.222.0.79 () {58 vars in 1153 bytes} [Tue Aug 30 01:18:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:18:51.923200 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787fd184-5129-4889-9df2-b6f473d155c0 None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:18:51.937539 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787fd184-5129-4889-9df2-b6f473d155c0 None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:18:51.943342 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c593e250-4ec9-44da-84f4-81b717ea3af5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:18:51.944210 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c593e250-4ec9-44da-84f4-81b717ea3af5 admin admin] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:51.944668 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c593e250-4ec9-44da-84f4-81b717ea3af5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:51.945091 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c593e250-4ec9-44da-84f4-81b717ea3af5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:51.946147 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c593e250-4ec9-44da-84f4-81b717ea3af5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:18:51.948730 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c593e250-4ec9-44da-84f4-81b717ea3af5 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:18:51.989018 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1208/2435] 10.222.0.79 () {60 vars in 1153 bytes} [Tue Aug 30 01:18:51 2022] POST /identity/v3/projects => generated 401 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:18:51.995696 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de26d65-5432-4e65-8f6d-271f8e3bacb9 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:18:52.024899 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de26d65-5432-4e65-8f6d-271f8e3bacb9 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:18:52.124050 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd9506a-e26f-4038-b969-ee386c9e7dec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:18:52.125373 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd9506a-e26f-4038-b969-ee386c9e7dec admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:52.127213 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd9506a-e26f-4038-b969-ee386c9e7dec admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:52.127914 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd9506a-e26f-4038-b969-ee386c9e7dec admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:52.129084 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd9506a-e26f-4038-b969-ee386c9e7dec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:18:52.131646 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd9506a-e26f-4038-b969-ee386c9e7dec admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:18:52.170167 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1228/2436] 10.222.0.79 () {60 vars in 1144 bytes} [Tue Aug 30 01:18:51 2022] POST /identity/v3/users => generated 301 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:18:52.175347 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c593e250-4ec9-44da-84f4-81b717ea3af5 admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:18:52.223756 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c593e250-4ec9-44da-84f4-81b717ea3af5 admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:18:52.235345 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1dac95-1d27-45f4-a2aa-720aa2eda9b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:18:52.236754 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1dac95-1d27-45f4-a2aa-720aa2eda9b4 admin admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:52.237493 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1dac95-1d27-45f4-a2aa-720aa2eda9b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:52.238198 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1dac95-1d27-45f4-a2aa-720aa2eda9b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:52.240149 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1dac95-1d27-45f4-a2aa-720aa2eda9b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:18:52.245230 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1dac95-1d27-45f4-a2aa-720aa2eda9b4 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:18:52.270610 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1209/2437] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:18:52 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:18:52.276549 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd9506a-e26f-4038-b969-ee386c9e7dec admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:18:52.296356 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd9506a-e26f-4038-b969-ee386c9e7dec admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:18:52.304943 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd84e76-b0d4-4c3d-8d1f-dfacb40719c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:18:52.306151 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd84e76-b0d4-4c3d-8d1f-dfacb40719c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:52.306655 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd84e76-b0d4-4c3d-8d1f-dfacb40719c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:52.307234 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd84e76-b0d4-4c3d-8d1f-dfacb40719c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:52.308601 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd84e76-b0d4-4c3d-8d1f-dfacb40719c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:18:52.311840 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd84e76-b0d4-4c3d-8d1f-dfacb40719c4 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:18:52.336388 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1229/2438] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:18:52 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 01:18:52.341850 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1dac95-1d27-45f4-a2aa-720aa2eda9b4 admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:18:52.376639 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1dac95-1d27-45f4-a2aa-720aa2eda9b4 admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:18:52.390637 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02722c14-3539-4be8-a751-e96410992c07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:18:52.391818 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02722c14-3539-4be8-a751-e96410992c07 admin admin] REQUEST_METHOD: `PUT` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:52.392486 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02722c14-3539-4be8-a751-e96410992c07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:52.392968 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02722c14-3539-4be8-a751-e96410992c07 admin admin] PATH_INFO: `/v3/projects/ccf05bea21dc44b9959025aaaa0f4593/users/61a9281cd4f34f9aa0ec037c5ef4e0e3/roles/c37945a17623465f899d4f217e7af593` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:52.421328 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02722c14-3539-4be8-a751-e96410992c07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccf05bea21dc44b9959025aaaa0f4593, user_id=61a9281cd4f34f9aa0ec037c5ef4e0e3, role_id=c37945a17623465f899d4f217e7af593)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:18:52.424831 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02722c14-3539-4be8-a751-e96410992c07 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:18:52.451469 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1210/2439] 10.222.0.79 () {60 vars in 1483 bytes} [Tue Aug 30 01:18:52 2022] PUT /identity/v3/projects/ccf05bea21dc44b9959025aaaa0f4593/users/61a9281cd4f34f9aa0ec037c5ef4e0e3/roles/c37945a17623465f899d4f217e7af593 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:18:52.464592 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22ae640-c431-4e95-96cd-025418fa43f7 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:52.465000 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22ae640-c431-4e95-96cd-025418fa43f7 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:52.465372 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22ae640-c431-4e95-96cd-025418fa43f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:52.506907 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-e22ae640-c431-4e95-96cd-025418fa43f7 None None] MFA Rules not processed for user `61a9281cd4f34f9aa0ec037c5ef4e0e3`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:18:52.508327 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-e22ae640-c431-4e95-96cd-025418fa43f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:18:52.539408 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:18:52.607189 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1230/2440] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:18:52 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:18:52.610895 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02722c14-3539-4be8-a751-e96410992c07 admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:18:52.693705 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02722c14-3539-4be8-a751-e96410992c07 admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:18:52.702295 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164e8c4c-6daf-4e60-906c-3b921f08a932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:18:52.703122 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164e8c4c-6daf-4e60-906c-3b921f08a932 admin admin] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:52.703529 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164e8c4c-6daf-4e60-906c-3b921f08a932 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:52.703841 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164e8c4c-6daf-4e60-906c-3b921f08a932 admin admin] PATH_INFO: `/v3/projects` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:52.704628 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164e8c4c-6daf-4e60-906c-3b921f08a932 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:18:52.706655 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164e8c4c-6daf-4e60-906c-3b921f08a932 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:18:52.747046 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1211/2441] 10.222.0.79 () {60 vars in 1153 bytes} [Tue Aug 30 01:18:52 2022] POST /identity/v3/projects => generated 399 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:18:52.752184 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22ae640-c431-4e95-96cd-025418fa43f7 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:18:52.772506 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22ae640-c431-4e95-96cd-025418fa43f7 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:18:52.864077 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313883be-5b84-43df-87c9-ec9d5feadbd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:18:52.865127 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313883be-5b84-43df-87c9-ec9d5feadbd8 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:52.865127 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313883be-5b84-43df-87c9-ec9d5feadbd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:52.865603 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313883be-5b84-43df-87c9-ec9d5feadbd8 admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:52.866027 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313883be-5b84-43df-87c9-ec9d5feadbd8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:18:52.868134 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313883be-5b84-43df-87c9-ec9d5feadbd8 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:18:52.892696 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1231/2442] 10.222.0.79 () {60 vars in 1144 bytes} [Tue Aug 30 01:18:52 2022] POST /identity/v3/users => generated 306 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:18:52.897363 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164e8c4c-6daf-4e60-906c-3b921f08a932 admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:18:52.911305 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164e8c4c-6daf-4e60-906c-3b921f08a932 admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:18:52.917897 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b9f4cd-afc7-4a5a-9b49-854e481916f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:18:52.918541 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b9f4cd-afc7-4a5a-9b49-854e481916f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:52.918840 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b9f4cd-afc7-4a5a-9b49-854e481916f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:52.919107 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b9f4cd-afc7-4a5a-9b49-854e481916f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:52.919794 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b9f4cd-afc7-4a5a-9b49-854e481916f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:18:52.921418 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b9f4cd-afc7-4a5a-9b49-854e481916f3 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:18:52.933295 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1212/2443] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:18:52 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:18:52.937878 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313883be-5b84-43df-87c9-ec9d5feadbd8 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:18:52.949267 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313883be-5b84-43df-87c9-ec9d5feadbd8 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:18:52.953934 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218e40ac-285d-4d6b-9708-d84128b31c05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:18:52.954623 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218e40ac-285d-4d6b-9708-d84128b31c05 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:52.954922 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218e40ac-285d-4d6b-9708-d84128b31c05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:52.955222 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218e40ac-285d-4d6b-9708-d84128b31c05 admin admin] PATH_INFO: `/v3/projects/3a74a2ad461b4f65949e8b3a7abfb337/users/98f19941fbb447d887c23706519d73ad/roles/d14c3070c9184d76a7b23df69bd3db07` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:52.971805 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218e40ac-285d-4d6b-9708-d84128b31c05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a74a2ad461b4f65949e8b3a7abfb337, user_id=98f19941fbb447d887c23706519d73ad, role_id=d14c3070c9184d76a7b23df69bd3db07)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:18:52.974475 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218e40ac-285d-4d6b-9708-d84128b31c05 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:18:52.989690 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1232/2444] 10.222.0.79 () {60 vars in 1483 bytes} [Tue Aug 30 01:18:52 2022] PUT /identity/v3/projects/3a74a2ad461b4f65949e8b3a7abfb337/users/98f19941fbb447d887c23706519d73ad/roles/d14c3070c9184d76a7b23df69bd3db07 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:18:52.994391 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b9f4cd-afc7-4a5a-9b49-854e481916f3 admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:18:53.012169 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b9f4cd-afc7-4a5a-9b49-854e481916f3 admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:18:53.078771 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c62472-a3b0-4d6b-961b-4dd4de66c898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:18:53.079427 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c62472-a3b0-4d6b-961b-4dd4de66c898 admin admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:53.079851 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c62472-a3b0-4d6b-961b-4dd4de66c898 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:53.080132 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c62472-a3b0-4d6b-961b-4dd4de66c898 admin admin] PATH_INFO: `/v3/roles` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:53.080785 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c62472-a3b0-4d6b-961b-4dd4de66c898 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:18:53.082448 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c62472-a3b0-4d6b-961b-4dd4de66c898 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:18:53.093766 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1213/2445] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:18:52 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:18:53.098499 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218e40ac-285d-4d6b-9708-d84128b31c05 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:18:53.110426 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218e40ac-285d-4d6b-9708-d84128b31c05 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:18:53.115721 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6eba4c6-d0a0-44a1-9bc8-e0b5a41be9e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:18:53.116404 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eba4c6-d0a0-44a1-9bc8-e0b5a41be9e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:53.116715 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eba4c6-d0a0-44a1-9bc8-e0b5a41be9e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:53.116997 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eba4c6-d0a0-44a1-9bc8-e0b5a41be9e4 admin admin] PATH_INFO: `/v3/projects/3a74a2ad461b4f65949e8b3a7abfb337/users/98f19941fbb447d887c23706519d73ad/roles/d14c3070c9184d76a7b23df69bd3db07` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:53.119100 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6eba4c6-d0a0-44a1-9bc8-e0b5a41be9e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a74a2ad461b4f65949e8b3a7abfb337, user_id=98f19941fbb447d887c23706519d73ad, role_id=d14c3070c9184d76a7b23df69bd3db07)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:18:53.121855 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6eba4c6-d0a0-44a1-9bc8-e0b5a41be9e4 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:18:53.134181 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1233/2446] 10.222.0.79 () {60 vars in 1483 bytes} [Tue Aug 30 01:18:53 2022] PUT /identity/v3/projects/3a74a2ad461b4f65949e8b3a7abfb337/users/98f19941fbb447d887c23706519d73ad/roles/d14c3070c9184d76a7b23df69bd3db07 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:18:53.145016 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb2b78e-b862-40ca-ad6b-5fb9a1b4c4ec None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:53.145307 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb2b78e-b862-40ca-ad6b-5fb9a1b4c4ec None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:53.145587 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb2b78e-b862-40ca-ad6b-5fb9a1b4c4ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:53.173955 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:18:53.178021 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-feb2b78e-b862-40ca-ad6b-5fb9a1b4c4ec None None] MFA Rules not processed for user `98f19941fbb447d887c23706519d73ad`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:18:53.181324 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-feb2b78e-b862-40ca-ad6b-5fb9a1b4c4ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:18:53.265904 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1214/2447] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:18:53 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:18:53.278027 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6eba4c6-d0a0-44a1-9bc8-e0b5a41be9e4 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:18:53.279843 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-c6eba4c6-d0a0-44a1-9bc8-e0b5a41be9e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:18:53.346739 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6eba4c6-d0a0-44a1-9bc8-e0b5a41be9e4 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:18:53.350466 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c0537d-d131-4e48-9739-fc49a2c2c411 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f827c7670b74d938ffe066ced88d1c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:18:53.351081 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c0537d-d131-4e48-9739-fc49a2c2c411 service cinder] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:53.351382 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c0537d-d131-4e48-9739-fc49a2c2c411 service cinder] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:53.351646 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c0537d-d131-4e48-9739-fc49a2c2c411 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:53.361887 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c0537d-d131-4e48-9739-fc49a2c2c411 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:18:53.363381 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c0537d-d131-4e48-9739-fc49a2c2c411 service cinder] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:18:53.374826 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1234/2448] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:18:53 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:18:53.508699 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb2b78e-b862-40ca-ad6b-5fb9a1b4c4ec None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:18:53.529117 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb2b78e-b862-40ca-ad6b-5fb9a1b4c4ec None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:18:53.536395 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71b04c5-4011-4af4-aa8b-ad1e60c38d07 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f827c7670b74d938ffe066ced88d1c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:18:53.537714 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71b04c5-4011-4af4-aa8b-ad1e60c38d07 service cinder] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:53.538341 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71b04c5-4011-4af4-aa8b-ad1e60c38d07 service cinder] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:53.539247 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71b04c5-4011-4af4-aa8b-ad1e60c38d07 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:53.653876 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71b04c5-4011-4af4-aa8b-ad1e60c38d07 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:18:53.655929 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71b04c5-4011-4af4-aa8b-ad1e60c38d07 service cinder] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:18:53.668074 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1215/2449] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:18:53 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:18:56.448356 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c0537d-d131-4e48-9739-fc49a2c2c411 service cinder] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:18:56.450036 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-98c0537d-d131-4e48-9739-fc49a2c2c411 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:18:56.477091 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:18:56.568074 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c0537d-d131-4e48-9739-fc49a2c2c411 service cinder] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:18:56.575488 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d6bf31-a530-4080-b88e-031c0b853851 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6480b2f14c37474c89df9fba48f7cd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:18:56.576110 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d6bf31-a530-4080-b88e-031c0b853851 service nova] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:56.576392 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d6bf31-a530-4080-b88e-031c0b853851 service nova] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:56.576663 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d6bf31-a530-4080-b88e-031c0b853851 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:56.578506 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-16d6bf31-a530-4080-b88e-031c0b853851 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:18:56.605305 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d6bf31-a530-4080-b88e-031c0b853851 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:18:56.607373 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d6bf31-a530-4080-b88e-031c0b853851 service nova] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:18:56.626423 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1235/2450] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:18:56 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:18:58.233146 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71b04c5-4011-4af4-aa8b-ad1e60c38d07 service cinder] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:18:58.322818 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71b04c5-4011-4af4-aa8b-ad1e60c38d07 service cinder] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:18:58.329787 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92333765-0501-437d-a4ed-972960953b63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:18:58.330465 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92333765-0501-437d-a4ed-972960953b63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:58.330781 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92333765-0501-437d-a4ed-972960953b63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:58.331013 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92333765-0501-437d-a4ed-972960953b63 admin admin] PATH_INFO: `/v3/users/61a9281cd4f34f9aa0ec037c5ef4e0e3` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:58.332447 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92333765-0501-437d-a4ed-972960953b63 admin admin] RBAC: Authorizing `identity:delete_user(user_id=61a9281cd4f34f9aa0ec037c5ef4e0e3)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:18:58.334468 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92333765-0501-437d-a4ed-972960953b63 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:18:58.398263 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:18:58.408140 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-92333765-0501-437d-a4ed-972960953b63 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61a9281cd4f34f9aa0ec037c5ef4e0e3'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:18:58.417850 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-92333765-0501-437d-a4ed-972960953b63 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61a9281cd4f34f9aa0ec037c5ef4e0e3'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:18:58.433604 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-92333765-0501-437d-a4ed-972960953b63 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61a9281cd4f34f9aa0ec037c5ef4e0e3'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:18:58.434419 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-92333765-0501-437d-a4ed-972960953b63 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61a9281cd4f34f9aa0ec037c5ef4e0e3'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:18:58.444757 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-92333765-0501-437d-a4ed-972960953b63 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61a9281cd4f34f9aa0ec037c5ef4e0e3'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:18:58.453052 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1216/2451] 10.222.0.79 () {58 vars in 1224 bytes} [Tue Aug 30 01:18:58 2022] DELETE /identity/v3/users/61a9281cd4f34f9aa0ec037c5ef4e0e3 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:18:58.458115 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecf5056-837b-4e40-961a-d66461c28005 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:58.458907 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecf5056-837b-4e40-961a-d66461c28005 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:58.458907 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecf5056-837b-4e40-961a-d66461c28005 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:58.502212 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-eecf5056-837b-4e40-961a-d66461c28005 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:18:58.503634 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-eecf5056-837b-4e40-961a-d66461c28005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:18:58.585963 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1236/2452] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:18:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:18:58.597736 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92333765-0501-437d-a4ed-972960953b63 admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:18:58.599487 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-92333765-0501-437d-a4ed-972960953b63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:18:58.670609 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92333765-0501-437d-a4ed-972960953b63 admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:18:58.674552 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a960fe-fcf4-4f90-84cc-7221d28f16ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16e6a0ca26fc4ef892c188ad89a1e132', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:18:58.675240 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a960fe-fcf4-4f90-84cc-7221d28f16ec service neutron] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:58.675519 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a960fe-fcf4-4f90-84cc-7221d28f16ec service neutron] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:58.675789 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a960fe-fcf4-4f90-84cc-7221d28f16ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:58.687116 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a960fe-fcf4-4f90-84cc-7221d28f16ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:18:58.688619 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a960fe-fcf4-4f90-84cc-7221d28f16ec service neutron] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:18:58.703890 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1217/2453] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:18:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:18:59.323782 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecf5056-837b-4e40-961a-d66461c28005 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:18:59.326291 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-eecf5056-837b-4e40-961a-d66461c28005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:18:59.342650 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecf5056-837b-4e40-961a-d66461c28005 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:18:59.349876 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d2da06-173e-4925-a0be-8c052f7338d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:18:59.350952 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d2da06-173e-4925-a0be-8c052f7338d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:59.351615 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d2da06-173e-4925-a0be-8c052f7338d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:59.352037 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d2da06-173e-4925-a0be-8c052f7338d2 admin admin] PATH_INFO: `/v3/projects/ccf05bea21dc44b9959025aaaa0f4593` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:59.354194 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d2da06-173e-4925-a0be-8c052f7338d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ccf05bea21dc44b9959025aaaa0f4593)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:18:59.375982 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d2da06-173e-4925-a0be-8c052f7338d2 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:18:59.451830 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b7d2da06-173e-4925-a0be-8c052f7338d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ccf05bea21dc44b9959025aaaa0f4593', 'request_id': 'req-b7d2da06-173e-4925-a0be-8c052f7338d2'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:18:59.462779 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b7d2da06-173e-4925-a0be-8c052f7338d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ccf05bea21dc44b9959025aaaa0f4593', 'request_id': 'req-b7d2da06-173e-4925-a0be-8c052f7338d2'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:18:59.470898 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b7d2da06-173e-4925-a0be-8c052f7338d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ccf05bea21dc44b9959025aaaa0f4593', 'request_id': 'req-b7d2da06-173e-4925-a0be-8c052f7338d2'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:18:59.485153 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b7d2da06-173e-4925-a0be-8c052f7338d2 admin admin] The token cache is being invalidate because project ccf05bea21dc44b9959025aaaa0f4593 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:18:59.485600 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b7d2da06-173e-4925-a0be-8c052f7338d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:18:59.486410 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b7d2da06-173e-4925-a0be-8c052f7338d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:18:59.488416 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1237/2454] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 30 01:18:59 2022] DELETE /identity/v3/projects/ccf05bea21dc44b9959025aaaa0f4593 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:18:59.492469 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a960fe-fcf4-4f90-84cc-7221d28f16ec service neutron] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:18:59.504625 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a960fe-fcf4-4f90-84cc-7221d28f16ec service neutron] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:18:59.603752 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733af622-7597-4245-a9a1-6dfa3f8c59aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:18:59.604841 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733af622-7597-4245-a9a1-6dfa3f8c59aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:59.605347 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733af622-7597-4245-a9a1-6dfa3f8c59aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:59.605828 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733af622-7597-4245-a9a1-6dfa3f8c59aa admin admin] PATH_INFO: `/v3/users/98f19941fbb447d887c23706519d73ad` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:59.608047 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733af622-7597-4245-a9a1-6dfa3f8c59aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=98f19941fbb447d887c23706519d73ad)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:18:59.611915 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733af622-7597-4245-a9a1-6dfa3f8c59aa admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:18:59.694192 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-733af622-7597-4245-a9a1-6dfa3f8c59aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98f19941fbb447d887c23706519d73ad'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:18:59.709817 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-733af622-7597-4245-a9a1-6dfa3f8c59aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98f19941fbb447d887c23706519d73ad'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:18:59.716302 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:18:59.734889 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-733af622-7597-4245-a9a1-6dfa3f8c59aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98f19941fbb447d887c23706519d73ad'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:18:59.736276 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-733af622-7597-4245-a9a1-6dfa3f8c59aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98f19941fbb447d887c23706519d73ad'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:18:59.750977 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-733af622-7597-4245-a9a1-6dfa3f8c59aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98f19941fbb447d887c23706519d73ad'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:18:59.764159 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1218/2455] 10.222.0.79 () {58 vars in 1224 bytes} [Tue Aug 30 01:18:59 2022] DELETE /identity/v3/users/98f19941fbb447d887c23706519d73ad => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:18:59.958405 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf925f79-8e37-4425-8d6d-9c30d1a877d8 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:59.958870 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf925f79-8e37-4425-8d6d-9c30d1a877d8 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:59.959399 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf925f79-8e37-4425-8d6d-9c30d1a877d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:59.986080 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-bf925f79-8e37-4425-8d6d-9c30d1a877d8 None None] MFA Rules not processed for user `5cacaed93420436e8f423f96a8041401`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:18:59.987368 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-bf925f79-8e37-4425-8d6d-9c30d1a877d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:19:00.014257 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:19:00.082731 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1238/2456] 10.222.0.79 () {58 vars in 1009 bytes} [Tue Aug 30 01:18:59 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:19:00.099254 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733af622-7597-4245-a9a1-6dfa3f8c59aa admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:00.101775 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-733af622-7597-4245-a9a1-6dfa3f8c59aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:19:00.250433 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733af622-7597-4245-a9a1-6dfa3f8c59aa admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:00.261379 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8569c68d-8212-4787-b3a3-677f1626f6c7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd556fa6ba464928b1e067325792a523', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:00.263414 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8569c68d-8212-4787-b3a3-677f1626f6c7 service swift] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:00.263414 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8569c68d-8212-4787-b3a3-677f1626f6c7 service swift] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:00.263885 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8569c68d-8212-4787-b3a3-677f1626f6c7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:00.282212 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8569c68d-8212-4787-b3a3-677f1626f6c7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:00.287963 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8569c68d-8212-4787-b3a3-677f1626f6c7 service swift] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:00.305676 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1219/2457] 10.222.0.79 () {60 vars in 1384 bytes} [Tue Aug 30 01:19:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 01:19:00.329849 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf925f79-8e37-4425-8d6d-9c30d1a877d8 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:00.332544 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-bf925f79-8e37-4425-8d6d-9c30d1a877d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:19:00.496277 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf925f79-8e37-4425-8d6d-9c30d1a877d8 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:00.505930 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b201475-3980-4dc3-b642-02d110ca0382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:00.507645 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b201475-3980-4dc3-b642-02d110ca0382 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:00.508942 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b201475-3980-4dc3-b642-02d110ca0382 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:00.509751 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b201475-3980-4dc3-b642-02d110ca0382 admin admin] PATH_INFO: `/v3/projects/3a74a2ad461b4f65949e8b3a7abfb337` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:00.512366 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b201475-3980-4dc3-b642-02d110ca0382 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a74a2ad461b4f65949e8b3a7abfb337)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:00.516882 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b201475-3980-4dc3-b642-02d110ca0382 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:00.652829 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-4b201475-3980-4dc3-b642-02d110ca0382 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a74a2ad461b4f65949e8b3a7abfb337', 'request_id': 'req-4b201475-3980-4dc3-b642-02d110ca0382'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:19:00.670005 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-4b201475-3980-4dc3-b642-02d110ca0382 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a74a2ad461b4f65949e8b3a7abfb337', 'request_id': 'req-4b201475-3980-4dc3-b642-02d110ca0382'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:19:00.685422 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-4b201475-3980-4dc3-b642-02d110ca0382 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a74a2ad461b4f65949e8b3a7abfb337', 'request_id': 'req-4b201475-3980-4dc3-b642-02d110ca0382'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:19:00.731405 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-4b201475-3980-4dc3-b642-02d110ca0382 admin admin] The token cache is being invalidate because project 3a74a2ad461b4f65949e8b3a7abfb337 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:19:00.733708 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-4b201475-3980-4dc3-b642-02d110ca0382 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:19:00.734280 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-4b201475-3980-4dc3-b642-02d110ca0382 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:19:00.737556 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1239/2458] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 30 01:19:00 2022] DELETE /identity/v3/projects/3a74a2ad461b4f65949e8b3a7abfb337 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:19:00.741919 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5932ca-c7df-402d-999e-aa1fe65b2e6f None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:00.743083 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5932ca-c7df-402d-999e-aa1fe65b2e6f None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:00.743083 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5932ca-c7df-402d-999e-aa1fe65b2e6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:00.794057 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-cc5932ca-c7df-402d-999e-aa1fe65b2e6f None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:19:00.798565 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-cc5932ca-c7df-402d-999e-aa1fe65b2e6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:19:00.936614 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1220/2459] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:19:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:19:00.951495 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be8af1e-43bd-4012-aa8b-ad04c870743b None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:00.952534 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be8af1e-43bd-4012-aa8b-ad04c870743b None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:00.954475 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be8af1e-43bd-4012-aa8b-ad04c870743b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:00.996786 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-1be8af1e-43bd-4012-aa8b-ad04c870743b None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:19:00.999963 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-1be8af1e-43bd-4012-aa8b-ad04c870743b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:19:01.019921 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1240/2460] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:19:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:19:01.027068 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5932ca-c7df-402d-999e-aa1fe65b2e6f None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:01.060900 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5932ca-c7df-402d-999e-aa1fe65b2e6f None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:01.070376 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7dbfc7-0dc0-4238-8984-15e3ed254374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:01.073694 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7dbfc7-0dc0-4238-8984-15e3ed254374 admin admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:01.074595 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7dbfc7-0dc0-4238-8984-15e3ed254374 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:01.076325 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7dbfc7-0dc0-4238-8984-15e3ed254374 admin admin] PATH_INFO: `/v3/domains` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:01.081761 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7dbfc7-0dc0-4238-8984-15e3ed254374 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:19:01.085013 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7dbfc7-0dc0-4238-8984-15e3ed254374 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:01.100994 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7dbfc7-0dc0-4238-8984-15e3ed254374 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:01.139160 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1221/2461] 10.222.0.79 () {58 vars in 1153 bytes} [Tue Aug 30 01:19:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:19:01.146401 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be8af1e-43bd-4012-aa8b-ad04c870743b None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:01.188607 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be8af1e-43bd-4012-aa8b-ad04c870743b None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:01.216959 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1000eb6e-47af-42e4-9c02-65f1dfc60a1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:01.218069 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1000eb6e-47af-42e4-9c02-65f1dfc60a1a admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:01.219053 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1000eb6e-47af-42e4-9c02-65f1dfc60a1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:01.221234 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1000eb6e-47af-42e4-9c02-65f1dfc60a1a admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:01.222815 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1000eb6e-47af-42e4-9c02-65f1dfc60a1a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:01.245348 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1000eb6e-47af-42e4-9c02-65f1dfc60a1a admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:01.291547 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1241/2462] 10.222.0.79 () {60 vars in 1153 bytes} [Tue Aug 30 01:19:01 2022] POST /identity/v3/projects => generated 383 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:19:01.298872 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7dbfc7-0dc0-4238-8984-15e3ed254374 admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:01.319037 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7dbfc7-0dc0-4238-8984-15e3ed254374 admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:01.427330 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:DELETE=3,keystone:SELECT=96,keystone:INSERT=1 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:19:01.444255 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b7a729-cd41-4c14-abff-9c5737ceb3f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:01.444807 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b7a729-cd41-4c14-abff-9c5737ceb3f4 admin admin] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:01.445085 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b7a729-cd41-4c14-abff-9c5737ceb3f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:01.445355 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b7a729-cd41-4c14-abff-9c5737ceb3f4 admin admin] PATH_INFO: `/v3/users` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:01.447428 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b7a729-cd41-4c14-abff-9c5737ceb3f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:01.451149 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b7a729-cd41-4c14-abff-9c5737ceb3f4 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:01.489284 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1222/2463] 10.222.0.79 () {60 vars in 1144 bytes} [Tue Aug 30 01:19:01 2022] POST /identity/v3/users => generated 292 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:19:01.491042 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1000eb6e-47af-42e4-9c02-65f1dfc60a1a admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:01.507636 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1000eb6e-47af-42e4-9c02-65f1dfc60a1a admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:01.519236 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73230724-9e6f-4c1b-b57a-2344f1903d22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:01.520282 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73230724-9e6f-4c1b-b57a-2344f1903d22 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:01.520985 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73230724-9e6f-4c1b-b57a-2344f1903d22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:01.521476 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73230724-9e6f-4c1b-b57a-2344f1903d22 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:01.523035 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73230724-9e6f-4c1b-b57a-2344f1903d22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:01.526488 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73230724-9e6f-4c1b-b57a-2344f1903d22 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:01.547715 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1242/2464] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:19:01 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:19:01.552103 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b7a729-cd41-4c14-abff-9c5737ceb3f4 admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:01.574833 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b7a729-cd41-4c14-abff-9c5737ceb3f4 admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:01.583624 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af46423-2599-4bad-b98d-558c58c1a799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:01.584821 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af46423-2599-4bad-b98d-558c58c1a799 admin admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:01.585478 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af46423-2599-4bad-b98d-558c58c1a799 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:01.586140 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af46423-2599-4bad-b98d-558c58c1a799 admin admin] PATH_INFO: `/v3/roles` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:01.588257 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af46423-2599-4bad-b98d-558c58c1a799 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:01.592355 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af46423-2599-4bad-b98d-558c58c1a799 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:01.641012 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1223/2465] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:19:01 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 01:19:01.644533 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73230724-9e6f-4c1b-b57a-2344f1903d22 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:01.663854 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73230724-9e6f-4c1b-b57a-2344f1903d22 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:01.680177 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1461ee8-ea17-4494-b8b3-0c66cd861617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:01.681201 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1461ee8-ea17-4494-b8b3-0c66cd861617 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:01.681638 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1461ee8-ea17-4494-b8b3-0c66cd861617 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:01.682274 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1461ee8-ea17-4494-b8b3-0c66cd861617 admin admin] PATH_INFO: `/v3/projects/827e26dbfa8944eebe51f8869976ef17/users/4bb7871bd8064a6887b407eb1e6201b3/roles/c37945a17623465f899d4f217e7af593` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:01.714130 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1461ee8-ea17-4494-b8b3-0c66cd861617 admin admin] RBAC: Authorizing `identity:create_grant(project_id=827e26dbfa8944eebe51f8869976ef17, user_id=4bb7871bd8064a6887b407eb1e6201b3, role_id=c37945a17623465f899d4f217e7af593)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:01.717054 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1461ee8-ea17-4494-b8b3-0c66cd861617 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:01.722317 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:19:01.759305 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1243/2466] 10.222.0.79 () {60 vars in 1483 bytes} [Tue Aug 30 01:19:01 2022] PUT /identity/v3/projects/827e26dbfa8944eebe51f8869976ef17/users/4bb7871bd8064a6887b407eb1e6201b3/roles/c37945a17623465f899d4f217e7af593 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:19:01.772776 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987ac0bf-1ebe-40f7-a4c8-458a55a5648f None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:01.773372 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987ac0bf-1ebe-40f7-a4c8-458a55a5648f None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:01.773372 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987ac0bf-1ebe-40f7-a4c8-458a55a5648f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:01.815676 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-987ac0bf-1ebe-40f7-a4c8-458a55a5648f None None] MFA Rules not processed for user `4bb7871bd8064a6887b407eb1e6201b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:19:01.817146 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-987ac0bf-1ebe-40f7-a4c8-458a55a5648f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:19:01.940942 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1224/2467] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:19:01 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:19:01.942735 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1461ee8-ea17-4494-b8b3-0c66cd861617 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:02.023909 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1461ee8-ea17-4494-b8b3-0c66cd861617 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:02.029253 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce49700-cab8-4156-9177-7c43a8839297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:02.030032 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce49700-cab8-4156-9177-7c43a8839297 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:02.030316 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce49700-cab8-4156-9177-7c43a8839297 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:02.030587 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce49700-cab8-4156-9177-7c43a8839297 admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:02.031470 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce49700-cab8-4156-9177-7c43a8839297 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:02.033428 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce49700-cab8-4156-9177-7c43a8839297 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:02.081526 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1244/2468] 10.222.0.79 () {60 vars in 1153 bytes} [Tue Aug 30 01:19:01 2022] POST /identity/v3/projects => generated 383 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:19:02.084520 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987ac0bf-1ebe-40f7-a4c8-458a55a5648f None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:02.098278 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987ac0bf-1ebe-40f7-a4c8-458a55a5648f None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:02.221006 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6ed627-12ec-409b-a47e-bb6ed8d4e509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:02.222220 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6ed627-12ec-409b-a47e-bb6ed8d4e509 admin admin] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:02.222220 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6ed627-12ec-409b-a47e-bb6ed8d4e509 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:02.222868 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6ed627-12ec-409b-a47e-bb6ed8d4e509 admin admin] PATH_INFO: `/v3/users` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:02.224222 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6ed627-12ec-409b-a47e-bb6ed8d4e509 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:02.225791 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6ed627-12ec-409b-a47e-bb6ed8d4e509 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:02.268125 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1225/2469] 10.222.0.79 () {60 vars in 1144 bytes} [Tue Aug 30 01:19:02 2022] POST /identity/v3/users => generated 298 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:19:02.273313 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce49700-cab8-4156-9177-7c43a8839297 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:02.296151 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce49700-cab8-4156-9177-7c43a8839297 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:02.308230 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fda601d-8379-4a34-9e59-9cdac36e400b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:02.310275 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fda601d-8379-4a34-9e59-9cdac36e400b admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:02.311292 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fda601d-8379-4a34-9e59-9cdac36e400b admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:02.312128 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fda601d-8379-4a34-9e59-9cdac36e400b admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:02.313834 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fda601d-8379-4a34-9e59-9cdac36e400b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:02.319526 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fda601d-8379-4a34-9e59-9cdac36e400b admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:02.343582 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1245/2470] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:19:02 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:19:02.348107 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6ed627-12ec-409b-a47e-bb6ed8d4e509 admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:02.370862 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6ed627-12ec-409b-a47e-bb6ed8d4e509 admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:02.376723 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58df4993-ba56-4cb7-9796-d4bbe6eb5769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:02.377851 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58df4993-ba56-4cb7-9796-d4bbe6eb5769 admin admin] REQUEST_METHOD: `PUT` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:02.378296 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58df4993-ba56-4cb7-9796-d4bbe6eb5769 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:02.379101 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58df4993-ba56-4cb7-9796-d4bbe6eb5769 admin admin] PATH_INFO: `/v3/projects/434f2fe11f42409b8e3674727222d334/users/9718bffe0c08492d88a78bfdb04179ee/roles/d14c3070c9184d76a7b23df69bd3db07` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:02.408657 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58df4993-ba56-4cb7-9796-d4bbe6eb5769 admin admin] RBAC: Authorizing `identity:create_grant(project_id=434f2fe11f42409b8e3674727222d334, user_id=9718bffe0c08492d88a78bfdb04179ee, role_id=d14c3070c9184d76a7b23df69bd3db07)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:02.411768 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58df4993-ba56-4cb7-9796-d4bbe6eb5769 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:02.442318 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1226/2471] 10.222.0.79 () {60 vars in 1483 bytes} [Tue Aug 30 01:19:02 2022] PUT /identity/v3/projects/434f2fe11f42409b8e3674727222d334/users/9718bffe0c08492d88a78bfdb04179ee/roles/d14c3070c9184d76a7b23df69bd3db07 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:19:02.447029 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fda601d-8379-4a34-9e59-9cdac36e400b admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:02.458921 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fda601d-8379-4a34-9e59-9cdac36e400b admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:02.530082 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86f1978-6767-446a-ba7b-3e72122772c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:02.530870 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86f1978-6767-446a-ba7b-3e72122772c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:02.531301 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86f1978-6767-446a-ba7b-3e72122772c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:02.531669 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86f1978-6767-446a-ba7b-3e72122772c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:02.532469 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86f1978-6767-446a-ba7b-3e72122772c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:02.534160 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86f1978-6767-446a-ba7b-3e72122772c9 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:02.546370 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1246/2472] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:19:02 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:19:02.550968 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58df4993-ba56-4cb7-9796-d4bbe6eb5769 admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:02.563757 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58df4993-ba56-4cb7-9796-d4bbe6eb5769 admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:02.569514 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5df9977-a6e7-4b46-b8c3-4d92b3724b5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:02.570209 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5df9977-a6e7-4b46-b8c3-4d92b3724b5f admin admin] REQUEST_METHOD: `PUT` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:02.570488 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5df9977-a6e7-4b46-b8c3-4d92b3724b5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:02.570761 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5df9977-a6e7-4b46-b8c3-4d92b3724b5f admin admin] PATH_INFO: `/v3/projects/434f2fe11f42409b8e3674727222d334/users/9718bffe0c08492d88a78bfdb04179ee/roles/d14c3070c9184d76a7b23df69bd3db07` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:02.573562 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5df9977-a6e7-4b46-b8c3-4d92b3724b5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=434f2fe11f42409b8e3674727222d334, user_id=9718bffe0c08492d88a78bfdb04179ee, role_id=d14c3070c9184d76a7b23df69bd3db07)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:02.576799 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5df9977-a6e7-4b46-b8c3-4d92b3724b5f admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:02.593829 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1227/2473] 10.222.0.79 () {60 vars in 1483 bytes} [Tue Aug 30 01:19:02 2022] PUT /identity/v3/projects/434f2fe11f42409b8e3674727222d334/users/9718bffe0c08492d88a78bfdb04179ee/roles/d14c3070c9184d76a7b23df69bd3db07 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:19:02.612889 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2560d5b8-6486-442a-9092-d232bb6353c0 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:02.613171 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2560d5b8-6486-442a-9092-d232bb6353c0 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:02.613436 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2560d5b8-6486-442a-9092-d232bb6353c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:02.650800 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-2560d5b8-6486-442a-9092-d232bb6353c0 None None] MFA Rules not processed for user `9718bffe0c08492d88a78bfdb04179ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:19:02.652121 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-2560d5b8-6486-442a-9092-d232bb6353c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:19:02.721301 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:19:02.748082 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1247/2474] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:19:02 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:19:02.760677 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5df9977-a6e7-4b46-b8c3-4d92b3724b5f admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:02.763554 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-d5df9977-a6e7-4b46-b8c3-4d92b3724b5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:19:02.792296 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:19:02.882588 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5df9977-a6e7-4b46-b8c3-4d92b3724b5f admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:02.887310 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62f3d78-84f5-46f2-89b8-2af4aa3b013d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f827c7670b74d938ffe066ced88d1c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:02.888263 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62f3d78-84f5-46f2-89b8-2af4aa3b013d service cinder] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:02.888546 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62f3d78-84f5-46f2-89b8-2af4aa3b013d service cinder] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:02.889590 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62f3d78-84f5-46f2-89b8-2af4aa3b013d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:03.051331 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62f3d78-84f5-46f2-89b8-2af4aa3b013d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:03.068567 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62f3d78-84f5-46f2-89b8-2af4aa3b013d service cinder] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:03.085784 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1228/2475] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:19:02 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:19:08.298871 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2560d5b8-6486-442a-9092-d232bb6353c0 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:08.301705 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-2560d5b8-6486-442a-9092-d232bb6353c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:19:08.346068 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2560d5b8-6486-442a-9092-d232bb6353c0 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:08.354433 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fd0730-4269-4be4-8d70-d9202be68f24 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f827c7670b74d938ffe066ced88d1c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:08.355755 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fd0730-4269-4be4-8d70-d9202be68f24 service cinder] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:08.356324 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fd0730-4269-4be4-8d70-d9202be68f24 service cinder] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:08.356894 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fd0730-4269-4be4-8d70-d9202be68f24 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:08.379411 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fd0730-4269-4be4-8d70-d9202be68f24 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:08.382795 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fd0730-4269-4be4-8d70-d9202be68f24 service cinder] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:08.397950 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1248/2476] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:19:08 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:19:13.078163 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=41 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:19:13.635384 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62f3d78-84f5-46f2-89b8-2af4aa3b013d service cinder] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:13.770337 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62f3d78-84f5-46f2-89b8-2af4aa3b013d service cinder] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:13.790851 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b3d5b8-ef37-4e2f-8443-23108529deab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:13.792278 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b3d5b8-ef37-4e2f-8443-23108529deab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:13.792802 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b3d5b8-ef37-4e2f-8443-23108529deab admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:13.793097 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b3d5b8-ef37-4e2f-8443-23108529deab admin admin] PATH_INFO: `/v3/users/4bb7871bd8064a6887b407eb1e6201b3` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:13.795114 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b3d5b8-ef37-4e2f-8443-23108529deab admin admin] RBAC: Authorizing `identity:delete_user(user_id=4bb7871bd8064a6887b407eb1e6201b3)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:13.799413 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b3d5b8-ef37-4e2f-8443-23108529deab admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:13.895088 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-39b3d5b8-ef37-4e2f-8443-23108529deab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4bb7871bd8064a6887b407eb1e6201b3'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:19:13.903823 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-39b3d5b8-ef37-4e2f-8443-23108529deab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4bb7871bd8064a6887b407eb1e6201b3'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:19:13.918955 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-39b3d5b8-ef37-4e2f-8443-23108529deab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4bb7871bd8064a6887b407eb1e6201b3'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:19:13.919821 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-39b3d5b8-ef37-4e2f-8443-23108529deab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4bb7871bd8064a6887b407eb1e6201b3'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:19:13.929366 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-39b3d5b8-ef37-4e2f-8443-23108529deab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4bb7871bd8064a6887b407eb1e6201b3'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:19:13.937547 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1229/2477] 10.222.0.79 () {58 vars in 1224 bytes} [Tue Aug 30 01:19:13 2022] DELETE /identity/v3/users/4bb7871bd8064a6887b407eb1e6201b3 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:19:13.945875 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60e57c1-7ad2-4367-b653-03b624f3922c None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:13.945875 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60e57c1-7ad2-4367-b653-03b624f3922c None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:13.947203 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60e57c1-7ad2-4367-b653-03b624f3922c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:13.982037 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-b60e57c1-7ad2-4367-b653-03b624f3922c None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:19:13.984196 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-b60e57c1-7ad2-4367-b653-03b624f3922c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:19:14.082355 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1249/2478] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:19:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:19:14.092778 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b3d5b8-ef37-4e2f-8443-23108529deab admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:14.094277 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-39b3d5b8-ef37-4e2f-8443-23108529deab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:19:14.162004 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b3d5b8-ef37-4e2f-8443-23108529deab admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:14.167314 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fb11d6-31ae-4b08-8746-a960cc98e09b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16e6a0ca26fc4ef892c188ad89a1e132', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:14.167985 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fb11d6-31ae-4b08-8746-a960cc98e09b service neutron] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:14.168310 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fb11d6-31ae-4b08-8746-a960cc98e09b service neutron] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:14.168694 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fb11d6-31ae-4b08-8746-a960cc98e09b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:14.179274 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fb11d6-31ae-4b08-8746-a960cc98e09b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:14.181243 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fb11d6-31ae-4b08-8746-a960cc98e09b service neutron] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:14.192751 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1230/2479] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:19:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:19:14.753025 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60e57c1-7ad2-4367-b653-03b624f3922c None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:14.756160 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-b60e57c1-7ad2-4367-b653-03b624f3922c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:19:14.775178 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60e57c1-7ad2-4367-b653-03b624f3922c None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:14.780730 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66680330-3650-4914-807e-cb10b490a087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:14.781476 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66680330-3650-4914-807e-cb10b490a087 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:14.782581 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66680330-3650-4914-807e-cb10b490a087 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:14.782889 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66680330-3650-4914-807e-cb10b490a087 admin admin] PATH_INFO: `/v3/projects/827e26dbfa8944eebe51f8869976ef17` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:14.784855 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66680330-3650-4914-807e-cb10b490a087 admin admin] RBAC: Authorizing `identity:delete_project(project_id=827e26dbfa8944eebe51f8869976ef17)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:14.786986 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66680330-3650-4914-807e-cb10b490a087 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:14.867645 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-66680330-3650-4914-807e-cb10b490a087 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '827e26dbfa8944eebe51f8869976ef17', 'request_id': 'req-66680330-3650-4914-807e-cb10b490a087'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:19:14.878148 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-66680330-3650-4914-807e-cb10b490a087 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '827e26dbfa8944eebe51f8869976ef17', 'request_id': 'req-66680330-3650-4914-807e-cb10b490a087'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:19:14.886976 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-66680330-3650-4914-807e-cb10b490a087 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '827e26dbfa8944eebe51f8869976ef17', 'request_id': 'req-66680330-3650-4914-807e-cb10b490a087'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:19:14.902689 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-66680330-3650-4914-807e-cb10b490a087 admin admin] The token cache is being invalidate because project 827e26dbfa8944eebe51f8869976ef17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:19:14.903252 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-66680330-3650-4914-807e-cb10b490a087 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:19:14.904122 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-66680330-3650-4914-807e-cb10b490a087 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:19:14.905956 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1250/2480] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 30 01:19:14 2022] DELETE /identity/v3/projects/827e26dbfa8944eebe51f8869976ef17 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:19:14.910368 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fb11d6-31ae-4b08-8746-a960cc98e09b service neutron] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:14.921401 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fb11d6-31ae-4b08-8746-a960cc98e09b service neutron] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:14.944021 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:19:15.001031 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc08dbf9-92f4-46b9-8f9c-bd5b22deaa71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:15.001678 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc08dbf9-92f4-46b9-8f9c-bd5b22deaa71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:15.001953 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc08dbf9-92f4-46b9-8f9c-bd5b22deaa71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:15.002250 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc08dbf9-92f4-46b9-8f9c-bd5b22deaa71 admin admin] PATH_INFO: `/v3/users/9718bffe0c08492d88a78bfdb04179ee` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:15.003526 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc08dbf9-92f4-46b9-8f9c-bd5b22deaa71 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9718bffe0c08492d88a78bfdb04179ee)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:15.005498 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc08dbf9-92f4-46b9-8f9c-bd5b22deaa71 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:15.062613 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-bc08dbf9-92f4-46b9-8f9c-bd5b22deaa71 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9718bffe0c08492d88a78bfdb04179ee'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:19:15.072198 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-bc08dbf9-92f4-46b9-8f9c-bd5b22deaa71 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9718bffe0c08492d88a78bfdb04179ee'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:19:15.088610 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-bc08dbf9-92f4-46b9-8f9c-bd5b22deaa71 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9718bffe0c08492d88a78bfdb04179ee'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:19:15.089383 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-bc08dbf9-92f4-46b9-8f9c-bd5b22deaa71 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9718bffe0c08492d88a78bfdb04179ee'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:19:15.099448 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-bc08dbf9-92f4-46b9-8f9c-bd5b22deaa71 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9718bffe0c08492d88a78bfdb04179ee'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:19:15.108986 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1231/2481] 10.222.0.79 () {58 vars in 1224 bytes} [Tue Aug 30 01:19:14 2022] DELETE /identity/v3/users/9718bffe0c08492d88a78bfdb04179ee => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:19:15.450970 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66680330-3650-4914-807e-cb10b490a087 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:15.453832 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-66680330-3650-4914-807e-cb10b490a087 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:19:15.476640 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66680330-3650-4914-807e-cb10b490a087 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:15.548650 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810179b1-1479-4fa3-8d08-bd4ba80ec50d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:15.549302 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810179b1-1479-4fa3-8d08-bd4ba80ec50d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:15.549589 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810179b1-1479-4fa3-8d08-bd4ba80ec50d admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:15.549856 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810179b1-1479-4fa3-8d08-bd4ba80ec50d admin admin] PATH_INFO: `/v3/projects/434f2fe11f42409b8e3674727222d334` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:15.551287 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810179b1-1479-4fa3-8d08-bd4ba80ec50d admin admin] RBAC: Authorizing `identity:delete_project(project_id=434f2fe11f42409b8e3674727222d334)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:15.553245 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810179b1-1479-4fa3-8d08-bd4ba80ec50d admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:15.556335 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:19:15.617529 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-810179b1-1479-4fa3-8d08-bd4ba80ec50d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '434f2fe11f42409b8e3674727222d334', 'request_id': 'req-810179b1-1479-4fa3-8d08-bd4ba80ec50d'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:19:15.626240 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-810179b1-1479-4fa3-8d08-bd4ba80ec50d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '434f2fe11f42409b8e3674727222d334', 'request_id': 'req-810179b1-1479-4fa3-8d08-bd4ba80ec50d'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:19:15.633757 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-810179b1-1479-4fa3-8d08-bd4ba80ec50d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '434f2fe11f42409b8e3674727222d334', 'request_id': 'req-810179b1-1479-4fa3-8d08-bd4ba80ec50d'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:19:15.649048 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-810179b1-1479-4fa3-8d08-bd4ba80ec50d admin admin] The token cache is being invalidate because project 434f2fe11f42409b8e3674727222d334 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:19:15.649469 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-810179b1-1479-4fa3-8d08-bd4ba80ec50d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:19:15.650279 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-810179b1-1479-4fa3-8d08-bd4ba80ec50d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:19:15.652040 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1251/2482] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 30 01:19:15 2022] DELETE /identity/v3/projects/434f2fe11f42409b8e3674727222d334 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:19:15.659899 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2cc718-f01e-4998-9d6c-abf5307198f4 None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:15.660395 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2cc718-f01e-4998-9d6c-abf5307198f4 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:15.660875 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2cc718-f01e-4998-9d6c-abf5307198f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:15.693410 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-ad2cc718-f01e-4998-9d6c-abf5307198f4 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:19:15.695630 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-ad2cc718-f01e-4998-9d6c-abf5307198f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:19:15.771996 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1232/2483] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:19:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:19:15.782489 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690a4dee-7e0c-463e-b9ab-d7bd271e14af None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:15.782798 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690a4dee-7e0c-463e-b9ab-d7bd271e14af None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:15.783021 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690a4dee-7e0c-463e-b9ab-d7bd271e14af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:15.805679 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-690a4dee-7e0c-463e-b9ab-d7bd271e14af None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:19:15.807054 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-690a4dee-7e0c-463e-b9ab-d7bd271e14af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:19:15.815529 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1252/2484] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:19:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:19:15.820149 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2cc718-f01e-4998-9d6c-abf5307198f4 None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:15.831307 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2cc718-f01e-4998-9d6c-abf5307198f4 None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:15.841542 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b1ab35-2e04-43c6-ab88-5273ec59ee57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:15.842190 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b1ab35-2e04-43c6-ab88-5273ec59ee57 admin admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:15.842464 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b1ab35-2e04-43c6-ab88-5273ec59ee57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:15.842730 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b1ab35-2e04-43c6-ab88-5273ec59ee57 admin admin] PATH_INFO: `/v3/domains` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:15.843404 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b1ab35-2e04-43c6-ab88-5273ec59ee57 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:19:15.843704 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b1ab35-2e04-43c6-ab88-5273ec59ee57 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:15.847187 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b1ab35-2e04-43c6-ab88-5273ec59ee57 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:15.860690 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1233/2485] 10.222.0.79 () {58 vars in 1153 bytes} [Tue Aug 30 01:19:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:19:15.865205 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690a4dee-7e0c-463e-b9ab-d7bd271e14af None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:15.875517 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690a4dee-7e0c-463e-b9ab-d7bd271e14af None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:15.880493 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ece82a-88c6-42fa-b3b0-fcbd2d70ba7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:15.881115 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ece82a-88c6-42fa-b3b0-fcbd2d70ba7d admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:15.881393 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ece82a-88c6-42fa-b3b0-fcbd2d70ba7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:15.881662 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ece82a-88c6-42fa-b3b0-fcbd2d70ba7d admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:15.882325 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ece82a-88c6-42fa-b3b0-fcbd2d70ba7d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:15.884898 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ece82a-88c6-42fa-b3b0-fcbd2d70ba7d admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:15.917958 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1253/2486] 10.222.0.79 () {60 vars in 1153 bytes} [Tue Aug 30 01:19:15 2022] POST /identity/v3/projects => generated 375 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:19:15.922758 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b1ab35-2e04-43c6-ab88-5273ec59ee57 admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:15.933827 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b1ab35-2e04-43c6-ab88-5273ec59ee57 admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:15.964079 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:19:15.997898 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956cc342-744a-4ee5-93a3-28b54e13b22b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:15.998502 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956cc342-744a-4ee5-93a3-28b54e13b22b admin admin] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:15.998779 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956cc342-744a-4ee5-93a3-28b54e13b22b admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:15.999047 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956cc342-744a-4ee5-93a3-28b54e13b22b admin admin] PATH_INFO: `/v3/users` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:15.999734 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956cc342-744a-4ee5-93a3-28b54e13b22b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:16.001679 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956cc342-744a-4ee5-93a3-28b54e13b22b admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:16.024913 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1234/2487] 10.222.0.79 () {60 vars in 1144 bytes} [Tue Aug 30 01:19:15 2022] POST /identity/v3/users => generated 288 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:19:16.029003 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ece82a-88c6-42fa-b3b0-fcbd2d70ba7d admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:16.039766 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ece82a-88c6-42fa-b3b0-fcbd2d70ba7d admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:16.044875 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0231f948-9eed-4435-8ec7-640eb112c67a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:16.045476 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0231f948-9eed-4435-8ec7-640eb112c67a admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:16.045754 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0231f948-9eed-4435-8ec7-640eb112c67a admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:16.046023 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0231f948-9eed-4435-8ec7-640eb112c67a admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:16.046669 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0231f948-9eed-4435-8ec7-640eb112c67a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:16.048298 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0231f948-9eed-4435-8ec7-640eb112c67a admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:16.060073 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1254/2488] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:19:16 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:19:16.068723 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956cc342-744a-4ee5-93a3-28b54e13b22b admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:16.081764 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c406f8-4442-4013-a703-3fcddd4d412b None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:16.082785 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c406f8-4442-4013-a703-3fcddd4d412b None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:16.083258 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c406f8-4442-4013-a703-3fcddd4d412b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:16.083394 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956cc342-744a-4ee5-93a3-28b54e13b22b admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:16.089737 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40d9e25-b3e1-4e30-9d47-3fc0d039289d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:16.090621 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40d9e25-b3e1-4e30-9d47-3fc0d039289d admin admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:16.090621 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40d9e25-b3e1-4e30-9d47-3fc0d039289d admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:16.090915 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40d9e25-b3e1-4e30-9d47-3fc0d039289d admin admin] PATH_INFO: `/v3/roles` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:16.091616 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40d9e25-b3e1-4e30-9d47-3fc0d039289d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:16.093308 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40d9e25-b3e1-4e30-9d47-3fc0d039289d admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:16.108169 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1235/2489] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:19:16 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:19:16.115333 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40d9e25-b3e1-4e30-9d47-3fc0d039289d admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:16.116262 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-f0c406f8-4442-4013-a703-3fcddd4d412b None None] MFA Rules not processed for user `5cacaed93420436e8f423f96a8041401`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:19:16.118262 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-f0c406f8-4442-4013-a703-3fcddd4d412b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:19:16.129732 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40d9e25-b3e1-4e30-9d47-3fc0d039289d admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:16.141725 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf7509e-3395-4637-a976-d1902f93489c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:16.142308 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf7509e-3395-4637-a976-d1902f93489c admin admin] REQUEST_METHOD: `PUT` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:16.142591 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf7509e-3395-4637-a976-d1902f93489c admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:16.142865 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf7509e-3395-4637-a976-d1902f93489c admin admin] PATH_INFO: `/v3/projects/da3269743468418d9bccc4c4a121a72a/users/15024db18ee24033aee4361a27d92994/roles/c37945a17623465f899d4f217e7af593` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:16.159762 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf7509e-3395-4637-a976-d1902f93489c admin admin] RBAC: Authorizing `identity:create_grant(project_id=da3269743468418d9bccc4c4a121a72a, user_id=15024db18ee24033aee4361a27d92994, role_id=c37945a17623465f899d4f217e7af593)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:16.162649 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf7509e-3395-4637-a976-d1902f93489c admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:16.183225 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1236/2490] 10.222.0.79 () {60 vars in 1483 bytes} [Tue Aug 30 01:19:16 2022] PUT /identity/v3/projects/da3269743468418d9bccc4c4a121a72a/users/15024db18ee24033aee4361a27d92994/roles/c37945a17623465f899d4f217e7af593 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:19:16.191879 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b413bb-c6c6-482a-ae94-8379309373ff None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:16.192295 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b413bb-c6c6-482a-ae94-8379309373ff None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:16.192861 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b413bb-c6c6-482a-ae94-8379309373ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:16.204731 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1255/2491] 10.222.0.79 () {58 vars in 967 bytes} [Tue Aug 30 01:19:16 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:19:16.224231 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-58b413bb-c6c6-482a-ae94-8379309373ff None None] MFA Rules not processed for user `15024db18ee24033aee4361a27d92994`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:19:16.225745 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-58b413bb-c6c6-482a-ae94-8379309373ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:19:16.245262 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c406f8-4442-4013-a703-3fcddd4d412b None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:16.247309 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-f0c406f8-4442-4013-a703-3fcddd4d412b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:19:16.317945 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:19:16.333410 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1237/2492] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:19:16 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:19:16.345649 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b413bb-c6c6-482a-ae94-8379309373ff None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:16.346696 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c406f8-4442-4013-a703-3fcddd4d412b None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:16.347006 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-58b413bb-c6c6-482a-ae94-8379309373ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:19:16.414009 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b413bb-c6c6-482a-ae94-8379309373ff None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:16.418554 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7413d1f1-4444-42c6-a2a1-14bf6d77bea5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e37a5c33c064c488fd4667170f7703a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:16.419217 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7413d1f1-4444-42c6-a2a1-14bf6d77bea5 service glance] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:16.419484 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7413d1f1-4444-42c6-a2a1-14bf6d77bea5 service glance] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:16.419753 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7413d1f1-4444-42c6-a2a1-14bf6d77bea5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:16.438768 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7413d1f1-4444-42c6-a2a1-14bf6d77bea5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:16.440285 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7413d1f1-4444-42c6-a2a1-14bf6d77bea5 service glance] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:16.444134 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de930c37-9f83-49dc-ba38-a947989573cc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd556fa6ba464928b1e067325792a523', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:16.444791 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de930c37-9f83-49dc-ba38-a947989573cc service swift] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:16.445082 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de930c37-9f83-49dc-ba38-a947989573cc service swift] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:16.445374 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de930c37-9f83-49dc-ba38-a947989573cc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:16.453903 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1238/2493] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:19:16 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 01:19:16.523570 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de930c37-9f83-49dc-ba38-a947989573cc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:16.525638 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de930c37-9f83-49dc-ba38-a947989573cc service swift] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:16.534620 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1256/2494] 10.222.0.79 () {60 vars in 1384 bytes} [Tue Aug 30 01:19:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 30 01:19:24.146190 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7413d1f1-4444-42c6-a2a1-14bf6d77bea5 service glance] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:24.147680 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-7413d1f1-4444-42c6-a2a1-14bf6d77bea5 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:19:24.168576 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:19:24.248593 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7413d1f1-4444-42c6-a2a1-14bf6d77bea5 service glance] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:24.254828 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6776a783-3d46-4fd4-9b8a-0cb1273a85f0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6480b2f14c37474c89df9fba48f7cd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:24.255533 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6776a783-3d46-4fd4-9b8a-0cb1273a85f0 service nova] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:24.255848 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6776a783-3d46-4fd4-9b8a-0cb1273a85f0 service nova] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:24.256153 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6776a783-3d46-4fd4-9b8a-0cb1273a85f0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:24.258079 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-6776a783-3d46-4fd4-9b8a-0cb1273a85f0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:19:24.327179 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6776a783-3d46-4fd4-9b8a-0cb1273a85f0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:24.328801 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6776a783-3d46-4fd4-9b8a-0cb1273a85f0 service nova] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:24.338630 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1239/2495] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:19:24 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 01:19:26.531003 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=54 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:19:32.368004 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de930c37-9f83-49dc-ba38-a947989573cc service swift] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:32.437684 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de930c37-9f83-49dc-ba38-a947989573cc service swift] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:32.442309 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2852f1-a5ee-4724-999a-157bbcd35925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:32.443206 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2852f1-a5ee-4724-999a-157bbcd35925 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:32.443484 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2852f1-a5ee-4724-999a-157bbcd35925 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:32.443759 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2852f1-a5ee-4724-999a-157bbcd35925 admin admin] PATH_INFO: `/v3/users/15024db18ee24033aee4361a27d92994` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:32.444892 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2852f1-a5ee-4724-999a-157bbcd35925 admin admin] RBAC: Authorizing `identity:delete_user(user_id=15024db18ee24033aee4361a27d92994)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:32.447466 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2852f1-a5ee-4724-999a-157bbcd35925 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:32.499206 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-2c2852f1-a5ee-4724-999a-157bbcd35925 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15024db18ee24033aee4361a27d92994'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:19:32.506146 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-2c2852f1-a5ee-4724-999a-157bbcd35925 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15024db18ee24033aee4361a27d92994'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:19:32.514707 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-2c2852f1-a5ee-4724-999a-157bbcd35925 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15024db18ee24033aee4361a27d92994'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:19:32.515554 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-2c2852f1-a5ee-4724-999a-157bbcd35925 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15024db18ee24033aee4361a27d92994'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:19:32.530390 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-2c2852f1-a5ee-4724-999a-157bbcd35925 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15024db18ee24033aee4361a27d92994'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:19:32.537821 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1257/2496] 10.222.0.79 () {58 vars in 1224 bytes} [Tue Aug 30 01:19:32 2022] DELETE /identity/v3/users/15024db18ee24033aee4361a27d92994 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:19:32.544344 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e5485d-37c3-482d-9c32-1609cf5a9708 None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:32.544925 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e5485d-37c3-482d-9c32-1609cf5a9708 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:32.545026 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e5485d-37c3-482d-9c32-1609cf5a9708 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:32.568800 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-06e5485d-37c3-482d-9c32-1609cf5a9708 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:19:32.570617 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-06e5485d-37c3-482d-9c32-1609cf5a9708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:19:32.636271 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1240/2497] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:19:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:19:32.647555 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2852f1-a5ee-4724-999a-157bbcd35925 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:32.649083 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-2c2852f1-a5ee-4724-999a-157bbcd35925 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:19:32.719811 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2852f1-a5ee-4724-999a-157bbcd35925 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:32.723948 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182e8ff6-3978-44b6-857b-9fe5340e3cbf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16e6a0ca26fc4ef892c188ad89a1e132', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:32.724408 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182e8ff6-3978-44b6-857b-9fe5340e3cbf service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:32.724860 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182e8ff6-3978-44b6-857b-9fe5340e3cbf service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:32.725179 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182e8ff6-3978-44b6-857b-9fe5340e3cbf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:32.736311 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182e8ff6-3978-44b6-857b-9fe5340e3cbf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:32.738312 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182e8ff6-3978-44b6-857b-9fe5340e3cbf service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:32.749724 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1258/2498] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:19:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:19:33.036336 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e5485d-37c3-482d-9c32-1609cf5a9708 None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:33.040165 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-06e5485d-37c3-482d-9c32-1609cf5a9708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:19:33.051748 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e5485d-37c3-482d-9c32-1609cf5a9708 None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:33.059434 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d54bfb-816e-414c-a28f-76bcb132121b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:33.060066 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d54bfb-816e-414c-a28f-76bcb132121b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:33.060348 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d54bfb-816e-414c-a28f-76bcb132121b admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:33.060621 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d54bfb-816e-414c-a28f-76bcb132121b admin admin] PATH_INFO: `/v3/projects/da3269743468418d9bccc4c4a121a72a` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:33.061821 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d54bfb-816e-414c-a28f-76bcb132121b admin admin] RBAC: Authorizing `identity:delete_project(project_id=da3269743468418d9bccc4c4a121a72a)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:33.063865 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d54bfb-816e-414c-a28f-76bcb132121b admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:33.130032 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:19:33.132168 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-02d54bfb-816e-414c-a28f-76bcb132121b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da3269743468418d9bccc4c4a121a72a', 'request_id': 'req-02d54bfb-816e-414c-a28f-76bcb132121b'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:19:33.143020 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-02d54bfb-816e-414c-a28f-76bcb132121b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da3269743468418d9bccc4c4a121a72a', 'request_id': 'req-02d54bfb-816e-414c-a28f-76bcb132121b'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:19:33.152374 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-02d54bfb-816e-414c-a28f-76bcb132121b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da3269743468418d9bccc4c4a121a72a', 'request_id': 'req-02d54bfb-816e-414c-a28f-76bcb132121b'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:19:33.167360 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-02d54bfb-816e-414c-a28f-76bcb132121b admin admin] The token cache is being invalidate because project da3269743468418d9bccc4c4a121a72a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81998) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:19:33.167654 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-02d54bfb-816e-414c-a28f-76bcb132121b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:19:33.168923 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-02d54bfb-816e-414c-a28f-76bcb132121b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:19:33.174212 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1241/2499] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 30 01:19:33 2022] DELETE /identity/v3/projects/da3269743468418d9bccc4c4a121a72a => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:19:33.175993 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbe0b33-3598-4dcd-b712-63df53c5c7c0 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:33.176344 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbe0b33-3598-4dcd-b712-63df53c5c7c0 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:33.176683 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbe0b33-3598-4dcd-b712-63df53c5c7c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:33.202098 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-3fbe0b33-3598-4dcd-b712-63df53c5c7c0 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:19:33.202409 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d54bfb-816e-414c-a28f-76bcb132121b admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:33.203497 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-3fbe0b33-3598-4dcd-b712-63df53c5c7c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:19:33.204967 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-02d54bfb-816e-414c-a28f-76bcb132121b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:19:33.246392 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:19:33.294026 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d54bfb-816e-414c-a28f-76bcb132121b admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:33.295923 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1273342-397a-45fe-8778-209fb5a6d709 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16e6a0ca26fc4ef892c188ad89a1e132', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:33.296521 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1273342-397a-45fe-8778-209fb5a6d709 service neutron] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:33.296897 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1273342-397a-45fe-8778-209fb5a6d709 service neutron] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:33.297229 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1273342-397a-45fe-8778-209fb5a6d709 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:33.299062 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-a1273342-397a-45fe-8778-209fb5a6d709 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:19:33.303555 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1259/2500] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:19:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:19:33.311470 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaa0f58-d2e4-49b5-bb44-4693d5f085c0 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:33.311832 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaa0f58-d2e4-49b5-bb44-4693d5f085c0 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:33.312238 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaa0f58-d2e4-49b5-bb44-4693d5f085c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:33.321198 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1273342-397a-45fe-8778-209fb5a6d709 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:33.324544 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1273342-397a-45fe-8778-209fb5a6d709 service neutron] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:33.337171 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1242/2501] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:19:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:19:33.345980 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-6eaa0f58-d2e4-49b5-bb44-4693d5f085c0 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:19:33.348532 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-6eaa0f58-d2e4-49b5-bb44-4693d5f085c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:19:33.359168 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1260/2502] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:19:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:19:33.363321 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1273342-397a-45fe-8778-209fb5a6d709 service neutron] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:33.374083 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1273342-397a-45fe-8778-209fb5a6d709 service neutron] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:33.379585 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e761e56-3844-4d23-b24a-1569fadc4d61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:33.380325 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e761e56-3844-4d23-b24a-1569fadc4d61 admin admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:33.380611 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e761e56-3844-4d23-b24a-1569fadc4d61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:33.381037 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e761e56-3844-4d23-b24a-1569fadc4d61 admin admin] PATH_INFO: `/v3/domains` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:33.381772 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e761e56-3844-4d23-b24a-1569fadc4d61 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:19:33.382045 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e761e56-3844-4d23-b24a-1569fadc4d61 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:33.384947 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e761e56-3844-4d23-b24a-1569fadc4d61 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:33.397427 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1243/2503] 10.222.0.79 () {58 vars in 1153 bytes} [Tue Aug 30 01:19:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:19:33.404227 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaa0f58-d2e4-49b5-bb44-4693d5f085c0 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:33.413967 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaa0f58-d2e4-49b5-bb44-4693d5f085c0 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:33.419029 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc3d16a-ef68-4aff-b380-b892ab690418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:33.419719 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc3d16a-ef68-4aff-b380-b892ab690418 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:33.420059 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc3d16a-ef68-4aff-b380-b892ab690418 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:33.420463 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc3d16a-ef68-4aff-b380-b892ab690418 admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:33.421265 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc3d16a-ef68-4aff-b380-b892ab690418 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:33.423527 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc3d16a-ef68-4aff-b380-b892ab690418 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:33.456151 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1261/2504] 10.222.0.79 () {60 vars in 1153 bytes} [Tue Aug 30 01:19:33 2022] POST /identity/v3/projects => generated 377 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:19:33.460646 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e761e56-3844-4d23-b24a-1569fadc4d61 admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:33.471511 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e761e56-3844-4d23-b24a-1569fadc4d61 admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:33.539377 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d42ac2-a5a8-47cd-92a7-e2acfd10f551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:33.540086 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d42ac2-a5a8-47cd-92a7-e2acfd10f551 admin admin] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:33.540363 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d42ac2-a5a8-47cd-92a7-e2acfd10f551 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:33.540771 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d42ac2-a5a8-47cd-92a7-e2acfd10f551 admin admin] PATH_INFO: `/v3/users` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:33.541356 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d42ac2-a5a8-47cd-92a7-e2acfd10f551 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:33.543820 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d42ac2-a5a8-47cd-92a7-e2acfd10f551 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:33.569538 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1244/2505] 10.222.0.79 () {60 vars in 1144 bytes} [Tue Aug 30 01:19:33 2022] POST /identity/v3/users => generated 289 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:19:33.575076 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc3d16a-ef68-4aff-b380-b892ab690418 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:33.590817 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc3d16a-ef68-4aff-b380-b892ab690418 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:33.598427 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2247e70-cbcc-4539-9263-6513c2c7bb1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:33.599151 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2247e70-cbcc-4539-9263-6513c2c7bb1a admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:33.599899 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2247e70-cbcc-4539-9263-6513c2c7bb1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:33.599899 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2247e70-cbcc-4539-9263-6513c2c7bb1a admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:33.600530 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2247e70-cbcc-4539-9263-6513c2c7bb1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:33.602497 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2247e70-cbcc-4539-9263-6513c2c7bb1a admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:33.615375 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1262/2506] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:19:33 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:19:33.619343 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d42ac2-a5a8-47cd-92a7-e2acfd10f551 admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:33.630156 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d42ac2-a5a8-47cd-92a7-e2acfd10f551 admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:33.635865 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7d2c39-5b9f-47ab-a527-fe0b055ceb3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:33.636500 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7d2c39-5b9f-47ab-a527-fe0b055ceb3e admin admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:33.636783 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7d2c39-5b9f-47ab-a527-fe0b055ceb3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:33.637058 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7d2c39-5b9f-47ab-a527-fe0b055ceb3e admin admin] PATH_INFO: `/v3/roles` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:33.637748 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7d2c39-5b9f-47ab-a527-fe0b055ceb3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:33.639422 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7d2c39-5b9f-47ab-a527-fe0b055ceb3e admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:33.652472 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1245/2507] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:19:33 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:19:33.657305 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2247e70-cbcc-4539-9263-6513c2c7bb1a admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:33.671297 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2247e70-cbcc-4539-9263-6513c2c7bb1a admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:33.677660 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8305b843-9ca1-44c1-8898-6561a7c3218c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:33.678525 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8305b843-9ca1-44c1-8898-6561a7c3218c admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:33.678676 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8305b843-9ca1-44c1-8898-6561a7c3218c admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:33.679039 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8305b843-9ca1-44c1-8898-6561a7c3218c admin admin] PATH_INFO: `/v3/projects/b27caea527cc4c6caa1ab37621688d53/users/5a59bf9070cf4e919e36e7323f2b61c7/roles/c37945a17623465f899d4f217e7af593` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:33.696829 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8305b843-9ca1-44c1-8898-6561a7c3218c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b27caea527cc4c6caa1ab37621688d53, user_id=5a59bf9070cf4e919e36e7323f2b61c7, role_id=c37945a17623465f899d4f217e7af593)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:33.699649 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8305b843-9ca1-44c1-8898-6561a7c3218c admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:33.716462 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1263/2508] 10.222.0.79 () {60 vars in 1483 bytes} [Tue Aug 30 01:19:33 2022] PUT /identity/v3/projects/b27caea527cc4c6caa1ab37621688d53/users/5a59bf9070cf4e919e36e7323f2b61c7/roles/c37945a17623465f899d4f217e7af593 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:19:33.808182 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141afa0f-b872-46d9-a57a-e8f51dd5eac2 None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:33.808378 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141afa0f-b872-46d9-a57a-e8f51dd5eac2 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:33.808632 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141afa0f-b872-46d9-a57a-e8f51dd5eac2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:33.839603 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-141afa0f-b872-46d9-a57a-e8f51dd5eac2 None None] MFA Rules not processed for user `5a59bf9070cf4e919e36e7323f2b61c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:19:33.840984 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-141afa0f-b872-46d9-a57a-e8f51dd5eac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:19:33.877806 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:19:33.937373 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1246/2509] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:19:33 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:19:33.948852 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8305b843-9ca1-44c1-8898-6561a7c3218c admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:33.950648 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-8305b843-9ca1-44c1-8898-6561a7c3218c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:19:34.014433 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8305b843-9ca1-44c1-8898-6561a7c3218c admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:34.018047 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd69fca-73a7-4548-82df-17a463a95be3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f827c7670b74d938ffe066ced88d1c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:34.018656 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd69fca-73a7-4548-82df-17a463a95be3 service cinder] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:34.018933 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd69fca-73a7-4548-82df-17a463a95be3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:34.019235 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd69fca-73a7-4548-82df-17a463a95be3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:34.029060 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd69fca-73a7-4548-82df-17a463a95be3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:34.030499 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd69fca-73a7-4548-82df-17a463a95be3 service cinder] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:34.043456 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1264/2510] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:19:33 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:19:37.039903 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141afa0f-b872-46d9-a57a-e8f51dd5eac2 None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:37.041833 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-141afa0f-b872-46d9-a57a-e8f51dd5eac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:19:37.140178 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141afa0f-b872-46d9-a57a-e8f51dd5eac2 None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:37.145636 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfeb74a2-46b1-4293-a9d5-61e6b93f278d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:37.146448 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeb74a2-46b1-4293-a9d5-61e6b93f278d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:37.146835 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeb74a2-46b1-4293-a9d5-61e6b93f278d admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:37.147247 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeb74a2-46b1-4293-a9d5-61e6b93f278d admin admin] PATH_INFO: `/v3/users/3ddcdbd4269c44c9b9e8d1c109de061f` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:37.149633 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfeb74a2-46b1-4293-a9d5-61e6b93f278d admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ddcdbd4269c44c9b9e8d1c109de061f)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:37.152692 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfeb74a2-46b1-4293-a9d5-61e6b93f278d admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:37.213219 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-bfeb74a2-46b1-4293-a9d5-61e6b93f278d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ddcdbd4269c44c9b9e8d1c109de061f'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:19:37.221239 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-bfeb74a2-46b1-4293-a9d5-61e6b93f278d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ddcdbd4269c44c9b9e8d1c109de061f'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:19:37.239766 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-bfeb74a2-46b1-4293-a9d5-61e6b93f278d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ddcdbd4269c44c9b9e8d1c109de061f'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:19:37.240540 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-bfeb74a2-46b1-4293-a9d5-61e6b93f278d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ddcdbd4269c44c9b9e8d1c109de061f'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:19:37.251684 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-bfeb74a2-46b1-4293-a9d5-61e6b93f278d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ddcdbd4269c44c9b9e8d1c109de061f'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:19:37.262568 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1247/2511] 10.222.0.79 () {58 vars in 1224 bytes} [Tue Aug 30 01:19:37 2022] DELETE /identity/v3/users/3ddcdbd4269c44c9b9e8d1c109de061f => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:19:37.477696 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd69fca-73a7-4548-82df-17a463a95be3 service cinder] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:37.489408 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd69fca-73a7-4548-82df-17a463a95be3 service cinder] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:37.560860 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692b914d-3f2a-4ba0-b221-3f9ee8461f7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:37.561489 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692b914d-3f2a-4ba0-b221-3f9ee8461f7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:37.561761 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692b914d-3f2a-4ba0-b221-3f9ee8461f7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:37.562028 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692b914d-3f2a-4ba0-b221-3f9ee8461f7d admin admin] PATH_INFO: `/v3/projects/497e00b7b49041a5bd2c92b19e45c4fc` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:37.563189 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692b914d-3f2a-4ba0-b221-3f9ee8461f7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=497e00b7b49041a5bd2c92b19e45c4fc)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:37.565078 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692b914d-3f2a-4ba0-b221-3f9ee8461f7d admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:37.567889 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:19:37.621077 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-692b914d-3f2a-4ba0-b221-3f9ee8461f7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '497e00b7b49041a5bd2c92b19e45c4fc', 'request_id': 'req-692b914d-3f2a-4ba0-b221-3f9ee8461f7d'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:19:37.629602 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-692b914d-3f2a-4ba0-b221-3f9ee8461f7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '497e00b7b49041a5bd2c92b19e45c4fc', 'request_id': 'req-692b914d-3f2a-4ba0-b221-3f9ee8461f7d'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:19:37.635801 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-692b914d-3f2a-4ba0-b221-3f9ee8461f7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '497e00b7b49041a5bd2c92b19e45c4fc', 'request_id': 'req-692b914d-3f2a-4ba0-b221-3f9ee8461f7d'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:19:37.647544 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-692b914d-3f2a-4ba0-b221-3f9ee8461f7d admin admin] The token cache is being invalidate because project 497e00b7b49041a5bd2c92b19e45c4fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:19:37.647717 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-692b914d-3f2a-4ba0-b221-3f9ee8461f7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:19:37.649466 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-692b914d-3f2a-4ba0-b221-3f9ee8461f7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:19:37.651112 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1265/2512] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 30 01:19:37 2022] DELETE /identity/v3/projects/497e00b7b49041a5bd2c92b19e45c4fc => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:19:37.656124 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2ce965-c636-420e-b812-fb4bb3704bc3 None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:37.656787 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2ce965-c636-420e-b812-fb4bb3704bc3 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:37.656787 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2ce965-c636-420e-b812-fb4bb3704bc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:37.682246 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-8b2ce965-c636-420e-b812-fb4bb3704bc3 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:19:37.683628 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-8b2ce965-c636-420e-b812-fb4bb3704bc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:19:37.750976 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:19:37.769429 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1248/2513] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:19:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:19:37.778754 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ea922e-a251-4388-8c32-0622b35bd190 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:37.778947 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ea922e-a251-4388-8c32-0622b35bd190 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:37.779212 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ea922e-a251-4388-8c32-0622b35bd190 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:37.803077 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-e4ea922e-a251-4388-8c32-0622b35bd190 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:19:37.804547 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-e4ea922e-a251-4388-8c32-0622b35bd190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:19:37.815722 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1266/2514] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:19:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:19:37.821632 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2ce965-c636-420e-b812-fb4bb3704bc3 None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:37.834614 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2ce965-c636-420e-b812-fb4bb3704bc3 None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:37.840165 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7e3440-16bb-4161-9654-f34106542624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:37.840786 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7e3440-16bb-4161-9654-f34106542624 admin admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:37.841079 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7e3440-16bb-4161-9654-f34106542624 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:37.841335 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7e3440-16bb-4161-9654-f34106542624 admin admin] PATH_INFO: `/v3/domains` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:37.841995 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7e3440-16bb-4161-9654-f34106542624 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:19:37.842298 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7e3440-16bb-4161-9654-f34106542624 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:37.843996 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7e3440-16bb-4161-9654-f34106542624 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:37.858489 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1249/2515] 10.222.0.79 () {58 vars in 1153 bytes} [Tue Aug 30 01:19:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:19:37.865537 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ea922e-a251-4388-8c32-0622b35bd190 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:37.881465 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ea922e-a251-4388-8c32-0622b35bd190 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:37.888256 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf5001c-fae4-4d6c-a7ee-13efd302f0ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:37.888985 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf5001c-fae4-4d6c-a7ee-13efd302f0ce admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:37.889393 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf5001c-fae4-4d6c-a7ee-13efd302f0ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:37.889815 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf5001c-fae4-4d6c-a7ee-13efd302f0ce admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:37.890935 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf5001c-fae4-4d6c-a7ee-13efd302f0ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:37.894761 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf5001c-fae4-4d6c-a7ee-13efd302f0ce admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:37.936766 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1267/2516] 10.222.0.79 () {60 vars in 1153 bytes} [Tue Aug 30 01:19:37 2022] POST /identity/v3/projects => generated 371 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:19:37.941603 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7e3440-16bb-4161-9654-f34106542624 admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:37.954969 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7e3440-16bb-4161-9654-f34106542624 admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:38.031781 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae93699-572f-40da-85a1-437c7de77067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:38.032332 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae93699-572f-40da-85a1-437c7de77067 admin admin] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:38.032810 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae93699-572f-40da-85a1-437c7de77067 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:38.033091 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae93699-572f-40da-85a1-437c7de77067 admin admin] PATH_INFO: `/v3/users` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:38.033764 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae93699-572f-40da-85a1-437c7de77067 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:38.040840 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae93699-572f-40da-85a1-437c7de77067 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:38.074806 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1250/2517] 10.222.0.79 () {60 vars in 1144 bytes} [Tue Aug 30 01:19:37 2022] POST /identity/v3/users => generated 286 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:19:38.076411 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf5001c-fae4-4d6c-a7ee-13efd302f0ce admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:38.092947 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf5001c-fae4-4d6c-a7ee-13efd302f0ce admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:38.114925 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b687bce-f68a-42a6-943a-229d414fec4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:38.115734 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b687bce-f68a-42a6-943a-229d414fec4b admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:38.116019 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b687bce-f68a-42a6-943a-229d414fec4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:38.116285 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b687bce-f68a-42a6-943a-229d414fec4b admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:38.117621 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b687bce-f68a-42a6-943a-229d414fec4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:38.119386 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b687bce-f68a-42a6-943a-229d414fec4b admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:38.137933 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1268/2518] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:19:38 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:19:38.141907 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae93699-572f-40da-85a1-437c7de77067 admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:38.156178 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae93699-572f-40da-85a1-437c7de77067 admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:38.163695 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5991e52-31f8-402c-9a7e-9cc284880b80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:38.164732 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5991e52-31f8-402c-9a7e-9cc284880b80 admin admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:38.165409 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5991e52-31f8-402c-9a7e-9cc284880b80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:38.166041 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5991e52-31f8-402c-9a7e-9cc284880b80 admin admin] PATH_INFO: `/v3/roles` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:38.167421 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5991e52-31f8-402c-9a7e-9cc284880b80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:38.170262 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5991e52-31f8-402c-9a7e-9cc284880b80 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:38.192086 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1251/2519] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:19:38 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 01:19:38.193761 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b687bce-f68a-42a6-943a-229d414fec4b admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:38.213601 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b687bce-f68a-42a6-943a-229d414fec4b admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:38.220541 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e3d58f-75d9-4a62-b4ac-3ef142e6870b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:38.221339 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e3d58f-75d9-4a62-b4ac-3ef142e6870b admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:38.221625 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e3d58f-75d9-4a62-b4ac-3ef142e6870b admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:38.221899 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e3d58f-75d9-4a62-b4ac-3ef142e6870b admin admin] PATH_INFO: `/v3/projects/48470d0e75814d5fbba92946f2270551/users/83fa8be8293649e49ec225ffc35cb41e/roles/c37945a17623465f899d4f217e7af593` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:38.242353 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e3d58f-75d9-4a62-b4ac-3ef142e6870b admin admin] RBAC: Authorizing `identity:create_grant(project_id=48470d0e75814d5fbba92946f2270551, user_id=83fa8be8293649e49ec225ffc35cb41e, role_id=c37945a17623465f899d4f217e7af593)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:38.245482 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e3d58f-75d9-4a62-b4ac-3ef142e6870b admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:38.261281 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1269/2520] 10.222.0.79 () {60 vars in 1483 bytes} [Tue Aug 30 01:19:38 2022] PUT /identity/v3/projects/48470d0e75814d5fbba92946f2270551/users/83fa8be8293649e49ec225ffc35cb41e/roles/c37945a17623465f899d4f217e7af593 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:19:38.271578 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91fa8e1-7ffd-49bd-bba4-c3795498b1e5 None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:38.271869 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91fa8e1-7ffd-49bd-bba4-c3795498b1e5 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:38.272421 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91fa8e1-7ffd-49bd-bba4-c3795498b1e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:38.304601 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-d91fa8e1-7ffd-49bd-bba4-c3795498b1e5 None None] MFA Rules not processed for user `83fa8be8293649e49ec225ffc35cb41e`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:19:38.306615 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-d91fa8e1-7ffd-49bd-bba4-c3795498b1e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:19:38.392118 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1252/2521] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:19:38 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:19:38.398908 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e3d58f-75d9-4a62-b4ac-3ef142e6870b admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:38.487363 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e3d58f-75d9-4a62-b4ac-3ef142e6870b admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:38.494107 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac82bec7-9366-4bec-8043-888f3f4e30e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:38.495058 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac82bec7-9366-4bec-8043-888f3f4e30e6 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:38.495541 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac82bec7-9366-4bec-8043-888f3f4e30e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:38.495966 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac82bec7-9366-4bec-8043-888f3f4e30e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:38.496814 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac82bec7-9366-4bec-8043-888f3f4e30e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:38.499229 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac82bec7-9366-4bec-8043-888f3f4e30e6 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:38.538871 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1270/2522] 10.222.0.79 () {60 vars in 1153 bytes} [Tue Aug 30 01:19:38 2022] POST /identity/v3/projects => generated 373 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:19:38.544999 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91fa8e1-7ffd-49bd-bba4-c3795498b1e5 None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:38.564538 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91fa8e1-7ffd-49bd-bba4-c3795498b1e5 None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:38.637376 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:19:38.656285 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b901743-c51a-4b31-946d-dc2ccfdca0ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:38.657011 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b901743-c51a-4b31-946d-dc2ccfdca0ef admin admin] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:38.657501 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b901743-c51a-4b31-946d-dc2ccfdca0ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:38.657839 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b901743-c51a-4b31-946d-dc2ccfdca0ef admin admin] PATH_INFO: `/v3/users` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:38.658725 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b901743-c51a-4b31-946d-dc2ccfdca0ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:38.660901 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b901743-c51a-4b31-946d-dc2ccfdca0ef admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:38.697712 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1253/2523] 10.222.0.79 () {60 vars in 1144 bytes} [Tue Aug 30 01:19:38 2022] POST /identity/v3/users => generated 293 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:19:38.704060 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac82bec7-9366-4bec-8043-888f3f4e30e6 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:38.719368 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac82bec7-9366-4bec-8043-888f3f4e30e6 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:38.726762 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612c7d8c-1016-4325-a5cb-37404557d7a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:38.727904 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612c7d8c-1016-4325-a5cb-37404557d7a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:38.728334 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612c7d8c-1016-4325-a5cb-37404557d7a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:38.728719 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612c7d8c-1016-4325-a5cb-37404557d7a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:38.729851 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612c7d8c-1016-4325-a5cb-37404557d7a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:38.732803 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612c7d8c-1016-4325-a5cb-37404557d7a3 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:38.750334 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1271/2524] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:19:38 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:19:38.755096 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b901743-c51a-4b31-946d-dc2ccfdca0ef admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:38.766869 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b901743-c51a-4b31-946d-dc2ccfdca0ef admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:38.772477 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a456bc-40de-435b-8cd6-be5fd3206c7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:38.774192 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a456bc-40de-435b-8cd6-be5fd3206c7a admin admin] REQUEST_METHOD: `PUT` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:38.774591 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a456bc-40de-435b-8cd6-be5fd3206c7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:38.774962 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a456bc-40de-435b-8cd6-be5fd3206c7a admin admin] PATH_INFO: `/v3/projects/bf74521a42274f249ac04a4bc3d431df/users/f7d0e2ff3bd94b4fb7bb767e96208cc4/roles/d14c3070c9184d76a7b23df69bd3db07` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:38.798227 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a456bc-40de-435b-8cd6-be5fd3206c7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf74521a42274f249ac04a4bc3d431df, user_id=f7d0e2ff3bd94b4fb7bb767e96208cc4, role_id=d14c3070c9184d76a7b23df69bd3db07)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:38.801049 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a456bc-40de-435b-8cd6-be5fd3206c7a admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:38.825816 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1254/2525] 10.222.0.79 () {60 vars in 1483 bytes} [Tue Aug 30 01:19:38 2022] PUT /identity/v3/projects/bf74521a42274f249ac04a4bc3d431df/users/f7d0e2ff3bd94b4fb7bb767e96208cc4/roles/d14c3070c9184d76a7b23df69bd3db07 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:19:38.830615 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612c7d8c-1016-4325-a5cb-37404557d7a3 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:38.843074 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:19:38.851555 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612c7d8c-1016-4325-a5cb-37404557d7a3 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:38.926257 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c401caf-27d7-43fd-bc8b-7c750e70d26f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:38.926974 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c401caf-27d7-43fd-bc8b-7c750e70d26f admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:38.927283 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c401caf-27d7-43fd-bc8b-7c750e70d26f admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:38.927550 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c401caf-27d7-43fd-bc8b-7c750e70d26f admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:38.928197 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c401caf-27d7-43fd-bc8b-7c750e70d26f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:38.930379 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c401caf-27d7-43fd-bc8b-7c750e70d26f admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:38.945966 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1272/2526] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:19:38 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:19:38.947169 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a456bc-40de-435b-8cd6-be5fd3206c7a admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:38.959609 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a456bc-40de-435b-8cd6-be5fd3206c7a admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:38.967498 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c8cb9f-fe72-4dbe-81e7-a2a9471e1adc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:38.968174 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c8cb9f-fe72-4dbe-81e7-a2a9471e1adc admin admin] REQUEST_METHOD: `PUT` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:38.968506 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c8cb9f-fe72-4dbe-81e7-a2a9471e1adc admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:38.969427 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c8cb9f-fe72-4dbe-81e7-a2a9471e1adc admin admin] PATH_INFO: `/v3/projects/bf74521a42274f249ac04a4bc3d431df/users/f7d0e2ff3bd94b4fb7bb767e96208cc4/roles/d14c3070c9184d76a7b23df69bd3db07` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:38.972050 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c8cb9f-fe72-4dbe-81e7-a2a9471e1adc admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf74521a42274f249ac04a4bc3d431df, user_id=f7d0e2ff3bd94b4fb7bb767e96208cc4, role_id=d14c3070c9184d76a7b23df69bd3db07)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:38.974743 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c8cb9f-fe72-4dbe-81e7-a2a9471e1adc admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:38.988353 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1255/2527] 10.222.0.79 () {60 vars in 1483 bytes} [Tue Aug 30 01:19:38 2022] PUT /identity/v3/projects/bf74521a42274f249ac04a4bc3d431df/users/f7d0e2ff3bd94b4fb7bb767e96208cc4/roles/d14c3070c9184d76a7b23df69bd3db07 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:19:38.999639 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad41228f-bf3e-49b0-8184-15f9ff614ae5 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:39.000043 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad41228f-bf3e-49b0-8184-15f9ff614ae5 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:39.000408 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad41228f-bf3e-49b0-8184-15f9ff614ae5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:39.056091 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-ad41228f-bf3e-49b0-8184-15f9ff614ae5 None None] MFA Rules not processed for user `f7d0e2ff3bd94b4fb7bb767e96208cc4`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:19:39.057255 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-ad41228f-bf3e-49b0-8184-15f9ff614ae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:19:39.143513 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1273/2528] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:19:38 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:19:39.157036 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c8cb9f-fe72-4dbe-81e7-a2a9471e1adc admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:39.159517 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-c2c8cb9f-fe72-4dbe-81e7-a2a9471e1adc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:19:39.264509 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c8cb9f-fe72-4dbe-81e7-a2a9471e1adc admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:39.269353 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8197936c-f319-4d79-8f13-b5257c71be4d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f827c7670b74d938ffe066ced88d1c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:39.269981 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8197936c-f319-4d79-8f13-b5257c71be4d service cinder] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:39.270372 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8197936c-f319-4d79-8f13-b5257c71be4d service cinder] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:39.270533 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8197936c-f319-4d79-8f13-b5257c71be4d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:39.282320 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8197936c-f319-4d79-8f13-b5257c71be4d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:39.283859 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8197936c-f319-4d79-8f13-b5257c71be4d service cinder] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:39.296144 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1256/2529] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:19:39 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:19:39.972485 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad41228f-bf3e-49b0-8184-15f9ff614ae5 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:40.097682 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad41228f-bf3e-49b0-8184-15f9ff614ae5 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:40.104692 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393b8dfd-1cf6-4229-8db8-4b54165e8aa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:40.105275 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393b8dfd-1cf6-4229-8db8-4b54165e8aa9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:40.105557 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393b8dfd-1cf6-4229-8db8-4b54165e8aa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:40.105865 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393b8dfd-1cf6-4229-8db8-4b54165e8aa9 admin admin] PATH_INFO: `/v3/users/83fa8be8293649e49ec225ffc35cb41e` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:40.109375 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393b8dfd-1cf6-4229-8db8-4b54165e8aa9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=83fa8be8293649e49ec225ffc35cb41e)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:40.114679 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393b8dfd-1cf6-4229-8db8-4b54165e8aa9 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:40.152251 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:19:40.185783 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-393b8dfd-1cf6-4229-8db8-4b54165e8aa9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83fa8be8293649e49ec225ffc35cb41e'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:19:40.198424 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-393b8dfd-1cf6-4229-8db8-4b54165e8aa9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83fa8be8293649e49ec225ffc35cb41e'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:19:40.208637 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-393b8dfd-1cf6-4229-8db8-4b54165e8aa9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83fa8be8293649e49ec225ffc35cb41e'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:19:40.209287 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-393b8dfd-1cf6-4229-8db8-4b54165e8aa9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83fa8be8293649e49ec225ffc35cb41e'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:19:40.224041 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-393b8dfd-1cf6-4229-8db8-4b54165e8aa9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83fa8be8293649e49ec225ffc35cb41e'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:19:40.234606 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1274/2530] 10.222.0.79 () {58 vars in 1224 bytes} [Tue Aug 30 01:19:39 2022] DELETE /identity/v3/users/83fa8be8293649e49ec225ffc35cb41e => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:19:40.241213 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c091b0-581e-4978-9f19-2040dfeba22f None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:40.245261 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c091b0-581e-4978-9f19-2040dfeba22f None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:40.245261 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c091b0-581e-4978-9f19-2040dfeba22f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:40.266506 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-c1c091b0-581e-4978-9f19-2040dfeba22f None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:19:40.267952 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-c1c091b0-581e-4978-9f19-2040dfeba22f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:19:40.337107 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1257/2531] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:19:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:19:40.354924 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393b8dfd-1cf6-4229-8db8-4b54165e8aa9 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:40.356204 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-393b8dfd-1cf6-4229-8db8-4b54165e8aa9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:19:40.436554 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393b8dfd-1cf6-4229-8db8-4b54165e8aa9 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:40.441317 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfd77b3-7438-4372-b99b-bde17641d74d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16e6a0ca26fc4ef892c188ad89a1e132', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:40.441955 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfd77b3-7438-4372-b99b-bde17641d74d service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:40.442233 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfd77b3-7438-4372-b99b-bde17641d74d service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:40.442896 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfd77b3-7438-4372-b99b-bde17641d74d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:40.455174 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfd77b3-7438-4372-b99b-bde17641d74d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:40.457121 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfd77b3-7438-4372-b99b-bde17641d74d service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:40.472069 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1275/2532] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:19:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:19:40.789867 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c091b0-581e-4978-9f19-2040dfeba22f None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:40.792680 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-c1c091b0-581e-4978-9f19-2040dfeba22f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:19:40.809233 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c091b0-581e-4978-9f19-2040dfeba22f None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:40.814325 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e408b0d3-e736-4fb8-87b3-f6c5d1ebbe34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:40.815222 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e408b0d3-e736-4fb8-87b3-f6c5d1ebbe34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:40.815506 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e408b0d3-e736-4fb8-87b3-f6c5d1ebbe34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:40.815779 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e408b0d3-e736-4fb8-87b3-f6c5d1ebbe34 admin admin] PATH_INFO: `/v3/projects/48470d0e75814d5fbba92946f2270551` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:40.817082 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e408b0d3-e736-4fb8-87b3-f6c5d1ebbe34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=48470d0e75814d5fbba92946f2270551)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:40.820962 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e408b0d3-e736-4fb8-87b3-f6c5d1ebbe34 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:40.862704 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:19:40.871233 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-e408b0d3-e736-4fb8-87b3-f6c5d1ebbe34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48470d0e75814d5fbba92946f2270551', 'request_id': 'req-e408b0d3-e736-4fb8-87b3-f6c5d1ebbe34'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:19:40.879042 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-e408b0d3-e736-4fb8-87b3-f6c5d1ebbe34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48470d0e75814d5fbba92946f2270551', 'request_id': 'req-e408b0d3-e736-4fb8-87b3-f6c5d1ebbe34'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:19:40.885658 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-e408b0d3-e736-4fb8-87b3-f6c5d1ebbe34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48470d0e75814d5fbba92946f2270551', 'request_id': 'req-e408b0d3-e736-4fb8-87b3-f6c5d1ebbe34'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:19:40.896965 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-e408b0d3-e736-4fb8-87b3-f6c5d1ebbe34 admin admin] The token cache is being invalidate because project 48470d0e75814d5fbba92946f2270551 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81998) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:19:40.897238 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-e408b0d3-e736-4fb8-87b3-f6c5d1ebbe34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:19:40.898594 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-e408b0d3-e736-4fb8-87b3-f6c5d1ebbe34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:19:40.900542 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1258/2533] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 30 01:19:40 2022] DELETE /identity/v3/projects/48470d0e75814d5fbba92946f2270551 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:19:40.908335 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfd77b3-7438-4372-b99b-bde17641d74d service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:40.920522 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfd77b3-7438-4372-b99b-bde17641d74d service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:40.990123 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d46f99-a9b6-4ae1-a555-9e4de3852a7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:40.991101 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d46f99-a9b6-4ae1-a555-9e4de3852a7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:40.991452 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d46f99-a9b6-4ae1-a555-9e4de3852a7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:40.991857 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d46f99-a9b6-4ae1-a555-9e4de3852a7b admin admin] PATH_INFO: `/v3/users/f7d0e2ff3bd94b4fb7bb767e96208cc4` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:40.993678 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d46f99-a9b6-4ae1-a555-9e4de3852a7b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7d0e2ff3bd94b4fb7bb767e96208cc4)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:40.995536 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d46f99-a9b6-4ae1-a555-9e4de3852a7b admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:41.049499 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-d8d46f99-a9b6-4ae1-a555-9e4de3852a7b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7d0e2ff3bd94b4fb7bb767e96208cc4'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:19:41.050794 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:19:41.059581 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-d8d46f99-a9b6-4ae1-a555-9e4de3852a7b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7d0e2ff3bd94b4fb7bb767e96208cc4'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:19:41.068933 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-d8d46f99-a9b6-4ae1-a555-9e4de3852a7b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7d0e2ff3bd94b4fb7bb767e96208cc4'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:19:41.070630 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-d8d46f99-a9b6-4ae1-a555-9e4de3852a7b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7d0e2ff3bd94b4fb7bb767e96208cc4'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:19:41.082887 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-d8d46f99-a9b6-4ae1-a555-9e4de3852a7b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7d0e2ff3bd94b4fb7bb767e96208cc4'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:19:41.090117 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1276/2534] 10.222.0.79 () {58 vars in 1224 bytes} [Tue Aug 30 01:19:40 2022] DELETE /identity/v3/users/f7d0e2ff3bd94b4fb7bb767e96208cc4 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:19:41.395709 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e408b0d3-e736-4fb8-87b3-f6c5d1ebbe34 admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:41.398345 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-e408b0d3-e736-4fb8-87b3-f6c5d1ebbe34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:19:41.411427 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e408b0d3-e736-4fb8-87b3-f6c5d1ebbe34 admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:41.480650 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70943d6-894e-4b97-baca-f292dab470e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:41.481285 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70943d6-894e-4b97-baca-f292dab470e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:41.481558 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70943d6-894e-4b97-baca-f292dab470e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:41.481828 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70943d6-894e-4b97-baca-f292dab470e6 admin admin] PATH_INFO: `/v3/projects/bf74521a42274f249ac04a4bc3d431df` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:41.482975 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70943d6-894e-4b97-baca-f292dab470e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf74521a42274f249ac04a4bc3d431df)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:41.485042 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70943d6-894e-4b97-baca-f292dab470e6 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:41.550721 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-a70943d6-894e-4b97-baca-f292dab470e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf74521a42274f249ac04a4bc3d431df', 'request_id': 'req-a70943d6-894e-4b97-baca-f292dab470e6'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:19:41.561359 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-a70943d6-894e-4b97-baca-f292dab470e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf74521a42274f249ac04a4bc3d431df', 'request_id': 'req-a70943d6-894e-4b97-baca-f292dab470e6'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:19:41.572070 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-a70943d6-894e-4b97-baca-f292dab470e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf74521a42274f249ac04a4bc3d431df', 'request_id': 'req-a70943d6-894e-4b97-baca-f292dab470e6'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:19:41.587613 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-a70943d6-894e-4b97-baca-f292dab470e6 admin admin] The token cache is being invalidate because project bf74521a42274f249ac04a4bc3d431df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81998) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:19:41.588012 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-a70943d6-894e-4b97-baca-f292dab470e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:19:41.588809 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-a70943d6-894e-4b97-baca-f292dab470e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:19:41.590979 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1259/2535] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 30 01:19:41 2022] DELETE /identity/v3/projects/bf74521a42274f249ac04a4bc3d431df => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:19:41.595607 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06575258-520e-4e81-8cef-adada7bf12c7 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:41.596225 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06575258-520e-4e81-8cef-adada7bf12c7 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:41.596699 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06575258-520e-4e81-8cef-adada7bf12c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:41.624212 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-06575258-520e-4e81-8cef-adada7bf12c7 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:19:41.625438 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-06575258-520e-4e81-8cef-adada7bf12c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:19:41.689168 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1277/2536] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:19:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:19:41.697080 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc513a76-cfc3-4be1-8e18-7f661890b9e1 None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:41.697420 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc513a76-cfc3-4be1-8e18-7f661890b9e1 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:41.697668 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc513a76-cfc3-4be1-8e18-7f661890b9e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:41.720603 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-bc513a76-cfc3-4be1-8e18-7f661890b9e1 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:19:41.721823 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-bc513a76-cfc3-4be1-8e18-7f661890b9e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:19:41.730646 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1260/2537] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:19:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:19:41.734837 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06575258-520e-4e81-8cef-adada7bf12c7 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:41.746115 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06575258-520e-4e81-8cef-adada7bf12c7 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:41.751350 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a416f5d9-38d7-4971-971f-56b83d9b154c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:41.751964 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a416f5d9-38d7-4971-971f-56b83d9b154c admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:41.752258 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a416f5d9-38d7-4971-971f-56b83d9b154c admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:41.752584 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a416f5d9-38d7-4971-971f-56b83d9b154c admin admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:41.753322 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a416f5d9-38d7-4971-971f-56b83d9b154c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:19:41.753618 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a416f5d9-38d7-4971-971f-56b83d9b154c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:41.755489 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a416f5d9-38d7-4971-971f-56b83d9b154c admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:41.772984 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1278/2538] 10.222.0.79 () {58 vars in 1153 bytes} [Tue Aug 30 01:19:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:19:41.774000 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc513a76-cfc3-4be1-8e18-7f661890b9e1 None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:41.783778 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc513a76-cfc3-4be1-8e18-7f661890b9e1 None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:41.789213 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013b6236-e89a-4f9a-b385-834429f88e34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:41.790106 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013b6236-e89a-4f9a-b385-834429f88e34 admin admin] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:41.790469 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013b6236-e89a-4f9a-b385-834429f88e34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:41.790801 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013b6236-e89a-4f9a-b385-834429f88e34 admin admin] PATH_INFO: `/v3/projects` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:41.791266 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013b6236-e89a-4f9a-b385-834429f88e34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:41.793306 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013b6236-e89a-4f9a-b385-834429f88e34 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:41.823723 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1261/2539] 10.222.0.79 () {60 vars in 1153 bytes} [Tue Aug 30 01:19:41 2022] POST /identity/v3/projects => generated 385 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:19:41.828019 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a416f5d9-38d7-4971-971f-56b83d9b154c admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:41.839230 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a416f5d9-38d7-4971-971f-56b83d9b154c admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:41.912829 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9829ab-78b8-481d-98ad-2245001ce021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:41.913985 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9829ab-78b8-481d-98ad-2245001ce021 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:41.917111 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9829ab-78b8-481d-98ad-2245001ce021 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:41.917397 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9829ab-78b8-481d-98ad-2245001ce021 admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:41.918118 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9829ab-78b8-481d-98ad-2245001ce021 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:41.920805 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9829ab-78b8-481d-98ad-2245001ce021 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:41.953880 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1279/2540] 10.222.0.79 () {60 vars in 1144 bytes} [Tue Aug 30 01:19:41 2022] POST /identity/v3/users => generated 293 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:19:41.958360 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013b6236-e89a-4f9a-b385-834429f88e34 admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:41.971464 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013b6236-e89a-4f9a-b385-834429f88e34 admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:41.978527 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfa17f5-3d64-4c84-9487-b24307daa422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:41.979261 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfa17f5-3d64-4c84-9487-b24307daa422 admin admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:41.979535 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfa17f5-3d64-4c84-9487-b24307daa422 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:41.979803 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfa17f5-3d64-4c84-9487-b24307daa422 admin admin] PATH_INFO: `/v3/roles` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:41.980538 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfa17f5-3d64-4c84-9487-b24307daa422 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:41.982131 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfa17f5-3d64-4c84-9487-b24307daa422 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:41.995622 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1262/2541] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:19:41 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:19:41.999977 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9829ab-78b8-481d-98ad-2245001ce021 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:42.011853 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9829ab-78b8-481d-98ad-2245001ce021 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:42.016728 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b419ec-f0dd-48d0-b760-0d96b3d058b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:42.017350 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b419ec-f0dd-48d0-b760-0d96b3d058b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:42.017613 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b419ec-f0dd-48d0-b760-0d96b3d058b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:42.017881 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b419ec-f0dd-48d0-b760-0d96b3d058b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:42.018522 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b419ec-f0dd-48d0-b760-0d96b3d058b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:42.020150 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b419ec-f0dd-48d0-b760-0d96b3d058b6 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:42.032669 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1280/2542] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:19:41 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:19:42.037102 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfa17f5-3d64-4c84-9487-b24307daa422 admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:42.048998 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfa17f5-3d64-4c84-9487-b24307daa422 admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:42.055171 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303a9a92-232b-4cbb-84bd-3980bb4be62d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:42.055450 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303a9a92-232b-4cbb-84bd-3980bb4be62d admin admin] REQUEST_METHOD: `PUT` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:42.055732 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303a9a92-232b-4cbb-84bd-3980bb4be62d admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:42.056004 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303a9a92-232b-4cbb-84bd-3980bb4be62d admin admin] PATH_INFO: `/v3/projects/ed5da3e1767846d9b7c59f5b92ae33e8/users/c1c65abf11d54f7fa944e5c68b128116/roles/c37945a17623465f899d4f217e7af593` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:42.073141 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303a9a92-232b-4cbb-84bd-3980bb4be62d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed5da3e1767846d9b7c59f5b92ae33e8, user_id=c1c65abf11d54f7fa944e5c68b128116, role_id=c37945a17623465f899d4f217e7af593)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:42.076020 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303a9a92-232b-4cbb-84bd-3980bb4be62d admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:42.081030 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:19:42.094448 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1263/2543] 10.222.0.79 () {60 vars in 1483 bytes} [Tue Aug 30 01:19:42 2022] PUT /identity/v3/projects/ed5da3e1767846d9b7c59f5b92ae33e8/users/c1c65abf11d54f7fa944e5c68b128116/roles/c37945a17623465f899d4f217e7af593 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:19:42.107340 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7c4875-9bfd-40e2-a250-2d42e2b98a18 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:42.107650 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7c4875-9bfd-40e2-a250-2d42e2b98a18 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:42.107899 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7c4875-9bfd-40e2-a250-2d42e2b98a18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:42.139078 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-cf7c4875-9bfd-40e2-a250-2d42e2b98a18 None None] MFA Rules not processed for user `c1c65abf11d54f7fa944e5c68b128116`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:19:42.140330 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-cf7c4875-9bfd-40e2-a250-2d42e2b98a18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:19:42.168554 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:19:42.233049 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1281/2544] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:19:42 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:19:42.237876 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303a9a92-232b-4cbb-84bd-3980bb4be62d admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:42.307824 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303a9a92-232b-4cbb-84bd-3980bb4be62d admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:42.312688 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0690cef9-2bb5-4dcc-8b65-7da7b0462cec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:42.313303 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0690cef9-2bb5-4dcc-8b65-7da7b0462cec admin admin] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:42.313576 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0690cef9-2bb5-4dcc-8b65-7da7b0462cec admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:42.313844 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0690cef9-2bb5-4dcc-8b65-7da7b0462cec admin admin] PATH_INFO: `/v3/projects` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:42.314488 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0690cef9-2bb5-4dcc-8b65-7da7b0462cec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:42.316425 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0690cef9-2bb5-4dcc-8b65-7da7b0462cec admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:42.348910 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1264/2545] 10.222.0.79 () {60 vars in 1153 bytes} [Tue Aug 30 01:19:42 2022] POST /identity/v3/projects => generated 387 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:19:42.354289 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7c4875-9bfd-40e2-a250-2d42e2b98a18 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:42.369104 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7c4875-9bfd-40e2-a250-2d42e2b98a18 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:42.439857 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0257a08-5efd-46ac-a0c2-3aca1390aea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:42.440520 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0257a08-5efd-46ac-a0c2-3aca1390aea8 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:42.440894 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0257a08-5efd-46ac-a0c2-3aca1390aea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:42.441259 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0257a08-5efd-46ac-a0c2-3aca1390aea8 admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:42.442021 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0257a08-5efd-46ac-a0c2-3aca1390aea8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:42.444197 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0257a08-5efd-46ac-a0c2-3aca1390aea8 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:42.466957 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1282/2546] 10.222.0.79 () {60 vars in 1144 bytes} [Tue Aug 30 01:19:42 2022] POST /identity/v3/users => generated 300 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:19:42.470945 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0690cef9-2bb5-4dcc-8b65-7da7b0462cec admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:42.483094 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0690cef9-2bb5-4dcc-8b65-7da7b0462cec admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:42.487837 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e9ccc9-34aa-4234-85bf-b2051516b662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:42.488439 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e9ccc9-34aa-4234-85bf-b2051516b662 admin admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:42.488718 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e9ccc9-34aa-4234-85bf-b2051516b662 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:42.488989 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e9ccc9-34aa-4234-85bf-b2051516b662 admin admin] PATH_INFO: `/v3/roles` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:42.489853 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e9ccc9-34aa-4234-85bf-b2051516b662 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:42.492108 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e9ccc9-34aa-4234-85bf-b2051516b662 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:42.502969 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1265/2547] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:19:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:19:42.507960 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0257a08-5efd-46ac-a0c2-3aca1390aea8 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:42.518570 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0257a08-5efd-46ac-a0c2-3aca1390aea8 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:42.525173 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f771d8a2-ccbe-48b6-8723-d593ed40dd2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:42.525873 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f771d8a2-ccbe-48b6-8723-d593ed40dd2d admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:42.526163 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f771d8a2-ccbe-48b6-8723-d593ed40dd2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:42.526414 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f771d8a2-ccbe-48b6-8723-d593ed40dd2d admin admin] PATH_INFO: `/v3/projects/3cdd34edc4d7437f8fcc71feda89f019/users/40c80e9bb9704c0c9a534cd53daa0e66/roles/d14c3070c9184d76a7b23df69bd3db07` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:42.544307 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f771d8a2-ccbe-48b6-8723-d593ed40dd2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=3cdd34edc4d7437f8fcc71feda89f019, user_id=40c80e9bb9704c0c9a534cd53daa0e66, role_id=d14c3070c9184d76a7b23df69bd3db07)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:42.546926 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f771d8a2-ccbe-48b6-8723-d593ed40dd2d admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:42.563767 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1283/2548] 10.222.0.79 () {60 vars in 1483 bytes} [Tue Aug 30 01:19:42 2022] PUT /identity/v3/projects/3cdd34edc4d7437f8fcc71feda89f019/users/40c80e9bb9704c0c9a534cd53daa0e66/roles/d14c3070c9184d76a7b23df69bd3db07 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:19:42.568102 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e9ccc9-34aa-4234-85bf-b2051516b662 admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:42.579195 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e9ccc9-34aa-4234-85bf-b2051516b662 admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:42.649662 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34c1b8b-d117-442f-bf3c-bcdbb5c019de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:42.650280 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34c1b8b-d117-442f-bf3c-bcdbb5c019de admin admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:42.650557 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34c1b8b-d117-442f-bf3c-bcdbb5c019de admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:42.650829 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34c1b8b-d117-442f-bf3c-bcdbb5c019de admin admin] PATH_INFO: `/v3/roles` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:42.651513 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34c1b8b-d117-442f-bf3c-bcdbb5c019de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:42.653200 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34c1b8b-d117-442f-bf3c-bcdbb5c019de admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:42.665273 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1266/2549] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:19:42 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:19:42.669849 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f771d8a2-ccbe-48b6-8723-d593ed40dd2d admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:42.681122 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f771d8a2-ccbe-48b6-8723-d593ed40dd2d admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:42.686987 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7853ee-46a3-4db1-ba6c-62779f369b43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:42.687712 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7853ee-46a3-4db1-ba6c-62779f369b43 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:42.687988 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7853ee-46a3-4db1-ba6c-62779f369b43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:42.688258 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7853ee-46a3-4db1-ba6c-62779f369b43 admin admin] PATH_INFO: `/v3/projects/3cdd34edc4d7437f8fcc71feda89f019/users/40c80e9bb9704c0c9a534cd53daa0e66/roles/d14c3070c9184d76a7b23df69bd3db07` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:42.690264 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7853ee-46a3-4db1-ba6c-62779f369b43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3cdd34edc4d7437f8fcc71feda89f019, user_id=40c80e9bb9704c0c9a534cd53daa0e66, role_id=d14c3070c9184d76a7b23df69bd3db07)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:42.693245 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7853ee-46a3-4db1-ba6c-62779f369b43 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:42.706782 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1284/2550] 10.222.0.79 () {60 vars in 1483 bytes} [Tue Aug 30 01:19:42 2022] PUT /identity/v3/projects/3cdd34edc4d7437f8fcc71feda89f019/users/40c80e9bb9704c0c9a534cd53daa0e66/roles/d14c3070c9184d76a7b23df69bd3db07 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:19:42.719591 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28788e0-821e-421a-a6c5-1fd57a693b61 None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:42.719875 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28788e0-821e-421a-a6c5-1fd57a693b61 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:42.720148 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28788e0-821e-421a-a6c5-1fd57a693b61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:42.753751 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-e28788e0-821e-421a-a6c5-1fd57a693b61 None None] MFA Rules not processed for user `40c80e9bb9704c0c9a534cd53daa0e66`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:19:42.755231 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-e28788e0-821e-421a-a6c5-1fd57a693b61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:19:42.813476 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:19:42.836000 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1267/2551] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:19:42 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:19:42.852651 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7853ee-46a3-4db1-ba6c-62779f369b43 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:42.854362 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-9f7853ee-46a3-4db1-ba6c-62779f369b43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:19:42.922310 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7853ee-46a3-4db1-ba6c-62779f369b43 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:42.926298 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6ec680-273e-499e-a6e8-a79004e2d561 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f827c7670b74d938ffe066ced88d1c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:42.926941 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6ec680-273e-499e-a6e8-a79004e2d561 service cinder] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:42.927341 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6ec680-273e-499e-a6e8-a79004e2d561 service cinder] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:42.927790 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6ec680-273e-499e-a6e8-a79004e2d561 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:42.938927 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6ec680-273e-499e-a6e8-a79004e2d561 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:42.940869 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6ec680-273e-499e-a6e8-a79004e2d561 service cinder] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:42.957744 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1285/2552] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:19:42 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:19:42.989303 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28788e0-821e-421a-a6c5-1fd57a693b61 None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:43.084933 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28788e0-821e-421a-a6c5-1fd57a693b61 None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:43.092150 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca0787a-c981-400b-9efe-038f0ba11131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:43.093274 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca0787a-c981-400b-9efe-038f0ba11131 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:43.093742 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca0787a-c981-400b-9efe-038f0ba11131 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:43.094256 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca0787a-c981-400b-9efe-038f0ba11131 admin admin] PATH_INFO: `/v3/users/c1c65abf11d54f7fa944e5c68b128116` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:43.095713 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca0787a-c981-400b-9efe-038f0ba11131 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1c65abf11d54f7fa944e5c68b128116)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:43.097662 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca0787a-c981-400b-9efe-038f0ba11131 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:43.164683 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-eca0787a-c981-400b-9efe-038f0ba11131 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1c65abf11d54f7fa944e5c68b128116'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:19:43.173942 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-eca0787a-c981-400b-9efe-038f0ba11131 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1c65abf11d54f7fa944e5c68b128116'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:19:43.189607 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-eca0787a-c981-400b-9efe-038f0ba11131 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1c65abf11d54f7fa944e5c68b128116'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:19:43.190443 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-eca0787a-c981-400b-9efe-038f0ba11131 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1c65abf11d54f7fa944e5c68b128116'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:19:43.201765 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-eca0787a-c981-400b-9efe-038f0ba11131 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1c65abf11d54f7fa944e5c68b128116'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:19:43.209287 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1268/2553] 10.222.0.79 () {58 vars in 1224 bytes} [Tue Aug 30 01:19:42 2022] DELETE /identity/v3/users/c1c65abf11d54f7fa944e5c68b128116 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:19:43.214709 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319051e9-33d8-420e-ab4a-bbfc4417d1c7 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:43.215557 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319051e9-33d8-420e-ab4a-bbfc4417d1c7 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:43.215557 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319051e9-33d8-420e-ab4a-bbfc4417d1c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:43.236499 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-319051e9-33d8-420e-ab4a-bbfc4417d1c7 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:19:43.237732 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-319051e9-33d8-420e-ab4a-bbfc4417d1c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:19:43.253329 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:19:43.318684 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1286/2554] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:19:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:19:43.328914 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca0787a-c981-400b-9efe-038f0ba11131 admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:43.330685 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-eca0787a-c981-400b-9efe-038f0ba11131 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:19:43.397598 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca0787a-c981-400b-9efe-038f0ba11131 admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:43.402509 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57934356-d852-4f01-b41f-c382a53d5984 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16e6a0ca26fc4ef892c188ad89a1e132', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:43.403175 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57934356-d852-4f01-b41f-c382a53d5984 service neutron] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:43.403462 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57934356-d852-4f01-b41f-c382a53d5984 service neutron] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:43.403728 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57934356-d852-4f01-b41f-c382a53d5984 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:43.414946 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57934356-d852-4f01-b41f-c382a53d5984 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:43.416392 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57934356-d852-4f01-b41f-c382a53d5984 service neutron] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:43.426931 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1269/2555] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:19:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:19:43.789804 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319051e9-33d8-420e-ab4a-bbfc4417d1c7 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:43.791527 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-319051e9-33d8-420e-ab4a-bbfc4417d1c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:19:43.820993 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319051e9-33d8-420e-ab4a-bbfc4417d1c7 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:43.832663 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b43aa7-0dc1-489b-96fc-d8f72b48e7cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:43.833361 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b43aa7-0dc1-489b-96fc-d8f72b48e7cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:43.833673 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b43aa7-0dc1-489b-96fc-d8f72b48e7cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:43.833955 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b43aa7-0dc1-489b-96fc-d8f72b48e7cc admin admin] PATH_INFO: `/v3/projects/ed5da3e1767846d9b7c59f5b92ae33e8` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:43.835811 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b43aa7-0dc1-489b-96fc-d8f72b48e7cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed5da3e1767846d9b7c59f5b92ae33e8)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:43.838177 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b43aa7-0dc1-489b-96fc-d8f72b48e7cc admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:43.916852 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-69b43aa7-0dc1-489b-96fc-d8f72b48e7cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed5da3e1767846d9b7c59f5b92ae33e8', 'request_id': 'req-69b43aa7-0dc1-489b-96fc-d8f72b48e7cc'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:19:43.929966 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-69b43aa7-0dc1-489b-96fc-d8f72b48e7cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed5da3e1767846d9b7c59f5b92ae33e8', 'request_id': 'req-69b43aa7-0dc1-489b-96fc-d8f72b48e7cc'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:19:43.940465 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-69b43aa7-0dc1-489b-96fc-d8f72b48e7cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed5da3e1767846d9b7c59f5b92ae33e8', 'request_id': 'req-69b43aa7-0dc1-489b-96fc-d8f72b48e7cc'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:19:43.955279 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-69b43aa7-0dc1-489b-96fc-d8f72b48e7cc admin admin] The token cache is being invalidate because project ed5da3e1767846d9b7c59f5b92ae33e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:19:43.955504 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-69b43aa7-0dc1-489b-96fc-d8f72b48e7cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:19:43.956164 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-69b43aa7-0dc1-489b-96fc-d8f72b48e7cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:19:43.957708 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1287/2556] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 30 01:19:43 2022] DELETE /identity/v3/projects/ed5da3e1767846d9b7c59f5b92ae33e8 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:19:43.962472 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57934356-d852-4f01-b41f-c382a53d5984 service neutron] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:43.972846 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57934356-d852-4f01-b41f-c382a53d5984 service neutron] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:43.982397 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:19:44.059378 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf27272-1e77-4922-826c-06ba28a0e116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:44.060170 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf27272-1e77-4922-826c-06ba28a0e116 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:44.060492 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf27272-1e77-4922-826c-06ba28a0e116 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:44.060829 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf27272-1e77-4922-826c-06ba28a0e116 admin admin] PATH_INFO: `/v3/users/40c80e9bb9704c0c9a534cd53daa0e66` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:44.062271 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf27272-1e77-4922-826c-06ba28a0e116 admin admin] RBAC: Authorizing `identity:delete_user(user_id=40c80e9bb9704c0c9a534cd53daa0e66)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:44.064991 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf27272-1e77-4922-826c-06ba28a0e116 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:44.129023 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-3bf27272-1e77-4922-826c-06ba28a0e116 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40c80e9bb9704c0c9a534cd53daa0e66'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:19:44.138790 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-3bf27272-1e77-4922-826c-06ba28a0e116 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40c80e9bb9704c0c9a534cd53daa0e66'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:19:44.153278 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-3bf27272-1e77-4922-826c-06ba28a0e116 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40c80e9bb9704c0c9a534cd53daa0e66'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:19:44.154058 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-3bf27272-1e77-4922-826c-06ba28a0e116 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40c80e9bb9704c0c9a534cd53daa0e66'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:19:44.164453 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-3bf27272-1e77-4922-826c-06ba28a0e116 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40c80e9bb9704c0c9a534cd53daa0e66'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:19:44.170938 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1270/2557] 10.222.0.79 () {58 vars in 1224 bytes} [Tue Aug 30 01:19:43 2022] DELETE /identity/v3/users/40c80e9bb9704c0c9a534cd53daa0e66 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:19:44.555760 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b43aa7-0dc1-489b-96fc-d8f72b48e7cc admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:44.557330 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-69b43aa7-0dc1-489b-96fc-d8f72b48e7cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:19:44.582288 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b43aa7-0dc1-489b-96fc-d8f72b48e7cc admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:44.673902 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3815a87-e7c0-4899-b7d2-1da79689ddd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:44.674848 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3815a87-e7c0-4899-b7d2-1da79689ddd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:44.675312 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3815a87-e7c0-4899-b7d2-1da79689ddd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:44.675751 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3815a87-e7c0-4899-b7d2-1da79689ddd6 admin admin] PATH_INFO: `/v3/projects/3cdd34edc4d7437f8fcc71feda89f019` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:44.677156 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3815a87-e7c0-4899-b7d2-1da79689ddd6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3cdd34edc4d7437f8fcc71feda89f019)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:44.680362 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3815a87-e7c0-4899-b7d2-1da79689ddd6 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:44.736715 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:19:44.743974 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-f3815a87-e7c0-4899-b7d2-1da79689ddd6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3cdd34edc4d7437f8fcc71feda89f019', 'request_id': 'req-f3815a87-e7c0-4899-b7d2-1da79689ddd6'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:19:44.756112 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-f3815a87-e7c0-4899-b7d2-1da79689ddd6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3cdd34edc4d7437f8fcc71feda89f019', 'request_id': 'req-f3815a87-e7c0-4899-b7d2-1da79689ddd6'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:19:44.767059 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-f3815a87-e7c0-4899-b7d2-1da79689ddd6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3cdd34edc4d7437f8fcc71feda89f019', 'request_id': 'req-f3815a87-e7c0-4899-b7d2-1da79689ddd6'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:19:44.782266 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-f3815a87-e7c0-4899-b7d2-1da79689ddd6 admin admin] The token cache is being invalidate because project 3cdd34edc4d7437f8fcc71feda89f019 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:19:44.782556 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-f3815a87-e7c0-4899-b7d2-1da79689ddd6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:19:44.783250 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-f3815a87-e7c0-4899-b7d2-1da79689ddd6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:19:44.784815 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1288/2558] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 30 01:19:44 2022] DELETE /identity/v3/projects/3cdd34edc4d7437f8fcc71feda89f019 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:19:44.791185 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c176ec-0138-40e7-95c2-674486c8ed49 None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:44.791486 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c176ec-0138-40e7-95c2-674486c8ed49 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:44.791766 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c176ec-0138-40e7-95c2-674486c8ed49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:44.814059 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-c8c176ec-0138-40e7-95c2-674486c8ed49 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:19:44.815416 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-c8c176ec-0138-40e7-95c2-674486c8ed49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:19:44.882722 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1271/2559] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:19:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:19:44.891459 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1761841-cdaf-4f98-a0de-384aba5a91b4 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:44.891747 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1761841-cdaf-4f98-a0de-384aba5a91b4 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:44.892023 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1761841-cdaf-4f98-a0de-384aba5a91b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:44.914260 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-e1761841-cdaf-4f98-a0de-384aba5a91b4 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:19:44.916300 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-e1761841-cdaf-4f98-a0de-384aba5a91b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:19:44.925001 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1289/2560] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:19:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:19:44.930609 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c176ec-0138-40e7-95c2-674486c8ed49 None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:44.941132 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c176ec-0138-40e7-95c2-674486c8ed49 None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:44.946744 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52db5d1a-c647-4945-a95a-44f88da7865a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:44.947407 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52db5d1a-c647-4945-a95a-44f88da7865a admin admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:44.947687 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52db5d1a-c647-4945-a95a-44f88da7865a admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:44.947959 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52db5d1a-c647-4945-a95a-44f88da7865a admin admin] PATH_INFO: `/v3/domains` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:44.948620 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52db5d1a-c647-4945-a95a-44f88da7865a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:19:44.948923 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52db5d1a-c647-4945-a95a-44f88da7865a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:44.950544 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52db5d1a-c647-4945-a95a-44f88da7865a admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:44.965268 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1272/2561] 10.222.0.79 () {58 vars in 1153 bytes} [Tue Aug 30 01:19:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:19:44.969813 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1761841-cdaf-4f98-a0de-384aba5a91b4 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:44.980526 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1761841-cdaf-4f98-a0de-384aba5a91b4 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:44.985775 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d5a8ab-57f2-4893-be2d-9f901e176f85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:44.986468 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d5a8ab-57f2-4893-be2d-9f901e176f85 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:44.986846 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d5a8ab-57f2-4893-be2d-9f901e176f85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:44.987205 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d5a8ab-57f2-4893-be2d-9f901e176f85 admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:44.987955 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d5a8ab-57f2-4893-be2d-9f901e176f85 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:44.989951 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d5a8ab-57f2-4893-be2d-9f901e176f85 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:45.024291 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1290/2562] 10.222.0.79 () {60 vars in 1153 bytes} [Tue Aug 30 01:19:44 2022] POST /identity/v3/projects => generated 385 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:19:45.030630 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52db5d1a-c647-4945-a95a-44f88da7865a admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:45.042436 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52db5d1a-c647-4945-a95a-44f88da7865a admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:45.057449 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:19:45.129580 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11aa580-b6fe-4e95-9c52-9a98cd141b2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:45.130203 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11aa580-b6fe-4e95-9c52-9a98cd141b2b admin admin] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:45.130472 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11aa580-b6fe-4e95-9c52-9a98cd141b2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:45.130740 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11aa580-b6fe-4e95-9c52-9a98cd141b2b admin admin] PATH_INFO: `/v3/users` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:45.131404 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11aa580-b6fe-4e95-9c52-9a98cd141b2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:45.133542 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11aa580-b6fe-4e95-9c52-9a98cd141b2b admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:45.157629 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1273/2563] 10.222.0.79 () {60 vars in 1144 bytes} [Tue Aug 30 01:19:45 2022] POST /identity/v3/users => generated 293 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:19:45.165320 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d5a8ab-57f2-4893-be2d-9f901e176f85 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:45.181645 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d5a8ab-57f2-4893-be2d-9f901e176f85 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:45.186629 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fc2629-516e-4cee-8a14-2f81cc7dc3ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:45.188707 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fc2629-516e-4cee-8a14-2f81cc7dc3ff admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:45.188707 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fc2629-516e-4cee-8a14-2f81cc7dc3ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:45.188707 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fc2629-516e-4cee-8a14-2f81cc7dc3ff admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:45.188707 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fc2629-516e-4cee-8a14-2f81cc7dc3ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:45.190106 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fc2629-516e-4cee-8a14-2f81cc7dc3ff admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:45.200829 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1291/2564] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:19:45 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 01:19:45.205081 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11aa580-b6fe-4e95-9c52-9a98cd141b2b admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:45.224199 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11aa580-b6fe-4e95-9c52-9a98cd141b2b admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:45.230413 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f097dc-ed30-4433-a61a-2563c6f82596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:45.231047 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f097dc-ed30-4433-a61a-2563c6f82596 admin admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:45.231765 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f097dc-ed30-4433-a61a-2563c6f82596 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:45.232042 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f097dc-ed30-4433-a61a-2563c6f82596 admin admin] PATH_INFO: `/v3/roles` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:45.232703 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f097dc-ed30-4433-a61a-2563c6f82596 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:45.234320 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f097dc-ed30-4433-a61a-2563c6f82596 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:45.248220 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1274/2565] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:19:45 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 01:19:45.252986 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fc2629-516e-4cee-8a14-2f81cc7dc3ff admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:45.264469 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fc2629-516e-4cee-8a14-2f81cc7dc3ff admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:45.269281 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7fe93e-2551-4530-a1d6-a797191ed881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:45.269932 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7fe93e-2551-4530-a1d6-a797191ed881 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:45.270241 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7fe93e-2551-4530-a1d6-a797191ed881 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:45.270644 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7fe93e-2551-4530-a1d6-a797191ed881 admin admin] PATH_INFO: `/v3/projects/6d839ec4a02c4fad886494e11698eafb/users/42a40f369a76433eb8c4d3438ee8b9cf/roles/c37945a17623465f899d4f217e7af593` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:45.287524 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7fe93e-2551-4530-a1d6-a797191ed881 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d839ec4a02c4fad886494e11698eafb, user_id=42a40f369a76433eb8c4d3438ee8b9cf, role_id=c37945a17623465f899d4f217e7af593)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:45.291576 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7fe93e-2551-4530-a1d6-a797191ed881 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:45.305926 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1292/2566] 10.222.0.79 () {60 vars in 1483 bytes} [Tue Aug 30 01:19:45 2022] PUT /identity/v3/projects/6d839ec4a02c4fad886494e11698eafb/users/42a40f369a76433eb8c4d3438ee8b9cf/roles/c37945a17623465f899d4f217e7af593 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:19:45.317836 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dca360f-3b94-4ef2-aa8f-4e943ac08bfb None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:45.318121 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dca360f-3b94-4ef2-aa8f-4e943ac08bfb None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:45.318401 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dca360f-3b94-4ef2-aa8f-4e943ac08bfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:45.349355 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-8dca360f-3b94-4ef2-aa8f-4e943ac08bfb None None] MFA Rules not processed for user `42a40f369a76433eb8c4d3438ee8b9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:19:45.350647 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-8dca360f-3b94-4ef2-aa8f-4e943ac08bfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:19:45.426926 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1275/2567] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:19:45 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:19:45.431515 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7fe93e-2551-4530-a1d6-a797191ed881 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:45.495207 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7fe93e-2551-4530-a1d6-a797191ed881 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:45.499951 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eebe6d5-2c92-400f-b9c9-d0ae4ceccac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:45.500552 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eebe6d5-2c92-400f-b9c9-d0ae4ceccac1 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:45.500829 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eebe6d5-2c92-400f-b9c9-d0ae4ceccac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:45.501099 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eebe6d5-2c92-400f-b9c9-d0ae4ceccac1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:45.501728 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eebe6d5-2c92-400f-b9c9-d0ae4ceccac1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:45.503671 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eebe6d5-2c92-400f-b9c9-d0ae4ceccac1 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:45.532996 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1293/2568] 10.222.0.79 () {60 vars in 1153 bytes} [Tue Aug 30 01:19:45 2022] POST /identity/v3/projects => generated 385 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:19:45.537366 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dca360f-3b94-4ef2-aa8f-4e943ac08bfb None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:45.549320 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dca360f-3b94-4ef2-aa8f-4e943ac08bfb None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:45.614492 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05fe335-afab-4db2-9236-2ba99e9a84f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:45.615108 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05fe335-afab-4db2-9236-2ba99e9a84f1 admin admin] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:45.615582 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05fe335-afab-4db2-9236-2ba99e9a84f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:45.615850 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05fe335-afab-4db2-9236-2ba99e9a84f1 admin admin] PATH_INFO: `/v3/users` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:45.616843 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05fe335-afab-4db2-9236-2ba99e9a84f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:45.619121 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05fe335-afab-4db2-9236-2ba99e9a84f1 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:45.645195 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1276/2569] 10.222.0.79 () {60 vars in 1144 bytes} [Tue Aug 30 01:19:45 2022] POST /identity/v3/users => generated 293 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:19:45.650764 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eebe6d5-2c92-400f-b9c9-d0ae4ceccac1 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:45.663765 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eebe6d5-2c92-400f-b9c9-d0ae4ceccac1 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:45.668714 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cfe1e7-fa9d-4633-aa9e-d5c39fc47c37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:45.669325 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cfe1e7-fa9d-4633-aa9e-d5c39fc47c37 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:45.669606 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cfe1e7-fa9d-4633-aa9e-d5c39fc47c37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:45.669880 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cfe1e7-fa9d-4633-aa9e-d5c39fc47c37 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:45.673109 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cfe1e7-fa9d-4633-aa9e-d5c39fc47c37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:45.673109 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cfe1e7-fa9d-4633-aa9e-d5c39fc47c37 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:45.684150 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1294/2570] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:19:45 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:19:45.688431 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05fe335-afab-4db2-9236-2ba99e9a84f1 admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:45.700197 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05fe335-afab-4db2-9236-2ba99e9a84f1 admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:45.705818 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8375a86-a71e-4a7c-9487-1d008eb52226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:45.706433 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8375a86-a71e-4a7c-9487-1d008eb52226 admin admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:45.706733 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8375a86-a71e-4a7c-9487-1d008eb52226 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:45.706979 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8375a86-a71e-4a7c-9487-1d008eb52226 admin admin] PATH_INFO: `/v3/roles` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:45.707676 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8375a86-a71e-4a7c-9487-1d008eb52226 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:45.709378 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8375a86-a71e-4a7c-9487-1d008eb52226 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:45.724514 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1277/2571] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:19:45 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:19:45.725281 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cfe1e7-fa9d-4633-aa9e-d5c39fc47c37 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:45.728455 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-e1cfe1e7-fa9d-4633-aa9e-d5c39fc47c37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:19:45.729014 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8375a86-a71e-4a7c-9487-1d008eb52226 admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:45.737932 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:19:45.743591 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8375a86-a71e-4a7c-9487-1d008eb52226 admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:45.753482 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66278cb4-4bbd-4996-b3b9-bed88e89b1bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:45.754138 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66278cb4-4bbd-4996-b3b9-bed88e89b1bd admin admin] REQUEST_METHOD: `PUT` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:45.754422 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66278cb4-4bbd-4996-b3b9-bed88e89b1bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:45.754691 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66278cb4-4bbd-4996-b3b9-bed88e89b1bd admin admin] PATH_INFO: `/v3/projects/774c76fbf66a4c0bad44e36f26e9fee9/users/911b4fd406234be0951f0901b3b6eab3/roles/c37945a17623465f899d4f217e7af593` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:45.771818 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66278cb4-4bbd-4996-b3b9-bed88e89b1bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=774c76fbf66a4c0bad44e36f26e9fee9, user_id=911b4fd406234be0951f0901b3b6eab3, role_id=c37945a17623465f899d4f217e7af593)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:45.774543 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66278cb4-4bbd-4996-b3b9-bed88e89b1bd admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:45.786167 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:19:45.789800 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1278/2572] 10.222.0.79 () {60 vars in 1483 bytes} [Tue Aug 30 01:19:45 2022] PUT /identity/v3/projects/774c76fbf66a4c0bad44e36f26e9fee9/users/911b4fd406234be0951f0901b3b6eab3/roles/c37945a17623465f899d4f217e7af593 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:19:45.802102 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9f5ab4-7f85-42bf-a8e7-91111a924dc3 None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:45.802328 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9f5ab4-7f85-42bf-a8e7-91111a924dc3 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:45.802554 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9f5ab4-7f85-42bf-a8e7-91111a924dc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:45.804590 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cfe1e7-fa9d-4633-aa9e-d5c39fc47c37 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:45.833575 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-ad9f5ab4-7f85-42bf-a8e7-91111a924dc3 None None] MFA Rules not processed for user `911b4fd406234be0951f0901b3b6eab3`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:19:45.834814 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-ad9f5ab4-7f85-42bf-a8e7-91111a924dc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:19:45.863394 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5429f16b-72b8-4d00-a8be-b65ede61e1ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16e6a0ca26fc4ef892c188ad89a1e132', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:45.864421 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5429f16b-72b8-4d00-a8be-b65ede61e1ed service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:45.864698 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5429f16b-72b8-4d00-a8be-b65ede61e1ed service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:45.864971 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5429f16b-72b8-4d00-a8be-b65ede61e1ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:45.867595 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-5429f16b-72b8-4d00-a8be-b65ede61e1ed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:19:45.918994 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1279/2573] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:19:45 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:19:45.923660 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9f5ab4-7f85-42bf-a8e7-91111a924dc3 None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:45.947864 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5429f16b-72b8-4d00-a8be-b65ede61e1ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:45.949471 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5429f16b-72b8-4d00-a8be-b65ede61e1ed service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:45.960846 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1295/2574] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:19:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 01:19:45.994793 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9f5ab4-7f85-42bf-a8e7-91111a924dc3 None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:45.999800 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6628d73-dc35-4b9d-961f-78de431431c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:46.000434 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6628d73-dc35-4b9d-961f-78de431431c9 admin admin] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:46.000711 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6628d73-dc35-4b9d-961f-78de431431c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:46.000982 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6628d73-dc35-4b9d-961f-78de431431c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:46.001640 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6628d73-dc35-4b9d-961f-78de431431c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:46.003644 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6628d73-dc35-4b9d-961f-78de431431c9 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:46.038649 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1280/2575] 10.222.0.79 () {60 vars in 1153 bytes} [Tue Aug 30 01:19:45 2022] POST /identity/v3/projects => generated 387 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:19:46.043021 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5429f16b-72b8-4d00-a8be-b65ede61e1ed service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:46.053346 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5429f16b-72b8-4d00-a8be-b65ede61e1ed service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:46.127817 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5427c1a5-1ce7-4421-a130-01fa2ee9939e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:46.128448 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5427c1a5-1ce7-4421-a130-01fa2ee9939e admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:46.128726 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5427c1a5-1ce7-4421-a130-01fa2ee9939e admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:46.128995 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5427c1a5-1ce7-4421-a130-01fa2ee9939e admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:46.129658 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5427c1a5-1ce7-4421-a130-01fa2ee9939e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:46.131698 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5427c1a5-1ce7-4421-a130-01fa2ee9939e admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:46.159772 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1296/2576] 10.222.0.79 () {60 vars in 1144 bytes} [Tue Aug 30 01:19:46 2022] POST /identity/v3/users => generated 300 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:19:46.163598 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6628d73-dc35-4b9d-961f-78de431431c9 admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:46.175293 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6628d73-dc35-4b9d-961f-78de431431c9 admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:46.181628 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273c8d44-6ab2-4822-bb9d-f2e9b74c9823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:46.182252 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273c8d44-6ab2-4822-bb9d-f2e9b74c9823 admin admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:46.182527 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273c8d44-6ab2-4822-bb9d-f2e9b74c9823 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:46.182796 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273c8d44-6ab2-4822-bb9d-f2e9b74c9823 admin admin] PATH_INFO: `/v3/roles` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:46.183526 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273c8d44-6ab2-4822-bb9d-f2e9b74c9823 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:46.185158 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273c8d44-6ab2-4822-bb9d-f2e9b74c9823 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:46.198488 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1281/2577] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:19:46 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:19:46.202799 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5427c1a5-1ce7-4421-a130-01fa2ee9939e admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:46.214235 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5427c1a5-1ce7-4421-a130-01fa2ee9939e admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:46.219287 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d709f2-cdc4-4a6a-a863-f181bb0775e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:46.220000 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d709f2-cdc4-4a6a-a863-f181bb0775e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:46.220270 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d709f2-cdc4-4a6a-a863-f181bb0775e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:46.222214 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d709f2-cdc4-4a6a-a863-f181bb0775e5 admin admin] PATH_INFO: `/v3/projects/c4ef27c124c4495c8bb57a7528b9e753/users/2d928c1033534f8d8fd4c35b48ebe590/roles/d14c3070c9184d76a7b23df69bd3db07` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:46.254005 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d709f2-cdc4-4a6a-a863-f181bb0775e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4ef27c124c4495c8bb57a7528b9e753, user_id=2d928c1033534f8d8fd4c35b48ebe590, role_id=d14c3070c9184d76a7b23df69bd3db07)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:46.257394 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d709f2-cdc4-4a6a-a863-f181bb0775e5 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:46.284545 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1297/2578] 10.222.0.79 () {60 vars in 1483 bytes} [Tue Aug 30 01:19:46 2022] PUT /identity/v3/projects/c4ef27c124c4495c8bb57a7528b9e753/users/2d928c1033534f8d8fd4c35b48ebe590/roles/d14c3070c9184d76a7b23df69bd3db07 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:19:46.286132 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273c8d44-6ab2-4822-bb9d-f2e9b74c9823 admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:46.302297 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273c8d44-6ab2-4822-bb9d-f2e9b74c9823 admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:46.369207 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:19:46.389658 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d709f2-cdc4-4a6a-a863-f181bb0775e5 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:46.390915 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-e6d709f2-cdc4-4a6a-a863-f181bb0775e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:19:46.396314 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7ac483-8cbc-47a2-afbd-cb0e8637232b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:46.397089 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7ac483-8cbc-47a2-afbd-cb0e8637232b admin admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:46.397513 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7ac483-8cbc-47a2-afbd-cb0e8637232b admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:46.398480 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7ac483-8cbc-47a2-afbd-cb0e8637232b admin admin] PATH_INFO: `/v3/roles` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:46.399381 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7ac483-8cbc-47a2-afbd-cb0e8637232b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:46.401455 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7ac483-8cbc-47a2-afbd-cb0e8637232b admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:46.409349 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d709f2-cdc4-4a6a-a863-f181bb0775e5 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:46.414545 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1282/2579] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:19:46 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:19:46.415926 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ba128b-1010-42b1-be98-e1d4e6a5d65f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:46.416903 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ba128b-1010-42b1-be98-e1d4e6a5d65f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:46.417662 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ba128b-1010-42b1-be98-e1d4e6a5d65f admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:46.417662 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ba128b-1010-42b1-be98-e1d4e6a5d65f admin admin] PATH_INFO: `/v3/users/5a59bf9070cf4e919e36e7323f2b61c7` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:46.419047 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7ac483-8cbc-47a2-afbd-cb0e8637232b admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:46.419644 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ba128b-1010-42b1-be98-e1d4e6a5d65f admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a59bf9070cf4e919e36e7323f2b61c7)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:46.422624 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ba128b-1010-42b1-be98-e1d4e6a5d65f admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:46.429693 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:19:46.433089 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7ac483-8cbc-47a2-afbd-cb0e8637232b admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:46.440660 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5601ba-3220-4601-9159-f03c51200c44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:46.441607 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5601ba-3220-4601-9159-f03c51200c44 admin admin] REQUEST_METHOD: `PUT` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:46.441992 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5601ba-3220-4601-9159-f03c51200c44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:46.442642 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5601ba-3220-4601-9159-f03c51200c44 admin admin] PATH_INFO: `/v3/projects/c4ef27c124c4495c8bb57a7528b9e753/users/2d928c1033534f8d8fd4c35b48ebe590/roles/d14c3070c9184d76a7b23df69bd3db07` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:46.447585 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5601ba-3220-4601-9159-f03c51200c44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4ef27c124c4495c8bb57a7528b9e753, user_id=2d928c1033534f8d8fd4c35b48ebe590, role_id=d14c3070c9184d76a7b23df69bd3db07)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:46.448258 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5601ba-3220-4601-9159-f03c51200c44 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:46.460736 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1283/2580] 10.222.0.79 () {60 vars in 1483 bytes} [Tue Aug 30 01:19:46 2022] PUT /identity/v3/projects/c4ef27c124c4495c8bb57a7528b9e753/users/2d928c1033534f8d8fd4c35b48ebe590/roles/d14c3070c9184d76a7b23df69bd3db07 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:19:46.472351 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb2a2f0-9b53-4376-aead-4fa71d960ffa None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:46.472697 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb2a2f0-9b53-4376-aead-4fa71d960ffa None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:46.472988 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb2a2f0-9b53-4376-aead-4fa71d960ffa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:46.504098 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-26ba128b-1010-42b1-be98-e1d4e6a5d65f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a59bf9070cf4e919e36e7323f2b61c7'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:19:46.516653 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-26ba128b-1010-42b1-be98-e1d4e6a5d65f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a59bf9070cf4e919e36e7323f2b61c7'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:19:46.517256 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-acb2a2f0-9b53-4376-aead-4fa71d960ffa None None] MFA Rules not processed for user `2d928c1033534f8d8fd4c35b48ebe590`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:19:46.519339 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-acb2a2f0-9b53-4376-aead-4fa71d960ffa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:19:46.528912 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-26ba128b-1010-42b1-be98-e1d4e6a5d65f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a59bf9070cf4e919e36e7323f2b61c7'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:19:46.530087 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-26ba128b-1010-42b1-be98-e1d4e6a5d65f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a59bf9070cf4e919e36e7323f2b61c7'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:19:46.547015 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-26ba128b-1010-42b1-be98-e1d4e6a5d65f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a59bf9070cf4e919e36e7323f2b61c7'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:19:46.556065 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1298/2581] 10.222.0.79 () {58 vars in 1224 bytes} [Tue Aug 30 01:19:46 2022] DELETE /identity/v3/users/5a59bf9070cf4e919e36e7323f2b61c7 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:19:46.562144 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab307e76-0f41-49d0-8257-4935de944f1f None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:46.562429 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab307e76-0f41-49d0-8257-4935de944f1f None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:46.562703 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab307e76-0f41-49d0-8257-4935de944f1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:46.584676 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-ab307e76-0f41-49d0-8257-4935de944f1f None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:19:46.587155 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-ab307e76-0f41-49d0-8257-4935de944f1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:19:46.614308 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1284/2582] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:19:46 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:19:46.626577 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb2a2f0-9b53-4376-aead-4fa71d960ffa None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:46.627593 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-acb2a2f0-9b53-4376-aead-4fa71d960ffa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:19:46.667159 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1299/2583] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:19:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:19:46.675587 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab307e76-0f41-49d0-8257-4935de944f1f None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:46.677107 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-ab307e76-0f41-49d0-8257-4935de944f1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:19:46.698245 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb2a2f0-9b53-4376-aead-4fa71d960ffa None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:46.755276 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab307e76-0f41-49d0-8257-4935de944f1f None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:46.767627 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8a9d7f-1c37-4b2f-88f4-408aa2be2ad5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16e6a0ca26fc4ef892c188ad89a1e132', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:46.767627 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8a9d7f-1c37-4b2f-88f4-408aa2be2ad5 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:46.767627 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8a9d7f-1c37-4b2f-88f4-408aa2be2ad5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:46.767627 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8a9d7f-1c37-4b2f-88f4-408aa2be2ad5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:46.785131 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8a9d7f-1c37-4b2f-88f4-408aa2be2ad5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:46.786579 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8a9d7f-1c37-4b2f-88f4-408aa2be2ad5 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:46.788036 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1db19f-5514-4f21-ac85-3b6d3e54b052 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f827c7670b74d938ffe066ced88d1c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:46.789647 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1db19f-5514-4f21-ac85-3b6d3e54b052 service cinder] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:46.790914 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1db19f-5514-4f21-ac85-3b6d3e54b052 service cinder] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:46.790914 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1db19f-5514-4f21-ac85-3b6d3e54b052 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:46.798234 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1300/2584] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:19:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:19:46.833603 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:19:46.910741 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1db19f-5514-4f21-ac85-3b6d3e54b052 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:46.912492 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1db19f-5514-4f21-ac85-3b6d3e54b052 service cinder] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:46.931487 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1285/2585] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:19:46 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 01:19:47.267617 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8a9d7f-1c37-4b2f-88f4-408aa2be2ad5 service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:47.270139 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-ec8a9d7f-1c37-4b2f-88f4-408aa2be2ad5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:19:47.302900 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8a9d7f-1c37-4b2f-88f4-408aa2be2ad5 service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:47.313083 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc45619-faca-4770-a450-2c9db37ef09a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:47.314384 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc45619-faca-4770-a450-2c9db37ef09a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:47.315215 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc45619-faca-4770-a450-2c9db37ef09a admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:47.316443 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc45619-faca-4770-a450-2c9db37ef09a admin admin] PATH_INFO: `/v3/projects/b27caea527cc4c6caa1ab37621688d53` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:47.319350 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc45619-faca-4770-a450-2c9db37ef09a admin admin] RBAC: Authorizing `identity:delete_project(project_id=b27caea527cc4c6caa1ab37621688d53)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:47.323479 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc45619-faca-4770-a450-2c9db37ef09a admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:47.369975 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:19:47.424115 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-2fc45619-faca-4770-a450-2c9db37ef09a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b27caea527cc4c6caa1ab37621688d53', 'request_id': 'req-2fc45619-faca-4770-a450-2c9db37ef09a'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:19:47.436839 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-2fc45619-faca-4770-a450-2c9db37ef09a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b27caea527cc4c6caa1ab37621688d53', 'request_id': 'req-2fc45619-faca-4770-a450-2c9db37ef09a'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:19:47.448771 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-2fc45619-faca-4770-a450-2c9db37ef09a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b27caea527cc4c6caa1ab37621688d53', 'request_id': 'req-2fc45619-faca-4770-a450-2c9db37ef09a'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:19:47.471423 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-2fc45619-faca-4770-a450-2c9db37ef09a admin admin] The token cache is being invalidate because project b27caea527cc4c6caa1ab37621688d53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:19:47.471906 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-2fc45619-faca-4770-a450-2c9db37ef09a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:19:47.473004 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-2fc45619-faca-4770-a450-2c9db37ef09a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:19:47.476079 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1301/2586] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 30 01:19:47 2022] DELETE /identity/v3/projects/b27caea527cc4c6caa1ab37621688d53 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:19:47.486393 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0bd910-2587-4b8c-8dd5-9d2816023dea None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:47.487222 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0bd910-2587-4b8c-8dd5-9d2816023dea None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:47.487690 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0bd910-2587-4b8c-8dd5-9d2816023dea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:47.540150 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-da0bd910-2587-4b8c-8dd5-9d2816023dea None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:19:47.542512 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-da0bd910-2587-4b8c-8dd5-9d2816023dea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:19:47.687991 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1286/2587] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:19:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:19:47.698536 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a9b1f0-580f-4ce8-a148-9c80eb8d31a2 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:47.700505 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a9b1f0-580f-4ce8-a148-9c80eb8d31a2 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:47.701268 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a9b1f0-580f-4ce8-a148-9c80eb8d31a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:47.767109 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-07a9b1f0-580f-4ce8-a148-9c80eb8d31a2 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:19:47.768383 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-07a9b1f0-580f-4ce8-a148-9c80eb8d31a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:19:47.778284 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1302/2588] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:19:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:19:47.784529 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0bd910-2587-4b8c-8dd5-9d2816023dea None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:47.812819 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0bd910-2587-4b8c-8dd5-9d2816023dea None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:47.825387 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad03471-8e43-450d-a387-094f628dbfb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:47.826866 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad03471-8e43-450d-a387-094f628dbfb0 admin admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:47.827388 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad03471-8e43-450d-a387-094f628dbfb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:47.828021 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad03471-8e43-450d-a387-094f628dbfb0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:47.829235 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad03471-8e43-450d-a387-094f628dbfb0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:19:47.829743 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad03471-8e43-450d-a387-094f628dbfb0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:47.832510 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad03471-8e43-450d-a387-094f628dbfb0 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:47.854331 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1287/2589] 10.222.0.79 () {58 vars in 1153 bytes} [Tue Aug 30 01:19:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:19:47.860278 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a9b1f0-580f-4ce8-a148-9c80eb8d31a2 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:47.871213 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a9b1f0-580f-4ce8-a148-9c80eb8d31a2 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:47.873391 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad03471-8e43-450d-a387-094f628dbfb0 admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:47.875987 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-3ad03471-8e43-450d-a387-094f628dbfb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:19:47.876982 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9256415-4220-475d-aba4-eeb7e1917a1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:47.877772 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9256415-4220-475d-aba4-eeb7e1917a1c admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:47.878026 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9256415-4220-475d-aba4-eeb7e1917a1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:47.878364 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9256415-4220-475d-aba4-eeb7e1917a1c admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:47.879276 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9256415-4220-475d-aba4-eeb7e1917a1c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:47.881342 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9256415-4220-475d-aba4-eeb7e1917a1c admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:47.919506 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1303/2590] 10.222.0.79 () {60 vars in 1153 bytes} [Tue Aug 30 01:19:47 2022] POST /identity/v3/projects => generated 385 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:19:47.924225 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9256415-4220-475d-aba4-eeb7e1917a1c admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:47.973009 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad03471-8e43-450d-a387-094f628dbfb0 admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:48.026368 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9256415-4220-475d-aba4-eeb7e1917a1c admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:48.036625 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9bf06a-7e4a-4212-bf98-81bc2fcd69e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:48.037572 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9bf06a-7e4a-4212-bf98-81bc2fcd69e8 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:48.038468 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9bf06a-7e4a-4212-bf98-81bc2fcd69e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:48.038643 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9bf06a-7e4a-4212-bf98-81bc2fcd69e8 admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:48.039704 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9bf06a-7e4a-4212-bf98-81bc2fcd69e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:48.043111 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e1c608-c4f4-4ca6-93eb-fe4585be76f5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f827c7670b74d938ffe066ced88d1c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:48.043427 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9bf06a-7e4a-4212-bf98-81bc2fcd69e8 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:48.044869 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e1c608-c4f4-4ca6-93eb-fe4585be76f5 service cinder] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:48.044869 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e1c608-c4f4-4ca6-93eb-fe4585be76f5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:48.045082 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e1c608-c4f4-4ca6-93eb-fe4585be76f5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:48.047811 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-09e1c608-c4f4-4ca6-93eb-fe4585be76f5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:19:48.078329 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1304/2591] 10.222.0.79 () {60 vars in 1144 bytes} [Tue Aug 30 01:19:47 2022] POST /identity/v3/users => generated 293 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:19:48.084229 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:19:48.084763 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9bf06a-7e4a-4212-bf98-81bc2fcd69e8 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:48.097851 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9bf06a-7e4a-4212-bf98-81bc2fcd69e8 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:48.104106 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f34a5b-44d2-4d62-b60e-bed13200c787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:48.104738 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f34a5b-44d2-4d62-b60e-bed13200c787 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:48.105000 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f34a5b-44d2-4d62-b60e-bed13200c787 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:48.105278 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f34a5b-44d2-4d62-b60e-bed13200c787 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:48.105924 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f34a5b-44d2-4d62-b60e-bed13200c787 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:48.107606 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f34a5b-44d2-4d62-b60e-bed13200c787 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:48.124455 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1305/2592] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:19:48 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:19:48.125339 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f34a5b-44d2-4d62-b60e-bed13200c787 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:48.137595 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f34a5b-44d2-4d62-b60e-bed13200c787 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:48.142662 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cb3ce9-b608-4140-a3a8-3c35c0e45a37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:48.143317 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cb3ce9-b608-4140-a3a8-3c35c0e45a37 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:48.143599 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cb3ce9-b608-4140-a3a8-3c35c0e45a37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:48.143899 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cb3ce9-b608-4140-a3a8-3c35c0e45a37 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:48.144555 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cb3ce9-b608-4140-a3a8-3c35c0e45a37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:48.146237 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cb3ce9-b608-4140-a3a8-3c35c0e45a37 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:48.162161 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1306/2593] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:19:48 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:19:48.163923 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cb3ce9-b608-4140-a3a8-3c35c0e45a37 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:48.164062 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e1c608-c4f4-4ca6-93eb-fe4585be76f5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:48.165531 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e1c608-c4f4-4ca6-93eb-fe4585be76f5 service cinder] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:48.175928 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cb3ce9-b608-4140-a3a8-3c35c0e45a37 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:48.177951 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1288/2594] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:19:47 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 01:19:48.181251 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4779ac2-06b5-494d-8161-96a766ff71c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:48.182361 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4779ac2-06b5-494d-8161-96a766ff71c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:48.182658 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4779ac2-06b5-494d-8161-96a766ff71c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:48.182931 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4779ac2-06b5-494d-8161-96a766ff71c6 admin admin] PATH_INFO: `/v3/projects/588d1bee35d54c9aa0cf13021a0bd1e7/users/0776817776354206bd095855c4601eaa/roles/c37945a17623465f899d4f217e7af593` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:48.204892 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4779ac2-06b5-494d-8161-96a766ff71c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=588d1bee35d54c9aa0cf13021a0bd1e7, user_id=0776817776354206bd095855c4601eaa, role_id=c37945a17623465f899d4f217e7af593)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:48.207764 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4779ac2-06b5-494d-8161-96a766ff71c6 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:48.237324 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1307/2595] 10.222.0.79 () {60 vars in 1483 bytes} [Tue Aug 30 01:19:48 2022] PUT /identity/v3/projects/588d1bee35d54c9aa0cf13021a0bd1e7/users/0776817776354206bd095855c4601eaa/roles/c37945a17623465f899d4f217e7af593 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:19:48.262519 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bd8012-c794-438f-9792-09bc504d76fc None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:48.263455 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bd8012-c794-438f-9792-09bc504d76fc None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:48.264504 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bd8012-c794-438f-9792-09bc504d76fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:48.317221 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-e3bd8012-c794-438f-9792-09bc504d76fc None None] MFA Rules not processed for user `0776817776354206bd095855c4601eaa`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:19:48.324562 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-e3bd8012-c794-438f-9792-09bc504d76fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:19:48.433037 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1289/2596] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:19:48 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:19:48.435462 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4779ac2-06b5-494d-8161-96a766ff71c6 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:48.499391 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:DELETE=7,keystone:SELECT=87,keystone:INSERT=6 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:19:48.568744 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4779ac2-06b5-494d-8161-96a766ff71c6 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:48.575156 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19611214-67fd-4c85-9668-cbc50e039a28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:48.576244 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19611214-67fd-4c85-9668-cbc50e039a28 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:48.576699 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19611214-67fd-4c85-9668-cbc50e039a28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:48.577184 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19611214-67fd-4c85-9668-cbc50e039a28 admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:48.578333 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19611214-67fd-4c85-9668-cbc50e039a28 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:48.580759 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19611214-67fd-4c85-9668-cbc50e039a28 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:48.621430 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1308/2597] 10.222.0.79 () {60 vars in 1153 bytes} [Tue Aug 30 01:19:48 2022] POST /identity/v3/projects => generated 385 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:19:48.627216 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bd8012-c794-438f-9792-09bc504d76fc None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:48.643664 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bd8012-c794-438f-9792-09bc504d76fc None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:48.813119 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90164bfb-899b-4aa5-8572-2520244a9eca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:48.813967 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90164bfb-899b-4aa5-8572-2520244a9eca admin admin] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:48.814377 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90164bfb-899b-4aa5-8572-2520244a9eca admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:48.814786 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90164bfb-899b-4aa5-8572-2520244a9eca admin admin] PATH_INFO: `/v3/users` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:48.816147 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90164bfb-899b-4aa5-8572-2520244a9eca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:48.821913 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90164bfb-899b-4aa5-8572-2520244a9eca admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:48.867188 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1290/2598] 10.222.0.79 () {60 vars in 1144 bytes} [Tue Aug 30 01:19:48 2022] POST /identity/v3/users => generated 293 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:19:48.871244 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19611214-67fd-4c85-9668-cbc50e039a28 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:48.881899 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19611214-67fd-4c85-9668-cbc50e039a28 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:48.887014 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fea9491-1d0b-478a-a0db-3187a7f8adff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:48.887996 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fea9491-1d0b-478a-a0db-3187a7f8adff admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:48.888318 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fea9491-1d0b-478a-a0db-3187a7f8adff admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:48.888606 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fea9491-1d0b-478a-a0db-3187a7f8adff admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:48.889429 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fea9491-1d0b-478a-a0db-3187a7f8adff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:48.891378 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fea9491-1d0b-478a-a0db-3187a7f8adff admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:48.910051 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1309/2599] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:19:48 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:19:48.911823 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90164bfb-899b-4aa5-8572-2520244a9eca admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:48.930861 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90164bfb-899b-4aa5-8572-2520244a9eca admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:48.937457 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb00f02-6e22-4828-b76c-d11549a2ce64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:48.938419 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb00f02-6e22-4828-b76c-d11549a2ce64 admin admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:48.938901 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb00f02-6e22-4828-b76c-d11549a2ce64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:48.939891 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb00f02-6e22-4828-b76c-d11549a2ce64 admin admin] PATH_INFO: `/v3/roles` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:48.940437 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb00f02-6e22-4828-b76c-d11549a2ce64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:48.942584 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb00f02-6e22-4828-b76c-d11549a2ce64 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:48.960854 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1291/2600] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:19:48 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:19:48.963499 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fea9491-1d0b-478a-a0db-3187a7f8adff admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:48.985957 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fea9491-1d0b-478a-a0db-3187a7f8adff admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:48.992552 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da9f59e-6036-409b-a202-9bb96bbfc95f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:48.993478 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da9f59e-6036-409b-a202-9bb96bbfc95f admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:48.993859 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da9f59e-6036-409b-a202-9bb96bbfc95f admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:48.994817 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da9f59e-6036-409b-a202-9bb96bbfc95f admin admin] PATH_INFO: `/v3/projects/b5e52f1739c04a61b2ef1b3b7a6cece6/users/7ed3efb44643416fa5c8450f93dc88ce/roles/c37945a17623465f899d4f217e7af593` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:49.019641 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da9f59e-6036-409b-a202-9bb96bbfc95f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5e52f1739c04a61b2ef1b3b7a6cece6, user_id=7ed3efb44643416fa5c8450f93dc88ce, role_id=c37945a17623465f899d4f217e7af593)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:49.025106 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da9f59e-6036-409b-a202-9bb96bbfc95f admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:49.063168 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1310/2601] 10.222.0.79 () {60 vars in 1483 bytes} [Tue Aug 30 01:19:48 2022] PUT /identity/v3/projects/b5e52f1739c04a61b2ef1b3b7a6cece6/users/7ed3efb44643416fa5c8450f93dc88ce/roles/c37945a17623465f899d4f217e7af593 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:19:49.070417 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dc4e59-6304-4fb6-a6bb-63d787016181 None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:49.071081 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dc4e59-6304-4fb6-a6bb-63d787016181 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:49.071465 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dc4e59-6304-4fb6-a6bb-63d787016181 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:49.113247 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-f1dc4e59-6304-4fb6-a6bb-63d787016181 None None] MFA Rules not processed for user `7ed3efb44643416fa5c8450f93dc88ce`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:19:49.113247 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-f1dc4e59-6304-4fb6-a6bb-63d787016181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:19:49.139028 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:19:49.220987 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1292/2602] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:19:49 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:19:49.226795 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da9f59e-6036-409b-a202-9bb96bbfc95f admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:49.319940 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da9f59e-6036-409b-a202-9bb96bbfc95f admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:49.325337 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a714bb05-db36-46d7-b173-e06a23654016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:49.325965 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a714bb05-db36-46d7-b173-e06a23654016 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:49.326244 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a714bb05-db36-46d7-b173-e06a23654016 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:49.326521 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a714bb05-db36-46d7-b173-e06a23654016 admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:49.327200 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a714bb05-db36-46d7-b173-e06a23654016 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:49.329118 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a714bb05-db36-46d7-b173-e06a23654016 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:49.359415 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1311/2603] 10.222.0.79 () {60 vars in 1153 bytes} [Tue Aug 30 01:19:49 2022] POST /identity/v3/projects => generated 383 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:19:49.364124 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dc4e59-6304-4fb6-a6bb-63d787016181 None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:49.375790 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dc4e59-6304-4fb6-a6bb-63d787016181 None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:49.462987 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfc22ed-3f0c-4ee6-9663-5e83d942957b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:49.463983 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfc22ed-3f0c-4ee6-9663-5e83d942957b admin admin] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:49.464321 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfc22ed-3f0c-4ee6-9663-5e83d942957b admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:49.464603 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfc22ed-3f0c-4ee6-9663-5e83d942957b admin admin] PATH_INFO: `/v3/users` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:49.465263 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfc22ed-3f0c-4ee6-9663-5e83d942957b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:49.467253 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfc22ed-3f0c-4ee6-9663-5e83d942957b admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:49.496823 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1293/2604] 10.222.0.79 () {60 vars in 1144 bytes} [Tue Aug 30 01:19:49 2022] POST /identity/v3/users => generated 298 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:19:49.498090 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a714bb05-db36-46d7-b173-e06a23654016 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:49.511660 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a714bb05-db36-46d7-b173-e06a23654016 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:49.518199 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a175e4f3-3f67-42eb-9eb2-9333ad6990b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:49.518829 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a175e4f3-3f67-42eb-9eb2-9333ad6990b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:49.519289 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a175e4f3-3f67-42eb-9eb2-9333ad6990b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:49.519427 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a175e4f3-3f67-42eb-9eb2-9333ad6990b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:49.520049 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a175e4f3-3f67-42eb-9eb2-9333ad6990b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:49.521687 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a175e4f3-3f67-42eb-9eb2-9333ad6990b0 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:49.542204 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1312/2605] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:19:49 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:19:49.546740 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfc22ed-3f0c-4ee6-9663-5e83d942957b admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:49.558742 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfc22ed-3f0c-4ee6-9663-5e83d942957b admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:49.563421 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dc2176-9478-4894-89d3-97959ce9dc61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:49.563847 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dc2176-9478-4894-89d3-97959ce9dc61 admin admin] REQUEST_METHOD: `PUT` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:49.564130 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dc2176-9478-4894-89d3-97959ce9dc61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:49.564400 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dc2176-9478-4894-89d3-97959ce9dc61 admin admin] PATH_INFO: `/v3/projects/c1afee8b2b49408eaa5051034df0cd3e/users/f75ca63ee4874b1db0a371911a71107e/roles/d14c3070c9184d76a7b23df69bd3db07` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:49.582738 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90dc2176-9478-4894-89d3-97959ce9dc61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1afee8b2b49408eaa5051034df0cd3e, user_id=f75ca63ee4874b1db0a371911a71107e, role_id=d14c3070c9184d76a7b23df69bd3db07)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:49.586004 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90dc2176-9478-4894-89d3-97959ce9dc61 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:49.602743 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1294/2606] 10.222.0.79 () {60 vars in 1483 bytes} [Tue Aug 30 01:19:49 2022] PUT /identity/v3/projects/c1afee8b2b49408eaa5051034df0cd3e/users/f75ca63ee4874b1db0a371911a71107e/roles/d14c3070c9184d76a7b23df69bd3db07 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:19:49.607170 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a175e4f3-3f67-42eb-9eb2-9333ad6990b0 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:49.622178 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a175e4f3-3f67-42eb-9eb2-9333ad6990b0 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:49.677959 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:19:49.699372 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac674e9-4d49-4c11-8b72-f67329e1d03f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:49.701147 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac674e9-4d49-4c11-8b72-f67329e1d03f admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:49.701147 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac674e9-4d49-4c11-8b72-f67329e1d03f admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:49.701147 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac674e9-4d49-4c11-8b72-f67329e1d03f admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:49.701762 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac674e9-4d49-4c11-8b72-f67329e1d03f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:49.704276 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac674e9-4d49-4c11-8b72-f67329e1d03f admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:49.720406 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1313/2607] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:19:49 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 01:19:49.726040 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dc2176-9478-4894-89d3-97959ce9dc61 admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:49.743464 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dc2176-9478-4894-89d3-97959ce9dc61 admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:49.748784 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a579c44-f1ad-4463-8fb4-750610649052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:49.749570 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a579c44-f1ad-4463-8fb4-750610649052 admin admin] REQUEST_METHOD: `PUT` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:49.749900 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a579c44-f1ad-4463-8fb4-750610649052 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:49.750250 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a579c44-f1ad-4463-8fb4-750610649052 admin admin] PATH_INFO: `/v3/projects/c1afee8b2b49408eaa5051034df0cd3e/users/f75ca63ee4874b1db0a371911a71107e/roles/d14c3070c9184d76a7b23df69bd3db07` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:49.752480 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a579c44-f1ad-4463-8fb4-750610649052 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1afee8b2b49408eaa5051034df0cd3e, user_id=f75ca63ee4874b1db0a371911a71107e, role_id=d14c3070c9184d76a7b23df69bd3db07)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:49.755369 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a579c44-f1ad-4463-8fb4-750610649052 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:49.775175 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1295/2608] 10.222.0.79 () {60 vars in 1483 bytes} [Tue Aug 30 01:19:49 2022] PUT /identity/v3/projects/c1afee8b2b49408eaa5051034df0cd3e/users/f75ca63ee4874b1db0a371911a71107e/roles/d14c3070c9184d76a7b23df69bd3db07 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:19:49.792240 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c46679-eb55-4bd7-9086-ea7848c9f2b1 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:49.792916 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c46679-eb55-4bd7-9086-ea7848c9f2b1 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:49.793413 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c46679-eb55-4bd7-9086-ea7848c9f2b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:49.874278 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-20c46679-eb55-4bd7-9086-ea7848c9f2b1 None None] MFA Rules not processed for user `f75ca63ee4874b1db0a371911a71107e`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:19:49.876533 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-20c46679-eb55-4bd7-9086-ea7848c9f2b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:19:50.071362 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1314/2609] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:19:49 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:19:50.092151 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a579c44-f1ad-4463-8fb4-750610649052 admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:50.094881 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-4a579c44-f1ad-4463-8fb4-750610649052 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:19:50.240883 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a579c44-f1ad-4463-8fb4-750610649052 admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:50.250915 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e04f43-c20a-4393-9be1-420b40bd35d7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f827c7670b74d938ffe066ced88d1c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:50.253232 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e04f43-c20a-4393-9be1-420b40bd35d7 service cinder] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:50.253717 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e04f43-c20a-4393-9be1-420b40bd35d7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:50.254391 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e04f43-c20a-4393-9be1-420b40bd35d7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:50.308584 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:19:50.411600 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e04f43-c20a-4393-9be1-420b40bd35d7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:50.413468 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e04f43-c20a-4393-9be1-420b40bd35d7 service cinder] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:50.439440 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1296/2610] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:19:50 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:19:50.708702 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c46679-eb55-4bd7-9086-ea7848c9f2b1 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:50.709654 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-20c46679-eb55-4bd7-9086-ea7848c9f2b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:19:50.795858 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c46679-eb55-4bd7-9086-ea7848c9f2b1 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:50.801134 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107f2a03-6966-4ddc-ab20-f2a2a4bf5573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:50.801789 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107f2a03-6966-4ddc-ab20-f2a2a4bf5573 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:50.802099 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107f2a03-6966-4ddc-ab20-f2a2a4bf5573 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:50.802483 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107f2a03-6966-4ddc-ab20-f2a2a4bf5573 admin admin] PATH_INFO: `/v3/users/d8445faa3bd6407986d739614cdd3a67` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:50.805206 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107f2a03-6966-4ddc-ab20-f2a2a4bf5573 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8445faa3bd6407986d739614cdd3a67)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:50.808458 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107f2a03-6966-4ddc-ab20-f2a2a4bf5573 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:50.893959 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-107f2a03-6966-4ddc-ab20-f2a2a4bf5573 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8445faa3bd6407986d739614cdd3a67'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:19:50.908909 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-107f2a03-6966-4ddc-ab20-f2a2a4bf5573 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8445faa3bd6407986d739614cdd3a67'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:19:50.923315 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-107f2a03-6966-4ddc-ab20-f2a2a4bf5573 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8445faa3bd6407986d739614cdd3a67'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:19:50.923994 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-107f2a03-6966-4ddc-ab20-f2a2a4bf5573 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8445faa3bd6407986d739614cdd3a67'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:19:50.935339 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:19:50.943893 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-107f2a03-6966-4ddc-ab20-f2a2a4bf5573 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8445faa3bd6407986d739614cdd3a67'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:19:50.952839 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1315/2611] 10.222.0.79 () {58 vars in 1224 bytes} [Tue Aug 30 01:19:50 2022] DELETE /identity/v3/users/d8445faa3bd6407986d739614cdd3a67 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:19:51.166259 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e04f43-c20a-4393-9be1-420b40bd35d7 service cinder] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:51.184957 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e04f43-c20a-4393-9be1-420b40bd35d7 service cinder] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:51.317840 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26b0de5-577c-4d8c-84f1-457db94b1ad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:51.319970 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26b0de5-577c-4d8c-84f1-457db94b1ad6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:51.320542 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26b0de5-577c-4d8c-84f1-457db94b1ad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:51.321099 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26b0de5-577c-4d8c-84f1-457db94b1ad6 admin admin] PATH_INFO: `/v3/projects/13c5624b0b004794b345c8d69152139f` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:51.323111 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26b0de5-577c-4d8c-84f1-457db94b1ad6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=13c5624b0b004794b345c8d69152139f)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:51.328659 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26b0de5-577c-4d8c-84f1-457db94b1ad6 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:51.429082 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-b26b0de5-577c-4d8c-84f1-457db94b1ad6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13c5624b0b004794b345c8d69152139f', 'request_id': 'req-b26b0de5-577c-4d8c-84f1-457db94b1ad6'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:19:51.448731 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-b26b0de5-577c-4d8c-84f1-457db94b1ad6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13c5624b0b004794b345c8d69152139f', 'request_id': 'req-b26b0de5-577c-4d8c-84f1-457db94b1ad6'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:19:51.463992 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-b26b0de5-577c-4d8c-84f1-457db94b1ad6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13c5624b0b004794b345c8d69152139f', 'request_id': 'req-b26b0de5-577c-4d8c-84f1-457db94b1ad6'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:19:51.492306 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-b26b0de5-577c-4d8c-84f1-457db94b1ad6 admin admin] The token cache is being invalidate because project 13c5624b0b004794b345c8d69152139f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81998) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:19:51.496134 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-b26b0de5-577c-4d8c-84f1-457db94b1ad6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:19:51.498147 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-b26b0de5-577c-4d8c-84f1-457db94b1ad6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:19:51.505517 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1297/2612] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 30 01:19:51 2022] DELETE /identity/v3/projects/13c5624b0b004794b345c8d69152139f => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:19:51.507738 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2332c9-9733-4643-b748-7954c6962d91 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:51.508102 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2332c9-9733-4643-b748-7954c6962d91 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:51.508374 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2332c9-9733-4643-b748-7954c6962d91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:51.535954 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-2b2332c9-9733-4643-b748-7954c6962d91 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:19:51.538733 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-2b2332c9-9733-4643-b748-7954c6962d91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:19:51.648020 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1316/2613] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:19:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:19:51.650937 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ce3138-c699-4133-880a-9ca06d87de95 None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:51.651244 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ce3138-c699-4133-880a-9ca06d87de95 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:51.651520 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ce3138-c699-4133-880a-9ca06d87de95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:51.683486 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-37ce3138-c699-4133-880a-9ca06d87de95 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:19:51.684745 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-37ce3138-c699-4133-880a-9ca06d87de95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:19:51.699945 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1298/2614] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:19:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:19:51.702375 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2332c9-9733-4643-b748-7954c6962d91 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:51.716989 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2332c9-9733-4643-b748-7954c6962d91 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:51.730491 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436ceed9-575b-4fc0-a2e3-6833cfb64404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:51.731474 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436ceed9-575b-4fc0-a2e3-6833cfb64404 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:51.732151 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436ceed9-575b-4fc0-a2e3-6833cfb64404 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:51.732613 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436ceed9-575b-4fc0-a2e3-6833cfb64404 admin admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:51.733491 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436ceed9-575b-4fc0-a2e3-6833cfb64404 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:19:51.734089 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436ceed9-575b-4fc0-a2e3-6833cfb64404 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:51.736209 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436ceed9-575b-4fc0-a2e3-6833cfb64404 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:51.755430 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1317/2615] 10.222.0.79 () {58 vars in 1153 bytes} [Tue Aug 30 01:19:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:19:51.761022 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ce3138-c699-4133-880a-9ca06d87de95 None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:51.774316 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ce3138-c699-4133-880a-9ca06d87de95 None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:51.787077 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a901ae4-5714-424d-ae59-948eb42a8038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:51.787772 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a901ae4-5714-424d-ae59-948eb42a8038 admin admin] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:51.788132 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a901ae4-5714-424d-ae59-948eb42a8038 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:51.788600 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a901ae4-5714-424d-ae59-948eb42a8038 admin admin] PATH_INFO: `/v3/projects` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:51.789325 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a901ae4-5714-424d-ae59-948eb42a8038 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:51.791327 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a901ae4-5714-424d-ae59-948eb42a8038 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:51.832378 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1299/2616] 10.222.0.79 () {60 vars in 1153 bytes} [Tue Aug 30 01:19:51 2022] POST /identity/v3/projects => generated 365 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:19:51.838091 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436ceed9-575b-4fc0-a2e3-6833cfb64404 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:51.850520 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436ceed9-575b-4fc0-a2e3-6833cfb64404 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:51.933751 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1906edcb-32fe-460a-ba2d-fdb7fa04def7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:51.934833 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1906edcb-32fe-460a-ba2d-fdb7fa04def7 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:51.935057 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1906edcb-32fe-460a-ba2d-fdb7fa04def7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:51.935304 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1906edcb-32fe-460a-ba2d-fdb7fa04def7 admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:51.936146 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1906edcb-32fe-460a-ba2d-fdb7fa04def7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:51.938544 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1906edcb-32fe-460a-ba2d-fdb7fa04def7 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:51.975606 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1318/2617] 10.222.0.79 () {60 vars in 1144 bytes} [Tue Aug 30 01:19:51 2022] POST /identity/v3/users => generated 283 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:19:51.979680 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a901ae4-5714-424d-ae59-948eb42a8038 admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:51.997040 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a901ae4-5714-424d-ae59-948eb42a8038 admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:52.004118 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f753c99f-b57c-4449-8434-e62582c43ed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:52.005185 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f753c99f-b57c-4449-8434-e62582c43ed9 admin admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:52.005626 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f753c99f-b57c-4449-8434-e62582c43ed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:52.006026 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f753c99f-b57c-4449-8434-e62582c43ed9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:52.006912 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f753c99f-b57c-4449-8434-e62582c43ed9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:52.008847 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f753c99f-b57c-4449-8434-e62582c43ed9 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:52.023502 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1300/2618] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:19:51 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:19:52.029593 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1906edcb-32fe-460a-ba2d-fdb7fa04def7 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:52.045123 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1906edcb-32fe-460a-ba2d-fdb7fa04def7 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:52.051683 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6c00c2-adad-42e5-828f-df509d2b1ef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:52.052739 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6c00c2-adad-42e5-828f-df509d2b1ef4 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:52.053253 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6c00c2-adad-42e5-828f-df509d2b1ef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:52.054220 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6c00c2-adad-42e5-828f-df509d2b1ef4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:52.055445 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6c00c2-adad-42e5-828f-df509d2b1ef4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:52.059591 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6c00c2-adad-42e5-828f-df509d2b1ef4 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:52.074628 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1319/2619] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:19:52 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 01:19:52.081066 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f753c99f-b57c-4449-8434-e62582c43ed9 admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:52.093207 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f753c99f-b57c-4449-8434-e62582c43ed9 admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:52.099354 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e3fbb4-f757-4cca-98cf-e16d0093d97e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:52.100170 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e3fbb4-f757-4cca-98cf-e16d0093d97e admin admin] REQUEST_METHOD: `PUT` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:52.101086 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e3fbb4-f757-4cca-98cf-e16d0093d97e admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:52.101606 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e3fbb4-f757-4cca-98cf-e16d0093d97e admin admin] PATH_INFO: `/v3/projects/f60e8a3239bc44078455074e48f2bdff/users/01fc49c4af7e4f4c80a579c1ce67d143/roles/c37945a17623465f899d4f217e7af593` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:52.112889 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:19:52.123185 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e3fbb4-f757-4cca-98cf-e16d0093d97e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f60e8a3239bc44078455074e48f2bdff, user_id=01fc49c4af7e4f4c80a579c1ce67d143, role_id=c37945a17623465f899d4f217e7af593)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:52.135116 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e3fbb4-f757-4cca-98cf-e16d0093d97e admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:52.157799 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1301/2620] 10.222.0.79 () {60 vars in 1483 bytes} [Tue Aug 30 01:19:52 2022] PUT /identity/v3/projects/f60e8a3239bc44078455074e48f2bdff/users/01fc49c4af7e4f4c80a579c1ce67d143/roles/c37945a17623465f899d4f217e7af593 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:19:52.170567 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c144005-98e7-44da-bfeb-f875bba51878 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:52.171077 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c144005-98e7-44da-bfeb-f875bba51878 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:52.171386 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c144005-98e7-44da-bfeb-f875bba51878 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:52.180898 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e3fbb4-f757-4cca-98cf-e16d0093d97e admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:52.182715 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-21e3fbb4-f757-4cca-98cf-e16d0093d97e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:19:52.212276 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-4c144005-98e7-44da-bfeb-f875bba51878 None None] MFA Rules not processed for user `01fc49c4af7e4f4c80a579c1ce67d143`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:19:52.213880 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-4c144005-98e7-44da-bfeb-f875bba51878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:19:52.275283 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:19:52.279656 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e3fbb4-f757-4cca-98cf-e16d0093d97e admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:52.285853 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e233fd-d8a5-4926-8c26-03b1d23226ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f827c7670b74d938ffe066ced88d1c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:52.287008 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e233fd-d8a5-4926-8c26-03b1d23226ab service cinder] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:52.287334 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e233fd-d8a5-4926-8c26-03b1d23226ab service cinder] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:52.287610 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e233fd-d8a5-4926-8c26-03b1d23226ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:52.290604 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-42e233fd-d8a5-4926-8c26-03b1d23226ab service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:19:52.301753 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1320/2621] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:19:52 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:19:52.314345 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c144005-98e7-44da-bfeb-f875bba51878 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:52.316199 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-4c144005-98e7-44da-bfeb-f875bba51878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:19:52.332917 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c144005-98e7-44da-bfeb-f875bba51878 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:52.339515 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7807f14-4105-416a-beec-e8f9e4e73bfc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f827c7670b74d938ffe066ced88d1c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:52.340579 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7807f14-4105-416a-beec-e8f9e4e73bfc service cinder] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:52.341085 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7807f14-4105-416a-beec-e8f9e4e73bfc service cinder] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:52.341583 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7807f14-4105-416a-beec-e8f9e4e73bfc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:52.359335 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7807f14-4105-416a-beec-e8f9e4e73bfc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:52.362154 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7807f14-4105-416a-beec-e8f9e4e73bfc service cinder] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:52.379702 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e233fd-d8a5-4926-8c26-03b1d23226ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:52.380732 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1321/2622] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:19:52 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 01:19:52.381309 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e233fd-d8a5-4926-8c26-03b1d23226ab service cinder] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:52.394487 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1302/2623] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:19:52 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 01:19:53.339861 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7807f14-4105-416a-beec-e8f9e4e73bfc service cinder] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:53.357926 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7807f14-4105-416a-beec-e8f9e4e73bfc service cinder] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:53.364930 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf456498-cd4f-477f-911b-8ee901c84c46 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f827c7670b74d938ffe066ced88d1c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:53.366660 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf456498-cd4f-477f-911b-8ee901c84c46 service cinder] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:53.367621 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf456498-cd4f-477f-911b-8ee901c84c46 service cinder] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:53.368290 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf456498-cd4f-477f-911b-8ee901c84c46 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:53.373277 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-bf456498-cd4f-477f-911b-8ee901c84c46 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:19:53.450430 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e233fd-d8a5-4926-8c26-03b1d23226ab service cinder] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:53.464802 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e233fd-d8a5-4926-8c26-03b1d23226ab service cinder] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:53.470862 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feeb95ca-449c-4113-8531-722b11c07b7a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f827c7670b74d938ffe066ced88d1c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:53.472027 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeb95ca-449c-4113-8531-722b11c07b7a service cinder] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:53.472788 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeb95ca-449c-4113-8531-722b11c07b7a service cinder] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:53.473322 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeb95ca-449c-4113-8531-722b11c07b7a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:53.477728 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-feeb95ca-449c-4113-8531-722b11c07b7a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:19:53.494817 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf456498-cd4f-477f-911b-8ee901c84c46 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:53.497193 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf456498-cd4f-477f-911b-8ee901c84c46 service cinder] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:53.516847 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1322/2624] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:19:53 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:19:53.602430 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feeb95ca-449c-4113-8531-722b11c07b7a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:53.605432 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feeb95ca-449c-4113-8531-722b11c07b7a service cinder] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:53.629536 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1303/2625] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:19:53 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 01:19:56.605979 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf456498-cd4f-477f-911b-8ee901c84c46 service cinder] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:56.607304 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-bf456498-cd4f-477f-911b-8ee901c84c46 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:19:56.739988 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf456498-cd4f-477f-911b-8ee901c84c46 service cinder] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:56.747690 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5aeb7d-d1bf-4f74-a456-d3a44428b614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:56.748440 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5aeb7d-d1bf-4f74-a456-d3a44428b614 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:56.748814 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5aeb7d-d1bf-4f74-a456-d3a44428b614 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:56.749295 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5aeb7d-d1bf-4f74-a456-d3a44428b614 admin admin] PATH_INFO: `/v3/users/42a40f369a76433eb8c4d3438ee8b9cf` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:56.750680 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5aeb7d-d1bf-4f74-a456-d3a44428b614 admin admin] RBAC: Authorizing `identity:delete_user(user_id=42a40f369a76433eb8c4d3438ee8b9cf)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:56.752774 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5aeb7d-d1bf-4f74-a456-d3a44428b614 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:56.839300 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-cc5aeb7d-d1bf-4f74-a456-d3a44428b614 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42a40f369a76433eb8c4d3438ee8b9cf'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:19:56.862453 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-cc5aeb7d-d1bf-4f74-a456-d3a44428b614 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42a40f369a76433eb8c4d3438ee8b9cf'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:19:56.883542 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-cc5aeb7d-d1bf-4f74-a456-d3a44428b614 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42a40f369a76433eb8c4d3438ee8b9cf'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:19:56.884951 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-cc5aeb7d-d1bf-4f74-a456-d3a44428b614 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42a40f369a76433eb8c4d3438ee8b9cf'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:19:56.900827 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:19:56.913559 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-cc5aeb7d-d1bf-4f74-a456-d3a44428b614 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42a40f369a76433eb8c4d3438ee8b9cf'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:19:56.925360 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1323/2626] 10.222.0.79 () {58 vars in 1224 bytes} [Tue Aug 30 01:19:56 2022] DELETE /identity/v3/users/42a40f369a76433eb8c4d3438ee8b9cf => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:19:56.931304 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d42f26-22fd-4848-907f-296aff05cc1a None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:56.931965 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d42f26-22fd-4848-907f-296aff05cc1a None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:56.932114 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d42f26-22fd-4848-907f-296aff05cc1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:56.955940 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-b8d42f26-22fd-4848-907f-296aff05cc1a None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:19:56.957276 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-b8d42f26-22fd-4848-907f-296aff05cc1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:19:56.999956 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:19:57.063970 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1304/2627] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:19:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:19:57.072536 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5aeb7d-d1bf-4f74-a456-d3a44428b614 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:57.074057 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-cc5aeb7d-d1bf-4f74-a456-d3a44428b614 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:19:57.156775 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5aeb7d-d1bf-4f74-a456-d3a44428b614 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:57.162506 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ce1ce9-8b33-43b7-8ad5-c9b0ac0d1878 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16e6a0ca26fc4ef892c188ad89a1e132', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:57.164164 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ce1ce9-8b33-43b7-8ad5-c9b0ac0d1878 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:57.164659 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ce1ce9-8b33-43b7-8ad5-c9b0ac0d1878 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:57.165128 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ce1ce9-8b33-43b7-8ad5-c9b0ac0d1878 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:57.182426 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ce1ce9-8b33-43b7-8ad5-c9b0ac0d1878 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:57.185496 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ce1ce9-8b33-43b7-8ad5-c9b0ac0d1878 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:57.204598 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1324/2628] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:19:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:19:57.594158 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d42f26-22fd-4848-907f-296aff05cc1a None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:57.596038 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-b8d42f26-22fd-4848-907f-296aff05cc1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:19:57.611368 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d42f26-22fd-4848-907f-296aff05cc1a None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:57.619401 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cafd27-91f1-47e8-961a-5288a5b4de90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:57.620079 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cafd27-91f1-47e8-961a-5288a5b4de90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:57.620359 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cafd27-91f1-47e8-961a-5288a5b4de90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:57.620635 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cafd27-91f1-47e8-961a-5288a5b4de90 admin admin] PATH_INFO: `/v3/projects/6d839ec4a02c4fad886494e11698eafb` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:57.621918 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cafd27-91f1-47e8-961a-5288a5b4de90 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d839ec4a02c4fad886494e11698eafb)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:57.624193 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cafd27-91f1-47e8-961a-5288a5b4de90 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:57.686677 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-03cafd27-91f1-47e8-961a-5288a5b4de90 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d839ec4a02c4fad886494e11698eafb', 'request_id': 'req-03cafd27-91f1-47e8-961a-5288a5b4de90'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:19:57.697450 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-03cafd27-91f1-47e8-961a-5288a5b4de90 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d839ec4a02c4fad886494e11698eafb', 'request_id': 'req-03cafd27-91f1-47e8-961a-5288a5b4de90'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:19:57.710261 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-03cafd27-91f1-47e8-961a-5288a5b4de90 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d839ec4a02c4fad886494e11698eafb', 'request_id': 'req-03cafd27-91f1-47e8-961a-5288a5b4de90'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:19:57.731070 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-03cafd27-91f1-47e8-961a-5288a5b4de90 admin admin] The token cache is being invalidate because project 6d839ec4a02c4fad886494e11698eafb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81998) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:19:57.731423 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-03cafd27-91f1-47e8-961a-5288a5b4de90 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:19:57.732202 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-03cafd27-91f1-47e8-961a-5288a5b4de90 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:19:57.733829 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1305/2629] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 30 01:19:57 2022] DELETE /identity/v3/projects/6d839ec4a02c4fad886494e11698eafb => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:19:57.739250 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ce1ce9-8b33-43b7-8ad5-c9b0ac0d1878 service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:57.757832 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ce1ce9-8b33-43b7-8ad5-c9b0ac0d1878 service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:57.852064 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523ba49f-d7ed-4be1-855e-44134f8a3334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:57.852733 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523ba49f-d7ed-4be1-855e-44134f8a3334 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:57.853075 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523ba49f-d7ed-4be1-855e-44134f8a3334 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:57.853356 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523ba49f-d7ed-4be1-855e-44134f8a3334 admin admin] PATH_INFO: `/v3/users/911b4fd406234be0951f0901b3b6eab3` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:57.854817 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523ba49f-d7ed-4be1-855e-44134f8a3334 admin admin] RBAC: Authorizing `identity:delete_user(user_id=911b4fd406234be0951f0901b3b6eab3)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:57.857096 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523ba49f-d7ed-4be1-855e-44134f8a3334 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:57.942909 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-523ba49f-d7ed-4be1-855e-44134f8a3334 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '911b4fd406234be0951f0901b3b6eab3'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:19:57.952824 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-523ba49f-d7ed-4be1-855e-44134f8a3334 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '911b4fd406234be0951f0901b3b6eab3'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:19:57.968959 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-523ba49f-d7ed-4be1-855e-44134f8a3334 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '911b4fd406234be0951f0901b3b6eab3'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:19:57.970087 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-523ba49f-d7ed-4be1-855e-44134f8a3334 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '911b4fd406234be0951f0901b3b6eab3'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:19:57.992079 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-523ba49f-d7ed-4be1-855e-44134f8a3334 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '911b4fd406234be0951f0901b3b6eab3'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:19:58.001038 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1325/2630] 10.222.0.79 () {58 vars in 1224 bytes} [Tue Aug 30 01:19:57 2022] DELETE /identity/v3/users/911b4fd406234be0951f0901b3b6eab3 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:19:58.072963 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cafd27-91f1-47e8-961a-5288a5b4de90 admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:58.077298 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-03cafd27-91f1-47e8-961a-5288a5b4de90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:19:58.106716 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cafd27-91f1-47e8-961a-5288a5b4de90 admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:58.298571 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7083a53-fb79-4a53-91be-f53650d5f29f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:58.303585 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7083a53-fb79-4a53-91be-f53650d5f29f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:58.304727 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7083a53-fb79-4a53-91be-f53650d5f29f admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:58.305223 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7083a53-fb79-4a53-91be-f53650d5f29f admin admin] PATH_INFO: `/v3/users/0776817776354206bd095855c4601eaa` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:58.312789 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7083a53-fb79-4a53-91be-f53650d5f29f admin admin] RBAC: Authorizing `identity:delete_user(user_id=0776817776354206bd095855c4601eaa)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:58.323557 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7083a53-fb79-4a53-91be-f53650d5f29f admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:58.491494 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-c7083a53-fb79-4a53-91be-f53650d5f29f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0776817776354206bd095855c4601eaa'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:19:58.515457 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-c7083a53-fb79-4a53-91be-f53650d5f29f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0776817776354206bd095855c4601eaa'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:19:58.520469 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:19:58.550493 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-c7083a53-fb79-4a53-91be-f53650d5f29f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0776817776354206bd095855c4601eaa'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:19:58.551702 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-c7083a53-fb79-4a53-91be-f53650d5f29f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0776817776354206bd095855c4601eaa'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:19:58.563309 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-c7083a53-fb79-4a53-91be-f53650d5f29f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0776817776354206bd095855c4601eaa'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:19:58.572391 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1306/2631] 10.222.0.79 () {58 vars in 1224 bytes} [Tue Aug 30 01:19:58 2022] DELETE /identity/v3/users/0776817776354206bd095855c4601eaa => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:19:58.578253 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cc4c27-f736-4077-a5a9-ccc959b61465 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:58.578772 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cc4c27-f736-4077-a5a9-ccc959b61465 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:58.579516 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cc4c27-f736-4077-a5a9-ccc959b61465 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:58.606213 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-11cc4c27-f736-4077-a5a9-ccc959b61465 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:19:58.607841 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-11cc4c27-f736-4077-a5a9-ccc959b61465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:19:58.615020 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:19:58.629451 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7083a53-fb79-4a53-91be-f53650d5f29f admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:58.632940 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-c7083a53-fb79-4a53-91be-f53650d5f29f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:19:58.724068 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1326/2632] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:19:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:19:58.738054 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cc4c27-f736-4077-a5a9-ccc959b61465 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:58.740636 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-11cc4c27-f736-4077-a5a9-ccc959b61465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:19:58.780493 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7083a53-fb79-4a53-91be-f53650d5f29f admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:58.786373 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0730029-3449-487d-83bc-7a9df5570090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:58.787026 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0730029-3449-487d-83bc-7a9df5570090 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:58.787506 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0730029-3449-487d-83bc-7a9df5570090 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:58.788003 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0730029-3449-487d-83bc-7a9df5570090 admin admin] PATH_INFO: `/v3/projects/774c76fbf66a4c0bad44e36f26e9fee9` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:58.789933 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0730029-3449-487d-83bc-7a9df5570090 admin admin] RBAC: Authorizing `identity:delete_project(project_id=774c76fbf66a4c0bad44e36f26e9fee9)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:58.792747 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0730029-3449-487d-83bc-7a9df5570090 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:58.852833 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-a0730029-3449-487d-83bc-7a9df5570090 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '774c76fbf66a4c0bad44e36f26e9fee9', 'request_id': 'req-a0730029-3449-487d-83bc-7a9df5570090'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:19:58.862865 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cc4c27-f736-4077-a5a9-ccc959b61465 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:58.867895 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-a0730029-3449-487d-83bc-7a9df5570090 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '774c76fbf66a4c0bad44e36f26e9fee9', 'request_id': 'req-a0730029-3449-487d-83bc-7a9df5570090'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:19:58.875343 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-a0730029-3449-487d-83bc-7a9df5570090 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '774c76fbf66a4c0bad44e36f26e9fee9', 'request_id': 'req-a0730029-3449-487d-83bc-7a9df5570090'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:19:58.890703 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-a0730029-3449-487d-83bc-7a9df5570090 admin admin] The token cache is being invalidate because project 774c76fbf66a4c0bad44e36f26e9fee9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81998) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:19:58.891063 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-a0730029-3449-487d-83bc-7a9df5570090 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:19:58.891965 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-a0730029-3449-487d-83bc-7a9df5570090 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:19:58.893904 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1307/2633] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 30 01:19:58 2022] DELETE /identity/v3/projects/774c76fbf66a4c0bad44e36f26e9fee9 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:19:58.897952 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0730029-3449-487d-83bc-7a9df5570090 admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:58.899452 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-a0730029-3449-487d-83bc-7a9df5570090 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:19:58.965395 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc27319-c26a-49c8-b98c-0d29111075ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16e6a0ca26fc4ef892c188ad89a1e132', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:58.966434 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc27319-c26a-49c8-b98c-0d29111075ad service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:58.967425 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc27319-c26a-49c8-b98c-0d29111075ad service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:58.968290 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc27319-c26a-49c8-b98c-0d29111075ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:58.971570 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-2fc27319-c26a-49c8-b98c-0d29111075ad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:19:58.993417 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0730029-3449-487d-83bc-7a9df5570090 admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:59.005912 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9e3b7d-9833-4244-947a-72e4fffed814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:59.007051 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9e3b7d-9833-4244-947a-72e4fffed814 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:59.007810 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9e3b7d-9833-4244-947a-72e4fffed814 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:59.008272 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9e3b7d-9833-4244-947a-72e4fffed814 admin admin] PATH_INFO: `/v3/users/2d928c1033534f8d8fd4c35b48ebe590` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:59.010479 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9e3b7d-9833-4244-947a-72e4fffed814 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d928c1033534f8d8fd4c35b48ebe590)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:59.014352 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9e3b7d-9833-4244-947a-72e4fffed814 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:59.041763 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:19:59.076921 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc27319-c26a-49c8-b98c-0d29111075ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:59.078482 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc27319-c26a-49c8-b98c-0d29111075ad service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:59.090662 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1327/2634] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:19:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 01:19:59.125371 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-4c9e3b7d-9833-4244-947a-72e4fffed814 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d928c1033534f8d8fd4c35b48ebe590'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:19:59.139382 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-4c9e3b7d-9833-4244-947a-72e4fffed814 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d928c1033534f8d8fd4c35b48ebe590'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:19:59.168779 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-4c9e3b7d-9833-4244-947a-72e4fffed814 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d928c1033534f8d8fd4c35b48ebe590'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:19:59.169641 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-4c9e3b7d-9833-4244-947a-72e4fffed814 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d928c1033534f8d8fd4c35b48ebe590'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:19:59.181731 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-4c9e3b7d-9833-4244-947a-72e4fffed814 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d928c1033534f8d8fd4c35b48ebe590'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:19:59.194420 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1308/2635] 10.222.0.79 () {58 vars in 1224 bytes} [Tue Aug 30 01:19:58 2022] DELETE /identity/v3/users/2d928c1033534f8d8fd4c35b48ebe590 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:19:59.558890 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc27319-c26a-49c8-b98c-0d29111075ad service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:59.563448 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-2fc27319-c26a-49c8-b98c-0d29111075ad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:19:59.589893 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9e3b7d-9833-4244-947a-72e4fffed814 admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:59.592283 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-4c9e3b7d-9833-4244-947a-72e4fffed814 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:19:59.595685 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc27319-c26a-49c8-b98c-0d29111075ad service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:59.614687 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:19:59.689531 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9e3b7d-9833-4244-947a-72e4fffed814 admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:59.690992 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308d3b29-6ce7-454e-b4fb-84b9e60164af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:59.692615 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308d3b29-6ce7-454e-b4fb-84b9e60164af admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:59.692885 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308d3b29-6ce7-454e-b4fb-84b9e60164af admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:59.693417 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308d3b29-6ce7-454e-b4fb-84b9e60164af admin admin] PATH_INFO: `/v3/projects/588d1bee35d54c9aa0cf13021a0bd1e7` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:59.696187 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308d3b29-6ce7-454e-b4fb-84b9e60164af admin admin] RBAC: Authorizing `identity:delete_project(project_id=588d1bee35d54c9aa0cf13021a0bd1e7)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:59.697043 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba58b7d2-5ef0-4d38-a9f3-6d0c74c2d6e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16e6a0ca26fc4ef892c188ad89a1e132', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:59.698028 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba58b7d2-5ef0-4d38-a9f3-6d0c74c2d6e1 service neutron] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:59.698479 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba58b7d2-5ef0-4d38-a9f3-6d0c74c2d6e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:59.698905 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba58b7d2-5ef0-4d38-a9f3-6d0c74c2d6e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:59.700218 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308d3b29-6ce7-454e-b4fb-84b9e60164af admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:59.701557 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-ba58b7d2-5ef0-4d38-a9f3-6d0c74c2d6e1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:19:59.721520 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba58b7d2-5ef0-4d38-a9f3-6d0c74c2d6e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:59.723629 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba58b7d2-5ef0-4d38-a9f3-6d0c74c2d6e1 service neutron] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:59.736399 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1309/2636] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:19:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:19:59.737290 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba58b7d2-5ef0-4d38-a9f3-6d0c74c2d6e1 service neutron] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:59.738817 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-ba58b7d2-5ef0-4d38-a9f3-6d0c74c2d6e1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:19:59.751983 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba58b7d2-5ef0-4d38-a9f3-6d0c74c2d6e1 service neutron] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:59.761053 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a8fc5f-dcf1-4ec0-a8e6-f96127da70bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:59.763642 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a8fc5f-dcf1-4ec0-a8e6-f96127da70bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:59.764366 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a8fc5f-dcf1-4ec0-a8e6-f96127da70bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:59.765064 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a8fc5f-dcf1-4ec0-a8e6-f96127da70bb admin admin] PATH_INFO: `/v3/projects/c4ef27c124c4495c8bb57a7528b9e753` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:59.767156 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a8fc5f-dcf1-4ec0-a8e6-f96127da70bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4ef27c124c4495c8bb57a7528b9e753)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:59.770982 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a8fc5f-dcf1-4ec0-a8e6-f96127da70bb admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:59.778881 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-308d3b29-6ce7-454e-b4fb-84b9e60164af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '588d1bee35d54c9aa0cf13021a0bd1e7', 'request_id': 'req-308d3b29-6ce7-454e-b4fb-84b9e60164af'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:19:59.792817 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-308d3b29-6ce7-454e-b4fb-84b9e60164af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '588d1bee35d54c9aa0cf13021a0bd1e7', 'request_id': 'req-308d3b29-6ce7-454e-b4fb-84b9e60164af'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:19:59.804219 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-308d3b29-6ce7-454e-b4fb-84b9e60164af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '588d1bee35d54c9aa0cf13021a0bd1e7', 'request_id': 'req-308d3b29-6ce7-454e-b4fb-84b9e60164af'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:19:59.822512 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-308d3b29-6ce7-454e-b4fb-84b9e60164af admin admin] The token cache is being invalidate because project 588d1bee35d54c9aa0cf13021a0bd1e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:19:59.822876 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-308d3b29-6ce7-454e-b4fb-84b9e60164af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:19:59.823792 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-308d3b29-6ce7-454e-b4fb-84b9e60164af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:19:59.826064 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1328/2637] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 30 01:19:59 2022] DELETE /identity/v3/projects/588d1bee35d54c9aa0cf13021a0bd1e7 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:19:59.831765 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308d3b29-6ce7-454e-b4fb-84b9e60164af admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:59.834244 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-308d3b29-6ce7-454e-b4fb-84b9e60164af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:19:59.861356 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-11a8fc5f-dcf1-4ec0-a8e6-f96127da70bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4ef27c124c4495c8bb57a7528b9e753', 'request_id': 'req-11a8fc5f-dcf1-4ec0-a8e6-f96127da70bb'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:19:59.876385 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-11a8fc5f-dcf1-4ec0-a8e6-f96127da70bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4ef27c124c4495c8bb57a7528b9e753', 'request_id': 'req-11a8fc5f-dcf1-4ec0-a8e6-f96127da70bb'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:19:59.891312 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-11a8fc5f-dcf1-4ec0-a8e6-f96127da70bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4ef27c124c4495c8bb57a7528b9e753', 'request_id': 'req-11a8fc5f-dcf1-4ec0-a8e6-f96127da70bb'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:19:59.919376 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-11a8fc5f-dcf1-4ec0-a8e6-f96127da70bb admin admin] The token cache is being invalidate because project c4ef27c124c4495c8bb57a7528b9e753 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81998) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:19:59.919890 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-11a8fc5f-dcf1-4ec0-a8e6-f96127da70bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:19:59.921033 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-11a8fc5f-dcf1-4ec0-a8e6-f96127da70bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:19:59.924255 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1310/2638] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 30 01:19:59 2022] DELETE /identity/v3/projects/c4ef27c124c4495c8bb57a7528b9e753 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:19:59.930969 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308d3b29-6ce7-454e-b4fb-84b9e60164af admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:59.933763 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffcd57b-62b0-4a39-aa0d-797c534ed30a None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:59.934051 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffcd57b-62b0-4a39-aa0d-797c534ed30a None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:59.934433 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffcd57b-62b0-4a39-aa0d-797c534ed30a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:59.962572 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-7ffcd57b-62b0-4a39-aa0d-797c534ed30a None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:19:59.965206 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-7ffcd57b-62b0-4a39-aa0d-797c534ed30a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:19:59.983749 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:20:00.012212 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:20:00.021692 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd9fb72-72bc-4827-bb0b-fdfa9ac6e35d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:00.023926 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd9fb72-72bc-4827-bb0b-fdfa9ac6e35d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:00.024632 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd9fb72-72bc-4827-bb0b-fdfa9ac6e35d admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:00.026215 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd9fb72-72bc-4827-bb0b-fdfa9ac6e35d admin admin] PATH_INFO: `/v3/users/7ed3efb44643416fa5c8450f93dc88ce` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:00.027397 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd9fb72-72bc-4827-bb0b-fdfa9ac6e35d admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ed3efb44643416fa5c8450f93dc88ce)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:00.030287 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd9fb72-72bc-4827-bb0b-fdfa9ac6e35d admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:00.099320 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-1bd9fb72-72bc-4827-bb0b-fdfa9ac6e35d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ed3efb44643416fa5c8450f93dc88ce'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:00.116691 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1311/2639] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:19:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:20:00.119734 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659b2559-b5e3-4a81-9fff-5721a1c25d9a None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:00.120403 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659b2559-b5e3-4a81-9fff-5721a1c25d9a None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:00.120763 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659b2559-b5e3-4a81-9fff-5721a1c25d9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:00.139272 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-1bd9fb72-72bc-4827-bb0b-fdfa9ac6e35d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ed3efb44643416fa5c8450f93dc88ce'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:00.153450 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-1bd9fb72-72bc-4827-bb0b-fdfa9ac6e35d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ed3efb44643416fa5c8450f93dc88ce'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:00.155707 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-1bd9fb72-72bc-4827-bb0b-fdfa9ac6e35d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ed3efb44643416fa5c8450f93dc88ce'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:00.171374 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-659b2559-b5e3-4a81-9fff-5721a1c25d9a None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:20:00.174877 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-659b2559-b5e3-4a81-9fff-5721a1c25d9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:20:00.178473 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-1bd9fb72-72bc-4827-bb0b-fdfa9ac6e35d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ed3efb44643416fa5c8450f93dc88ce'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:00.187508 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1329/2640] 10.222.0.79 () {58 vars in 1224 bytes} [Tue Aug 30 01:19:59 2022] DELETE /identity/v3/users/7ed3efb44643416fa5c8450f93dc88ce => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:20:00.212214 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1312/2641] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:20:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:20:00.213470 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd9fb72-72bc-4827-bb0b-fdfa9ac6e35d admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:00.357999 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd9fb72-72bc-4827-bb0b-fdfa9ac6e35d admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:00.366166 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2d4b71-1153-461d-af54-617fe4427de4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:00.367730 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2d4b71-1153-461d-af54-617fe4427de4 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:00.368018 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2d4b71-1153-461d-af54-617fe4427de4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:00.368294 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2d4b71-1153-461d-af54-617fe4427de4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:00.368979 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2d4b71-1153-461d-af54-617fe4427de4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:20:00.369288 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2d4b71-1153-461d-af54-617fe4427de4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:00.371007 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2d4b71-1153-461d-af54-617fe4427de4 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:00.386024 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1330/2642] 10.222.0.79 () {58 vars in 1153 bytes} [Tue Aug 30 01:20:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:20:00.393991 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659b2559-b5e3-4a81-9fff-5721a1c25d9a None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:00.408996 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659b2559-b5e3-4a81-9fff-5721a1c25d9a None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:00.416921 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d2bd3b-6710-4b47-802d-33e071d01a6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:00.418466 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d2bd3b-6710-4b47-802d-33e071d01a6f admin admin] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:00.418466 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d2bd3b-6710-4b47-802d-33e071d01a6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:00.418466 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d2bd3b-6710-4b47-802d-33e071d01a6f admin admin] PATH_INFO: `/v3/projects` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:00.418979 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d2bd3b-6710-4b47-802d-33e071d01a6f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:00.421206 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d2bd3b-6710-4b47-802d-33e071d01a6f admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:00.498071 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1313/2643] 10.222.0.79 () {60 vars in 1153 bytes} [Tue Aug 30 01:20:00 2022] POST /identity/v3/projects => generated 383 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:20:00.503316 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2d4b71-1153-461d-af54-617fe4427de4 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:00.529651 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2d4b71-1153-461d-af54-617fe4427de4 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:00.611168 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6921ff44-e9cd-4aa9-b69e-13fb74a3fd96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:00.611923 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6921ff44-e9cd-4aa9-b69e-13fb74a3fd96 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:00.611923 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6921ff44-e9cd-4aa9-b69e-13fb74a3fd96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:00.612297 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6921ff44-e9cd-4aa9-b69e-13fb74a3fd96 admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:00.613442 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6921ff44-e9cd-4aa9-b69e-13fb74a3fd96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:00.616057 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6921ff44-e9cd-4aa9-b69e-13fb74a3fd96 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:00.637654 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:20:00.651330 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d2bd3b-6710-4b47-802d-33e071d01a6f admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:00.658970 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1331/2644] 10.222.0.79 () {60 vars in 1144 bytes} [Tue Aug 30 01:20:00 2022] POST /identity/v3/users => generated 292 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:20:00.666018 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d2bd3b-6710-4b47-802d-33e071d01a6f admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:00.673064 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26780a5a-d51c-4b4d-8703-60a0319fc515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:00.673821 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26780a5a-d51c-4b4d-8703-60a0319fc515 admin admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:00.674182 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26780a5a-d51c-4b4d-8703-60a0319fc515 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:00.674639 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26780a5a-d51c-4b4d-8703-60a0319fc515 admin admin] PATH_INFO: `/v3/roles` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:00.675506 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26780a5a-d51c-4b4d-8703-60a0319fc515 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:00.677341 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26780a5a-d51c-4b4d-8703-60a0319fc515 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:00.692210 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1314/2645] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:20:00 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:20:00.697979 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6921ff44-e9cd-4aa9-b69e-13fb74a3fd96 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:00.710478 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6921ff44-e9cd-4aa9-b69e-13fb74a3fd96 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:00.716974 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f283ee-e252-4e60-9b52-a6e25d6d04d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:00.717927 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f283ee-e252-4e60-9b52-a6e25d6d04d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:00.718383 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f283ee-e252-4e60-9b52-a6e25d6d04d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:00.718643 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f283ee-e252-4e60-9b52-a6e25d6d04d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:00.719370 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f283ee-e252-4e60-9b52-a6e25d6d04d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:00.721050 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f283ee-e252-4e60-9b52-a6e25d6d04d7 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:00.739767 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1332/2646] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:20:00 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:20:00.746895 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26780a5a-d51c-4b4d-8703-60a0319fc515 admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:00.762987 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26780a5a-d51c-4b4d-8703-60a0319fc515 admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:00.766957 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f283ee-e252-4e60-9b52-a6e25d6d04d7 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:00.769648 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-18f283ee-e252-4e60-9b52-a6e25d6d04d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:20:00.770707 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51548678-6698-4cdd-ac5f-40f3f9c60c36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:00.771856 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51548678-6698-4cdd-ac5f-40f3f9c60c36 admin admin] REQUEST_METHOD: `PUT` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:00.773078 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51548678-6698-4cdd-ac5f-40f3f9c60c36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:00.773800 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51548678-6698-4cdd-ac5f-40f3f9c60c36 admin admin] PATH_INFO: `/v3/projects/9f63ad1896f34188a4bb07dca6f83203/users/a59becc03dab430aa81fa5cdb012d9cf/roles/c37945a17623465f899d4f217e7af593` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:00.795089 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f283ee-e252-4e60-9b52-a6e25d6d04d7 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:00.803119 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34580e77-ec3d-4eda-9ade-7a28331e44bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:00.805636 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34580e77-ec3d-4eda-9ade-7a28331e44bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:00.806139 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34580e77-ec3d-4eda-9ade-7a28331e44bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:00.806697 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34580e77-ec3d-4eda-9ade-7a28331e44bf admin admin] PATH_INFO: `/v3/projects/b5e52f1739c04a61b2ef1b3b7a6cece6` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:00.808920 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34580e77-ec3d-4eda-9ade-7a28331e44bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5e52f1739c04a61b2ef1b3b7a6cece6)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:00.809714 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51548678-6698-4cdd-ac5f-40f3f9c60c36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f63ad1896f34188a4bb07dca6f83203, user_id=a59becc03dab430aa81fa5cdb012d9cf, role_id=c37945a17623465f899d4f217e7af593)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:00.815976 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51548678-6698-4cdd-ac5f-40f3f9c60c36 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:00.823329 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34580e77-ec3d-4eda-9ade-7a28331e44bf admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:00.849018 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1315/2647] 10.222.0.79 () {60 vars in 1483 bytes} [Tue Aug 30 01:20:00 2022] PUT /identity/v3/projects/9f63ad1896f34188a4bb07dca6f83203/users/a59becc03dab430aa81fa5cdb012d9cf/roles/c37945a17623465f899d4f217e7af593 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:20:00.870679 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aaaebb-d909-452c-b265-f7e1146766c1 None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:00.871240 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aaaebb-d909-452c-b265-f7e1146766c1 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:00.871735 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aaaebb-d909-452c-b265-f7e1146766c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:00.909479 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-34580e77-ec3d-4eda-9ade-7a28331e44bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5e52f1739c04a61b2ef1b3b7a6cece6', 'request_id': 'req-34580e77-ec3d-4eda-9ade-7a28331e44bf'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:00.911603 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-e1aaaebb-d909-452c-b265-f7e1146766c1 None None] MFA Rules not processed for user `a59becc03dab430aa81fa5cdb012d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:20:00.912971 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-e1aaaebb-d909-452c-b265-f7e1146766c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:20:00.926275 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-34580e77-ec3d-4eda-9ade-7a28331e44bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5e52f1739c04a61b2ef1b3b7a6cece6', 'request_id': 'req-34580e77-ec3d-4eda-9ade-7a28331e44bf'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:00.941115 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-34580e77-ec3d-4eda-9ade-7a28331e44bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5e52f1739c04a61b2ef1b3b7a6cece6', 'request_id': 'req-34580e77-ec3d-4eda-9ade-7a28331e44bf'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:00.969934 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-34580e77-ec3d-4eda-9ade-7a28331e44bf admin admin] The token cache is being invalidate because project b5e52f1739c04a61b2ef1b3b7a6cece6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:20:00.970229 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-34580e77-ec3d-4eda-9ade-7a28331e44bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:00.970950 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-34580e77-ec3d-4eda-9ade-7a28331e44bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:00.974125 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1333/2648] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 30 01:20:00 2022] DELETE /identity/v3/projects/b5e52f1739c04a61b2ef1b3b7a6cece6 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:20:00.978498 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34580e77-ec3d-4eda-9ade-7a28331e44bf admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:00.980597 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-34580e77-ec3d-4eda-9ade-7a28331e44bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:20:01.025267 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1316/2649] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:20:00 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:20:01.030383 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1aaaebb-d909-452c-b265-f7e1146766c1 None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:01.031858 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-e1aaaebb-d909-452c-b265-f7e1146766c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:20:01.095062 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34580e77-ec3d-4eda-9ade-7a28331e44bf admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:01.104669 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78482b5-2986-42f9-8c98-fc1da6152879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:01.105728 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78482b5-2986-42f9-8c98-fc1da6152879 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:01.106166 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78482b5-2986-42f9-8c98-fc1da6152879 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:01.106942 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78482b5-2986-42f9-8c98-fc1da6152879 admin admin] PATH_INFO: `/v3/users/f75ca63ee4874b1db0a371911a71107e` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:01.108326 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:20:01.109499 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78482b5-2986-42f9-8c98-fc1da6152879 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f75ca63ee4874b1db0a371911a71107e)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:01.113629 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78482b5-2986-42f9-8c98-fc1da6152879 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:01.172119 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1aaaebb-d909-452c-b265-f7e1146766c1 None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:01.182494 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7438fc-c75d-4291-91e6-87f4a5706185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:01.184366 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7438fc-c75d-4291-91e6-87f4a5706185 admin admin] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:01.185063 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7438fc-c75d-4291-91e6-87f4a5706185 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:01.185718 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7438fc-c75d-4291-91e6-87f4a5706185 admin admin] PATH_INFO: `/v3/projects` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:01.187825 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7438fc-c75d-4291-91e6-87f4a5706185 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:01.192052 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7438fc-c75d-4291-91e6-87f4a5706185 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:01.228108 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-e78482b5-2986-42f9-8c98-fc1da6152879 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f75ca63ee4874b1db0a371911a71107e'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:01.250741 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-e78482b5-2986-42f9-8c98-fc1da6152879 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f75ca63ee4874b1db0a371911a71107e'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:01.261671 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1317/2650] 10.222.0.79 () {60 vars in 1153 bytes} [Tue Aug 30 01:20:01 2022] POST /identity/v3/projects => generated 383 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:20:01.266026 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-e78482b5-2986-42f9-8c98-fc1da6152879 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f75ca63ee4874b1db0a371911a71107e'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:01.267849 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-e78482b5-2986-42f9-8c98-fc1da6152879 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f75ca63ee4874b1db0a371911a71107e'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:01.268141 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7438fc-c75d-4291-91e6-87f4a5706185 admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:01.271466 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-0c7438fc-c75d-4291-91e6-87f4a5706185 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:20:01.280254 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:20:01.291342 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-e78482b5-2986-42f9-8c98-fc1da6152879 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f75ca63ee4874b1db0a371911a71107e'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:01.304466 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1334/2651] 10.222.0.79 () {58 vars in 1224 bytes} [Tue Aug 30 01:20:00 2022] DELETE /identity/v3/users/f75ca63ee4874b1db0a371911a71107e => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:20:01.432093 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7438fc-c75d-4291-91e6-87f4a5706185 admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:01.658311 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47fe30b-9a38-4cd8-85fd-5037627a89e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:01.660820 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47fe30b-9a38-4cd8-85fd-5037627a89e2 admin admin] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:01.661614 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47fe30b-9a38-4cd8-85fd-5037627a89e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:01.662096 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47fe30b-9a38-4cd8-85fd-5037627a89e2 admin admin] PATH_INFO: `/v3/users` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:01.664337 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47fe30b-9a38-4cd8-85fd-5037627a89e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:01.679806 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47fe30b-9a38-4cd8-85fd-5037627a89e2 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:01.773077 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1318/2652] 10.222.0.79 () {60 vars in 1144 bytes} [Tue Aug 30 01:20:01 2022] POST /identity/v3/users => generated 298 bytes in 501 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:20:01.775474 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78482b5-2986-42f9-8c98-fc1da6152879 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:01.798891 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78482b5-2986-42f9-8c98-fc1da6152879 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:01.804319 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa57016f-5a5f-41c8-9b93-be901ddc341f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:01.804959 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa57016f-5a5f-41c8-9b93-be901ddc341f admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:01.805237 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa57016f-5a5f-41c8-9b93-be901ddc341f admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:01.805507 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa57016f-5a5f-41c8-9b93-be901ddc341f admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:01.806813 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa57016f-5a5f-41c8-9b93-be901ddc341f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:01.808943 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa57016f-5a5f-41c8-9b93-be901ddc341f admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:01.823462 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1335/2653] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:20:01 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:20:01.829013 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47fe30b-9a38-4cd8-85fd-5037627a89e2 admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:01.846962 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47fe30b-9a38-4cd8-85fd-5037627a89e2 admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:01.854011 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3c938b-6129-4396-b5b7-feb816aa4dc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:01.858402 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3c938b-6129-4396-b5b7-feb816aa4dc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:01.859518 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3c938b-6129-4396-b5b7-feb816aa4dc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:01.859943 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3c938b-6129-4396-b5b7-feb816aa4dc9 admin admin] PATH_INFO: `/v3/projects/c0b2fd18aef64220934afb8dfcdb62b2/users/448082629ce24602896bbcc2fa7d49b6/roles/d14c3070c9184d76a7b23df69bd3db07` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:01.885104 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3c938b-6129-4396-b5b7-feb816aa4dc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0b2fd18aef64220934afb8dfcdb62b2, user_id=448082629ce24602896bbcc2fa7d49b6, role_id=d14c3070c9184d76a7b23df69bd3db07)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:01.891300 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3c938b-6129-4396-b5b7-feb816aa4dc9 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:01.917048 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1319/2654] 10.222.0.79 () {60 vars in 1483 bytes} [Tue Aug 30 01:20:01 2022] PUT /identity/v3/projects/c0b2fd18aef64220934afb8dfcdb62b2/users/448082629ce24602896bbcc2fa7d49b6/roles/d14c3070c9184d76a7b23df69bd3db07 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:20:01.923558 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa57016f-5a5f-41c8-9b93-be901ddc341f admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:01.939006 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa57016f-5a5f-41c8-9b93-be901ddc341f admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:02.043251 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49a0181-ae0c-44a9-843f-68c2f593ba2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:02.045054 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49a0181-ae0c-44a9-843f-68c2f593ba2f admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:02.045530 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49a0181-ae0c-44a9-843f-68c2f593ba2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:02.046018 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49a0181-ae0c-44a9-843f-68c2f593ba2f admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:02.047327 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49a0181-ae0c-44a9-843f-68c2f593ba2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:02.050534 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49a0181-ae0c-44a9-843f-68c2f593ba2f admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:02.076414 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1336/2655] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:20:01 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:20:02.082008 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3c938b-6129-4396-b5b7-feb816aa4dc9 admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:02.103612 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3c938b-6129-4396-b5b7-feb816aa4dc9 admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:02.112040 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ff87bc-d9c5-44e5-b4f0-7cb873010409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:02.113174 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ff87bc-d9c5-44e5-b4f0-7cb873010409 admin admin] REQUEST_METHOD: `PUT` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:02.113745 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ff87bc-d9c5-44e5-b4f0-7cb873010409 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:02.114239 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ff87bc-d9c5-44e5-b4f0-7cb873010409 admin admin] PATH_INFO: `/v3/projects/c0b2fd18aef64220934afb8dfcdb62b2/users/448082629ce24602896bbcc2fa7d49b6/roles/d14c3070c9184d76a7b23df69bd3db07` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:02.118672 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ff87bc-d9c5-44e5-b4f0-7cb873010409 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0b2fd18aef64220934afb8dfcdb62b2, user_id=448082629ce24602896bbcc2fa7d49b6, role_id=d14c3070c9184d76a7b23df69bd3db07)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:02.126698 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ff87bc-d9c5-44e5-b4f0-7cb873010409 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:02.144436 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1320/2656] 10.222.0.79 () {60 vars in 1483 bytes} [Tue Aug 30 01:20:02 2022] PUT /identity/v3/projects/c0b2fd18aef64220934afb8dfcdb62b2/users/448082629ce24602896bbcc2fa7d49b6/roles/d14c3070c9184d76a7b23df69bd3db07 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:20:02.160478 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22397f04-5eef-45af-a153-39225fd76c8b None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:02.161024 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22397f04-5eef-45af-a153-39225fd76c8b None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:02.161533 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22397f04-5eef-45af-a153-39225fd76c8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:02.207533 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-22397f04-5eef-45af-a153-39225fd76c8b None None] MFA Rules not processed for user `448082629ce24602896bbcc2fa7d49b6`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:20:02.209283 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-22397f04-5eef-45af-a153-39225fd76c8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:20:02.246783 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ff87bc-d9c5-44e5-b4f0-7cb873010409 admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:02.250250 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-15ff87bc-d9c5-44e5-b4f0-7cb873010409 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:20:02.326887 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:20:02.339768 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1337/2657] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:20:02 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:20:02.363330 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22397f04-5eef-45af-a153-39225fd76c8b None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:02.366300 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-22397f04-5eef-45af-a153-39225fd76c8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:20:02.396863 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ff87bc-d9c5-44e5-b4f0-7cb873010409 admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:02.405317 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d5dbb8-82b1-4fa2-8ec0-c31210a83ecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:02.406420 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d5dbb8-82b1-4fa2-8ec0-c31210a83ecf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:02.406881 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d5dbb8-82b1-4fa2-8ec0-c31210a83ecf admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:02.407371 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d5dbb8-82b1-4fa2-8ec0-c31210a83ecf admin admin] PATH_INFO: `/v3/projects/c1afee8b2b49408eaa5051034df0cd3e` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:02.409400 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d5dbb8-82b1-4fa2-8ec0-c31210a83ecf admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1afee8b2b49408eaa5051034df0cd3e)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:02.411596 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d5dbb8-82b1-4fa2-8ec0-c31210a83ecf admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:02.490432 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22397f04-5eef-45af-a153-39225fd76c8b None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:02.509552 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-95d5dbb8-82b1-4fa2-8ec0-c31210a83ecf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1afee8b2b49408eaa5051034df0cd3e', 'request_id': 'req-95d5dbb8-82b1-4fa2-8ec0-c31210a83ecf'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:02.517464 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:20:02.525088 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-95d5dbb8-82b1-4fa2-8ec0-c31210a83ecf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1afee8b2b49408eaa5051034df0cd3e', 'request_id': 'req-95d5dbb8-82b1-4fa2-8ec0-c31210a83ecf'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:02.539215 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-95d5dbb8-82b1-4fa2-8ec0-c31210a83ecf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1afee8b2b49408eaa5051034df0cd3e', 'request_id': 'req-95d5dbb8-82b1-4fa2-8ec0-c31210a83ecf'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:02.576720 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-95d5dbb8-82b1-4fa2-8ec0-c31210a83ecf admin admin] The token cache is being invalidate because project c1afee8b2b49408eaa5051034df0cd3e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81998) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:20:02.579645 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-95d5dbb8-82b1-4fa2-8ec0-c31210a83ecf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:02.580629 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-95d5dbb8-82b1-4fa2-8ec0-c31210a83ecf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:02.582687 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1321/2658] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 30 01:20:02 2022] DELETE /identity/v3/projects/c1afee8b2b49408eaa5051034df0cd3e => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:20:02.614152 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cc6995-1b86-409e-b108-c6cefe250324 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f827c7670b74d938ffe066ced88d1c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:02.615802 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cc6995-1b86-409e-b108-c6cefe250324 service cinder] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:02.617060 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cc6995-1b86-409e-b108-c6cefe250324 service cinder] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:02.617832 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cc6995-1b86-409e-b108-c6cefe250324 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:02.622219 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-e6cc6995-1b86-409e-b108-c6cefe250324 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:20:02.746043 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d5dbb8-82b1-4fa2-8ec0-c31210a83ecf admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:02.749596 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-95d5dbb8-82b1-4fa2-8ec0-c31210a83ecf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:20:02.880832 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cc6995-1b86-409e-b108-c6cefe250324 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:02.888801 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cc6995-1b86-409e-b108-c6cefe250324 service cinder] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:02.903531 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d5dbb8-82b1-4fa2-8ec0-c31210a83ecf admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:02.914582 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3633234-d2bd-4b85-b2aa-3bd8ae93a860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:02.916136 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3633234-d2bd-4b85-b2aa-3bd8ae93a860 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:02.916815 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3633234-d2bd-4b85-b2aa-3bd8ae93a860 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:02.917463 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3633234-d2bd-4b85-b2aa-3bd8ae93a860 admin admin] PATH_INFO: `/v3/users/01fc49c4af7e4f4c80a579c1ce67d143` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:02.920006 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3633234-d2bd-4b85-b2aa-3bd8ae93a860 admin admin] RBAC: Authorizing `identity:delete_user(user_id=01fc49c4af7e4f4c80a579c1ce67d143)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:02.924917 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3633234-d2bd-4b85-b2aa-3bd8ae93a860 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:02.928853 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1338/2659] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:20:02 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 565 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 01:20:03.055167 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-d3633234-d2bd-4b85-b2aa-3bd8ae93a860 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01fc49c4af7e4f4c80a579c1ce67d143'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:03.075336 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-d3633234-d2bd-4b85-b2aa-3bd8ae93a860 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01fc49c4af7e4f4c80a579c1ce67d143'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:03.077217 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:20:03.098307 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cc6995-1b86-409e-b108-c6cefe250324 service cinder] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:03.102146 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-e6cc6995-1b86-409e-b108-c6cefe250324 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:20:03.109574 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-d3633234-d2bd-4b85-b2aa-3bd8ae93a860 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01fc49c4af7e4f4c80a579c1ce67d143'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:03.110321 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-d3633234-d2bd-4b85-b2aa-3bd8ae93a860 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01fc49c4af7e4f4c80a579c1ce67d143'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:03.122091 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cc6995-1b86-409e-b108-c6cefe250324 service cinder] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:03.132450 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-d3633234-d2bd-4b85-b2aa-3bd8ae93a860 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01fc49c4af7e4f4c80a579c1ce67d143'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:03.136482 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb22d49c-869a-468e-88d6-9601616502d5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f827c7670b74d938ffe066ced88d1c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:03.139245 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb22d49c-869a-468e-88d6-9601616502d5 service cinder] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:03.139748 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb22d49c-869a-468e-88d6-9601616502d5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:03.140215 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb22d49c-869a-468e-88d6-9601616502d5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:03.144045 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-eb22d49c-869a-468e-88d6-9601616502d5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:20:03.148063 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1322/2660] 10.222.0.79 () {58 vars in 1224 bytes} [Tue Aug 30 01:20:02 2022] DELETE /identity/v3/users/01fc49c4af7e4f4c80a579c1ce67d143 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:20:03.156811 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634c9086-c869-490b-b697-75e41fb4b2d5 None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:03.157347 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634c9086-c869-490b-b697-75e41fb4b2d5 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:03.157815 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634c9086-c869-490b-b697-75e41fb4b2d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:03.194741 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-634c9086-c869-490b-b697-75e41fb4b2d5 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:20:03.197142 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-634c9086-c869-490b-b697-75e41fb4b2d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:20:03.305312 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb22d49c-869a-468e-88d6-9601616502d5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:03.305781 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1323/2661] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:20:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:20:03.307285 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb22d49c-869a-468e-88d6-9601616502d5 service cinder] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:03.318554 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634c9086-c869-490b-b697-75e41fb4b2d5 None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:03.324138 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-634c9086-c869-490b-b697-75e41fb4b2d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:20:03.329385 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1339/2662] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:20:03 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 01:20:03.440394 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634c9086-c869-490b-b697-75e41fb4b2d5 None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:03.447487 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eda788f-0f21-42c1-bc43-ace4e98600de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16e6a0ca26fc4ef892c188ad89a1e132', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:03.448530 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eda788f-0f21-42c1-bc43-ace4e98600de service neutron] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:03.449138 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eda788f-0f21-42c1-bc43-ace4e98600de service neutron] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:03.450654 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eda788f-0f21-42c1-bc43-ace4e98600de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:03.466127 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eda788f-0f21-42c1-bc43-ace4e98600de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:03.468217 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eda788f-0f21-42c1-bc43-ace4e98600de service neutron] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:03.483065 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1324/2663] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:20:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:20:03.954235 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb22d49c-869a-468e-88d6-9601616502d5 service cinder] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:03.956257 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-eb22d49c-869a-468e-88d6-9601616502d5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:20:03.976540 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb22d49c-869a-468e-88d6-9601616502d5 service cinder] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:03.982109 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f4bcd8-e371-43c0-8e8b-2eff03cb630e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:03.982771 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f4bcd8-e371-43c0-8e8b-2eff03cb630e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:03.983050 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f4bcd8-e371-43c0-8e8b-2eff03cb630e admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:03.983352 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f4bcd8-e371-43c0-8e8b-2eff03cb630e admin admin] PATH_INFO: `/v3/projects/f60e8a3239bc44078455074e48f2bdff` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:03.984543 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f4bcd8-e371-43c0-8e8b-2eff03cb630e admin admin] RBAC: Authorizing `identity:delete_project(project_id=f60e8a3239bc44078455074e48f2bdff)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:03.986848 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f4bcd8-e371-43c0-8e8b-2eff03cb630e admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:04.052138 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-13f4bcd8-e371-43c0-8e8b-2eff03cb630e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f60e8a3239bc44078455074e48f2bdff', 'request_id': 'req-13f4bcd8-e371-43c0-8e8b-2eff03cb630e'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:04.063870 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-13f4bcd8-e371-43c0-8e8b-2eff03cb630e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f60e8a3239bc44078455074e48f2bdff', 'request_id': 'req-13f4bcd8-e371-43c0-8e8b-2eff03cb630e'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:04.068412 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:20:04.081856 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-13f4bcd8-e371-43c0-8e8b-2eff03cb630e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f60e8a3239bc44078455074e48f2bdff', 'request_id': 'req-13f4bcd8-e371-43c0-8e8b-2eff03cb630e'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:04.102572 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-13f4bcd8-e371-43c0-8e8b-2eff03cb630e admin admin] The token cache is being invalidate because project f60e8a3239bc44078455074e48f2bdff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:20:04.102973 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-13f4bcd8-e371-43c0-8e8b-2eff03cb630e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:04.103953 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-13f4bcd8-e371-43c0-8e8b-2eff03cb630e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:04.106487 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1340/2664] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 30 01:20:03 2022] DELETE /identity/v3/projects/f60e8a3239bc44078455074e48f2bdff => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:20:04.112527 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6426c44e-3e0c-411c-b099-3fcf82d16aa9 None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:04.113954 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6426c44e-3e0c-411c-b099-3fcf82d16aa9 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:04.113954 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6426c44e-3e0c-411c-b099-3fcf82d16aa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:04.154816 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-6426c44e-3e0c-411c-b099-3fcf82d16aa9 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:20:04.157069 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-6426c44e-3e0c-411c-b099-3fcf82d16aa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:20:04.253909 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1325/2665] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:20:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:20:04.263295 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480d77d7-046a-47b0-a195-56f171305122 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:04.263636 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480d77d7-046a-47b0-a195-56f171305122 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:04.263881 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480d77d7-046a-47b0-a195-56f171305122 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:04.297110 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-480d77d7-046a-47b0-a195-56f171305122 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:20:04.299816 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-480d77d7-046a-47b0-a195-56f171305122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:20:04.310311 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1341/2666] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:20:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:20:04.314419 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6426c44e-3e0c-411c-b099-3fcf82d16aa9 None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:04.329444 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6426c44e-3e0c-411c-b099-3fcf82d16aa9 None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:04.336115 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f36c74e-8e07-4f68-8379-7960eeacf3d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:04.336826 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f36c74e-8e07-4f68-8379-7960eeacf3d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:04.337298 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f36c74e-8e07-4f68-8379-7960eeacf3d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:04.337639 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f36c74e-8e07-4f68-8379-7960eeacf3d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:04.338440 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f36c74e-8e07-4f68-8379-7960eeacf3d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:20:04.338828 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f36c74e-8e07-4f68-8379-7960eeacf3d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:04.340699 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f36c74e-8e07-4f68-8379-7960eeacf3d5 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:04.362586 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1326/2667] 10.222.0.79 () {58 vars in 1153 bytes} [Tue Aug 30 01:20:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:20:04.362812 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480d77d7-046a-47b0-a195-56f171305122 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:04.372945 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480d77d7-046a-47b0-a195-56f171305122 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:04.380518 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33301304-5de4-437b-b7a4-89a86b1a515f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:04.381670 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33301304-5de4-437b-b7a4-89a86b1a515f admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:04.382208 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33301304-5de4-437b-b7a4-89a86b1a515f admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:04.382652 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33301304-5de4-437b-b7a4-89a86b1a515f admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:04.383785 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33301304-5de4-437b-b7a4-89a86b1a515f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:04.386834 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33301304-5de4-437b-b7a4-89a86b1a515f admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:04.457995 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1342/2668] 10.222.0.79 () {60 vars in 1153 bytes} [Tue Aug 30 01:20:04 2022] POST /identity/v3/projects => generated 379 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:20:04.467959 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f36c74e-8e07-4f68-8379-7960eeacf3d5 admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:04.483735 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:20:04.495968 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f36c74e-8e07-4f68-8379-7960eeacf3d5 admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:04.617297 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77f6e2a-7898-40f3-9553-e2c57a5c0a3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:04.618291 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77f6e2a-7898-40f3-9553-e2c57a5c0a3b admin admin] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:04.618632 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77f6e2a-7898-40f3-9553-e2c57a5c0a3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:04.618971 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77f6e2a-7898-40f3-9553-e2c57a5c0a3b admin admin] PATH_INFO: `/v3/users` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:04.619742 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77f6e2a-7898-40f3-9553-e2c57a5c0a3b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:04.622305 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77f6e2a-7898-40f3-9553-e2c57a5c0a3b admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:04.672619 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1327/2669] 10.222.0.79 () {60 vars in 1144 bytes} [Tue Aug 30 01:20:04 2022] POST /identity/v3/users => generated 290 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:20:04.676228 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33301304-5de4-437b-b7a4-89a86b1a515f admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:04.689402 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33301304-5de4-437b-b7a4-89a86b1a515f admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:04.694876 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b54cf1-74c2-4e12-a982-787928c5798d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:04.695541 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b54cf1-74c2-4e12-a982-787928c5798d admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:04.695860 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b54cf1-74c2-4e12-a982-787928c5798d admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:04.696098 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b54cf1-74c2-4e12-a982-787928c5798d admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:04.696743 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b54cf1-74c2-4e12-a982-787928c5798d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:04.698473 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b54cf1-74c2-4e12-a982-787928c5798d admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:04.712090 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1343/2670] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:20:04 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:20:04.718365 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77f6e2a-7898-40f3-9553-e2c57a5c0a3b admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:04.730773 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77f6e2a-7898-40f3-9553-e2c57a5c0a3b admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:04.736591 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e632c01d-2af1-4c4b-bd05-e4acd1912dd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:04.737232 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e632c01d-2af1-4c4b-bd05-e4acd1912dd4 admin admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:04.737653 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e632c01d-2af1-4c4b-bd05-e4acd1912dd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:04.738064 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e632c01d-2af1-4c4b-bd05-e4acd1912dd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:04.739065 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e632c01d-2af1-4c4b-bd05-e4acd1912dd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:04.741345 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e632c01d-2af1-4c4b-bd05-e4acd1912dd4 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:04.756523 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1328/2671] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:20:04 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:20:04.764594 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b54cf1-74c2-4e12-a982-787928c5798d admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:04.785119 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b54cf1-74c2-4e12-a982-787928c5798d admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:04.796657 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf80e93b-4698-45da-b6ce-e399b03cf631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:04.797236 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf80e93b-4698-45da-b6ce-e399b03cf631 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:04.798239 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf80e93b-4698-45da-b6ce-e399b03cf631 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:04.798239 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf80e93b-4698-45da-b6ce-e399b03cf631 admin admin] PATH_INFO: `/v3/projects/2820e32fc5314652b664bf10eed383e9/users/1e819844fc6a4f749437f35c95f9cc04/roles/c37945a17623465f899d4f217e7af593` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:04.830153 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf80e93b-4698-45da-b6ce-e399b03cf631 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2820e32fc5314652b664bf10eed383e9, user_id=1e819844fc6a4f749437f35c95f9cc04, role_id=c37945a17623465f899d4f217e7af593)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:04.836366 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf80e93b-4698-45da-b6ce-e399b03cf631 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:04.874259 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1344/2672] 10.222.0.79 () {60 vars in 1483 bytes} [Tue Aug 30 01:20:04 2022] PUT /identity/v3/projects/2820e32fc5314652b664bf10eed383e9/users/1e819844fc6a4f749437f35c95f9cc04/roles/c37945a17623465f899d4f217e7af593 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:20:04.881149 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6278f16-2d61-4d00-af37-1c950c31705d None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:04.882155 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6278f16-2d61-4d00-af37-1c950c31705d None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:04.882589 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6278f16-2d61-4d00-af37-1c950c31705d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:04.940056 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-d6278f16-2d61-4d00-af37-1c950c31705d None None] MFA Rules not processed for user `1e819844fc6a4f749437f35c95f9cc04`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:20:04.942746 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-d6278f16-2d61-4d00-af37-1c950c31705d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:20:05.122287 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1329/2673] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:20:04 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:20:05.128151 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf80e93b-4698-45da-b6ce-e399b03cf631 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:05.222746 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6278f16-2d61-4d00-af37-1c950c31705d None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:05.225739 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-d6278f16-2d61-4d00-af37-1c950c31705d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:20:05.269558 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf80e93b-4698-45da-b6ce-e399b03cf631 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:05.279386 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5119231-c0df-44f5-a440-c04d9970a19b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:05.280651 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5119231-c0df-44f5-a440-c04d9970a19b admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:05.281101 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5119231-c0df-44f5-a440-c04d9970a19b admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:05.281570 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5119231-c0df-44f5-a440-c04d9970a19b admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:05.283067 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5119231-c0df-44f5-a440-c04d9970a19b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:05.286632 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5119231-c0df-44f5-a440-c04d9970a19b admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:05.353175 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1345/2674] 10.222.0.79 () {60 vars in 1153 bytes} [Tue Aug 30 01:20:05 2022] POST /identity/v3/projects => generated 375 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:20:05.355567 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5119231-c0df-44f5-a440-c04d9970a19b admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:05.359663 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6278f16-2d61-4d00-af37-1c950c31705d None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:05.383190 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:20:05.450267 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87ac6e1-735d-40a2-82b6-66172f393de7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:05.451352 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87ac6e1-735d-40a2-82b6-66172f393de7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:05.451752 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87ac6e1-735d-40a2-82b6-66172f393de7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:05.452169 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87ac6e1-735d-40a2-82b6-66172f393de7 admin admin] PATH_INFO: `/v3/users/ef92b49bac944122b2a24db6da89d7f0` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:05.454213 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87ac6e1-735d-40a2-82b6-66172f393de7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef92b49bac944122b2a24db6da89d7f0)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:05.458048 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87ac6e1-735d-40a2-82b6-66172f393de7 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:05.484618 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5119231-c0df-44f5-a440-c04d9970a19b admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:05.492637 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af93ae2-e6d9-4b8d-8f64-9d6def264653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:05.493254 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af93ae2-e6d9-4b8d-8f64-9d6def264653 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:05.493548 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af93ae2-e6d9-4b8d-8f64-9d6def264653 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:05.493807 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af93ae2-e6d9-4b8d-8f64-9d6def264653 admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:05.494449 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af93ae2-e6d9-4b8d-8f64-9d6def264653 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:05.496484 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af93ae2-e6d9-4b8d-8f64-9d6def264653 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:05.518005 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=93,keystone:DELETE=1,keystone:INSERT=6 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:20:05.533500 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1346/2675] 10.222.0.79 () {60 vars in 1144 bytes} [Tue Aug 30 01:20:05 2022] POST /identity/v3/users => generated 294 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:20:05.538355 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af93ae2-e6d9-4b8d-8f64-9d6def264653 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:05.549131 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-b87ac6e1-735d-40a2-82b6-66172f393de7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef92b49bac944122b2a24db6da89d7f0'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:05.551058 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af93ae2-e6d9-4b8d-8f64-9d6def264653 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:05.557287 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39947ff-0a90-49dd-95c4-288b54eb98c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:05.558215 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39947ff-0a90-49dd-95c4-288b54eb98c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:05.558635 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39947ff-0a90-49dd-95c4-288b54eb98c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:05.558917 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39947ff-0a90-49dd-95c4-288b54eb98c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:05.559676 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39947ff-0a90-49dd-95c4-288b54eb98c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:05.561441 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39947ff-0a90-49dd-95c4-288b54eb98c5 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:05.564405 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-b87ac6e1-735d-40a2-82b6-66172f393de7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef92b49bac944122b2a24db6da89d7f0'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:05.573249 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1347/2676] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:20:05 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 01:20:05.577707 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39947ff-0a90-49dd-95c4-288b54eb98c5 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:05.588744 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39947ff-0a90-49dd-95c4-288b54eb98c5 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:05.589076 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-b87ac6e1-735d-40a2-82b6-66172f393de7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef92b49bac944122b2a24db6da89d7f0'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:05.589803 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-b87ac6e1-735d-40a2-82b6-66172f393de7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef92b49bac944122b2a24db6da89d7f0'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:05.593851 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c50274-2761-4126-8f32-f5416eeb2e7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:05.594524 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c50274-2761-4126-8f32-f5416eeb2e7a admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:05.594802 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c50274-2761-4126-8f32-f5416eeb2e7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:05.595069 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c50274-2761-4126-8f32-f5416eeb2e7a admin admin] PATH_INFO: `/v3/projects/aaa6b1bcd1f54d71a7832ff4c42ee4f5/users/3593795ae541491fbae5c14807e6d07a/roles/d14c3070c9184d76a7b23df69bd3db07` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:05.601795 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-b87ac6e1-735d-40a2-82b6-66172f393de7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef92b49bac944122b2a24db6da89d7f0'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:05.610566 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1330/2677] 10.222.0.79 () {58 vars in 1224 bytes} [Tue Aug 30 01:20:05 2022] DELETE /identity/v3/users/ef92b49bac944122b2a24db6da89d7f0 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:20:05.615818 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c50274-2761-4126-8f32-f5416eeb2e7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=aaa6b1bcd1f54d71a7832ff4c42ee4f5, user_id=3593795ae541491fbae5c14807e6d07a, role_id=d14c3070c9184d76a7b23df69bd3db07)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:05.621299 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c50274-2761-4126-8f32-f5416eeb2e7a admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:05.640897 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1348/2678] 10.222.0.79 () {60 vars in 1483 bytes} [Tue Aug 30 01:20:05 2022] PUT /identity/v3/projects/aaa6b1bcd1f54d71a7832ff4c42ee4f5/users/3593795ae541491fbae5c14807e6d07a/roles/d14c3070c9184d76a7b23df69bd3db07 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:20:05.645807 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87ac6e1-735d-40a2-82b6-66172f393de7 admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:05.648444 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-b87ac6e1-735d-40a2-82b6-66172f393de7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:20:05.781229 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87ac6e1-735d-40a2-82b6-66172f393de7 admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:05.884344 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c50274-2761-4126-8f32-f5416eeb2e7a admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:05.886005 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:20:05.887066 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-f6c50274-2761-4126-8f32-f5416eeb2e7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:20:05.916863 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087f7515-43d0-4462-8cc8-bf7522a0d05c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:05.917861 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087f7515-43d0-4462-8cc8-bf7522a0d05c admin admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:05.918329 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087f7515-43d0-4462-8cc8-bf7522a0d05c admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:05.918800 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087f7515-43d0-4462-8cc8-bf7522a0d05c admin admin] PATH_INFO: `/v3/roles` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:05.919921 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087f7515-43d0-4462-8cc8-bf7522a0d05c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:05.922878 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087f7515-43d0-4462-8cc8-bf7522a0d05c admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:05.942002 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1331/2679] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:20:05 2022] GET /identity/v3/roles => generated 1420 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:20:05.947008 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087f7515-43d0-4462-8cc8-bf7522a0d05c admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:05.957871 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087f7515-43d0-4462-8cc8-bf7522a0d05c admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:05.964309 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04e4040-5804-4b13-ab39-c2704a60e9d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:05.964994 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04e4040-5804-4b13-ab39-c2704a60e9d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:05.965260 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04e4040-5804-4b13-ab39-c2704a60e9d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:05.965530 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04e4040-5804-4b13-ab39-c2704a60e9d4 admin admin] PATH_INFO: `/v3/projects/aaa6b1bcd1f54d71a7832ff4c42ee4f5/users/3593795ae541491fbae5c14807e6d07a/roles/d14c3070c9184d76a7b23df69bd3db07` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:05.967715 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04e4040-5804-4b13-ab39-c2704a60e9d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aaa6b1bcd1f54d71a7832ff4c42ee4f5, user_id=3593795ae541491fbae5c14807e6d07a, role_id=d14c3070c9184d76a7b23df69bd3db07)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:05.970248 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04e4040-5804-4b13-ab39-c2704a60e9d4 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:05.984027 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1332/2680] 10.222.0.79 () {60 vars in 1483 bytes} [Tue Aug 30 01:20:05 2022] PUT /identity/v3/projects/aaa6b1bcd1f54d71a7832ff4c42ee4f5/users/3593795ae541491fbae5c14807e6d07a/roles/d14c3070c9184d76a7b23df69bd3db07 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:20:05.996532 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a5ee6a-2a0d-4454-b3b7-8a818512a2f2 None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:05.996814 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a5ee6a-2a0d-4454-b3b7-8a818512a2f2 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:05.997084 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a5ee6a-2a0d-4454-b3b7-8a818512a2f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:05.998635 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c50274-2761-4126-8f32-f5416eeb2e7a admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:06.085495 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27260823-d6c8-4717-a481-41b13ca61dd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:06.086157 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27260823-d6c8-4717-a481-41b13ca61dd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:06.086430 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27260823-d6c8-4717-a481-41b13ca61dd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:06.086705 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27260823-d6c8-4717-a481-41b13ca61dd5 admin admin] PATH_INFO: `/v3/projects/0a751c73b64d4c5197b9e072fb7f6952` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:06.088033 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27260823-d6c8-4717-a481-41b13ca61dd5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a751c73b64d4c5197b9e072fb7f6952)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:06.089965 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27260823-d6c8-4717-a481-41b13ca61dd5 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:06.149882 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-27260823-d6c8-4717-a481-41b13ca61dd5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a751c73b64d4c5197b9e072fb7f6952', 'request_id': 'req-27260823-d6c8-4717-a481-41b13ca61dd5'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:06.158575 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-93a5ee6a-2a0d-4454-b3b7-8a818512a2f2 None None] MFA Rules not processed for user `3593795ae541491fbae5c14807e6d07a`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:20:06.159946 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-93a5ee6a-2a0d-4454-b3b7-8a818512a2f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:20:06.161876 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-27260823-d6c8-4717-a481-41b13ca61dd5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a751c73b64d4c5197b9e072fb7f6952', 'request_id': 'req-27260823-d6c8-4717-a481-41b13ca61dd5'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:06.173161 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-27260823-d6c8-4717-a481-41b13ca61dd5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a751c73b64d4c5197b9e072fb7f6952', 'request_id': 'req-27260823-d6c8-4717-a481-41b13ca61dd5'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:06.187083 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:20:06.195611 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-27260823-d6c8-4717-a481-41b13ca61dd5 admin admin] The token cache is being invalidate because project 0a751c73b64d4c5197b9e072fb7f6952 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:20:06.197504 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-27260823-d6c8-4717-a481-41b13ca61dd5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:06.199020 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-27260823-d6c8-4717-a481-41b13ca61dd5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:06.202021 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1349/2681] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 30 01:20:05 2022] DELETE /identity/v3/projects/0a751c73b64d4c5197b9e072fb7f6952 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:20:06.210029 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37cda08-dc3f-4bea-b97d-077ebca323a4 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:06.210620 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37cda08-dc3f-4bea-b97d-077ebca323a4 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:06.210992 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37cda08-dc3f-4bea-b97d-077ebca323a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:06.238923 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-b37cda08-dc3f-4bea-b97d-077ebca323a4 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:20:06.242649 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-b37cda08-dc3f-4bea-b97d-077ebca323a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:20:06.268650 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1333/2682] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:20:05 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:20:06.287436 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a5ee6a-2a0d-4454-b3b7-8a818512a2f2 None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:06.289777 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-93a5ee6a-2a0d-4454-b3b7-8a818512a2f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:20:06.351426 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1350/2683] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:20:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:20:06.354073 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07834946-d5f5-42e7-a2e9-c8b2c3ea2301 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:06.354365 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07834946-d5f5-42e7-a2e9-c8b2c3ea2301 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:06.354952 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07834946-d5f5-42e7-a2e9-c8b2c3ea2301 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:06.376978 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-07834946-d5f5-42e7-a2e9-c8b2c3ea2301 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:20:06.383483 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a5ee6a-2a0d-4454-b3b7-8a818512a2f2 None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:06.384337 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-07834946-d5f5-42e7-a2e9-c8b2c3ea2301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:20:06.387815 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f32a22-5f85-42ff-941e-7dc3f44d99e0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f827c7670b74d938ffe066ced88d1c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:06.388430 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f32a22-5f85-42ff-941e-7dc3f44d99e0 service cinder] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:06.388709 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f32a22-5f85-42ff-941e-7dc3f44d99e0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:06.388976 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f32a22-5f85-42ff-941e-7dc3f44d99e0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:06.390915 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-95f32a22-5f85-42ff-941e-7dc3f44d99e0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:20:06.398606 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1351/2684] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:20:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:20:06.405626 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07834946-d5f5-42e7-a2e9-c8b2c3ea2301 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:06.417915 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07834946-d5f5-42e7-a2e9-c8b2c3ea2301 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:06.423875 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb1d8f7-d601-4251-bc10-6845119b4db3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:06.423875 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb1d8f7-d601-4251-bc10-6845119b4db3 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:06.424228 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb1d8f7-d601-4251-bc10-6845119b4db3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:06.424415 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb1d8f7-d601-4251-bc10-6845119b4db3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:06.425085 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb1d8f7-d601-4251-bc10-6845119b4db3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:20:06.425394 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb1d8f7-d601-4251-bc10-6845119b4db3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:06.427090 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb1d8f7-d601-4251-bc10-6845119b4db3 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:06.451043 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1352/2685] 10.222.0.79 () {58 vars in 1153 bytes} [Tue Aug 30 01:20:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:20:06.458162 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb1d8f7-d601-4251-bc10-6845119b4db3 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:06.477714 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb1d8f7-d601-4251-bc10-6845119b4db3 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:06.485060 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5034ccb-bb53-4baa-ada7-c2d688f066bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:06.486041 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5034ccb-bb53-4baa-ada7-c2d688f066bf admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:06.486498 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5034ccb-bb53-4baa-ada7-c2d688f066bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:06.486951 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5034ccb-bb53-4baa-ada7-c2d688f066bf admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:06.488097 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5034ccb-bb53-4baa-ada7-c2d688f066bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:06.492556 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5034ccb-bb53-4baa-ada7-c2d688f066bf admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:06.499301 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f32a22-5f85-42ff-941e-7dc3f44d99e0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:06.501755 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f32a22-5f85-42ff-941e-7dc3f44d99e0 service cinder] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:06.516246 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1334/2686] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:20:06 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 01:20:06.517452 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f32a22-5f85-42ff-941e-7dc3f44d99e0 service cinder] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:06.519988 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-95f32a22-5f85-42ff-941e-7dc3f44d99e0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:20:06.540089 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1353/2687] 10.222.0.79 () {60 vars in 1153 bytes} [Tue Aug 30 01:20:06 2022] POST /identity/v3/projects => generated 405 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:20:06.541415 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f32a22-5f85-42ff-941e-7dc3f44d99e0 service cinder] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:06.546013 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5034ccb-bb53-4baa-ada7-c2d688f066bf admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:06.550764 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:20:06.653538 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f093a5-d101-46cd-a8db-cb7da82f4935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:06.654650 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f093a5-d101-46cd-a8db-cb7da82f4935 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:06.655122 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f093a5-d101-46cd-a8db-cb7da82f4935 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:06.655823 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f093a5-d101-46cd-a8db-cb7da82f4935 admin admin] PATH_INFO: `/v3/users/a59becc03dab430aa81fa5cdb012d9cf` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:06.657999 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f093a5-d101-46cd-a8db-cb7da82f4935 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a59becc03dab430aa81fa5cdb012d9cf)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:06.661260 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f093a5-d101-46cd-a8db-cb7da82f4935 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:06.672730 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5034ccb-bb53-4baa-ada7-c2d688f066bf admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:06.679366 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04e2567-2cdf-4426-86bd-e6d87ab5ead2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:06.680172 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04e2567-2cdf-4426-86bd-e6d87ab5ead2 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:06.680605 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04e2567-2cdf-4426-86bd-e6d87ab5ead2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:06.681016 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04e2567-2cdf-4426-86bd-e6d87ab5ead2 admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:06.682789 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04e2567-2cdf-4426-86bd-e6d87ab5ead2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:06.688505 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04e2567-2cdf-4426-86bd-e6d87ab5ead2 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:06.728228 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1354/2688] 10.222.0.79 () {60 vars in 1144 bytes} [Tue Aug 30 01:20:06 2022] POST /identity/v3/users => generated 303 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:20:06.734180 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04e2567-2cdf-4426-86bd-e6d87ab5ead2 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:06.751351 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04e2567-2cdf-4426-86bd-e6d87ab5ead2 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:06.759782 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9f1527-41c3-4625-a8ec-57ed59d06faa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:06.761026 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9f1527-41c3-4625-a8ec-57ed59d06faa admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:06.761392 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9f1527-41c3-4625-a8ec-57ed59d06faa admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:06.761751 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9f1527-41c3-4625-a8ec-57ed59d06faa admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:06.762508 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9f1527-41c3-4625-a8ec-57ed59d06faa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:06.764461 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-77f093a5-d101-46cd-a8db-cb7da82f4935 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a59becc03dab430aa81fa5cdb012d9cf'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:06.764790 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9f1527-41c3-4625-a8ec-57ed59d06faa admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:06.779926 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-77f093a5-d101-46cd-a8db-cb7da82f4935 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a59becc03dab430aa81fa5cdb012d9cf'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:06.784044 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1355/2689] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:20:06 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 01:20:06.789819 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9f1527-41c3-4625-a8ec-57ed59d06faa admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:06.806024 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-77f093a5-d101-46cd-a8db-cb7da82f4935 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a59becc03dab430aa81fa5cdb012d9cf'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:06.807543 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-77f093a5-d101-46cd-a8db-cb7da82f4935 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a59becc03dab430aa81fa5cdb012d9cf'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:06.808522 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9f1527-41c3-4625-a8ec-57ed59d06faa admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:06.816834 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99290c1c-3f98-4ad0-b0a7-4597084fea70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:06.818278 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99290c1c-3f98-4ad0-b0a7-4597084fea70 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:06.819365 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99290c1c-3f98-4ad0-b0a7-4597084fea70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:06.820431 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99290c1c-3f98-4ad0-b0a7-4597084fea70 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:06.820885 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99290c1c-3f98-4ad0-b0a7-4597084fea70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:06.823461 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-77f093a5-d101-46cd-a8db-cb7da82f4935 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a59becc03dab430aa81fa5cdb012d9cf'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:06.824055 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99290c1c-3f98-4ad0-b0a7-4597084fea70 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:06.837013 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1335/2690] 10.222.0.79 () {58 vars in 1224 bytes} [Tue Aug 30 01:20:06 2022] DELETE /identity/v3/users/a59becc03dab430aa81fa5cdb012d9cf => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:20:06.840847 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1356/2691] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:20:06 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 01:20:06.844877 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec34e2d2-a2db-4385-8e49-293770011918 None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:06.845239 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec34e2d2-a2db-4385-8e49-293770011918 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:06.845415 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec34e2d2-a2db-4385-8e49-293770011918 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:06.846142 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99290c1c-3f98-4ad0-b0a7-4597084fea70 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:06.848537 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-99290c1c-3f98-4ad0-b0a7-4597084fea70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:20:06.872075 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99290c1c-3f98-4ad0-b0a7-4597084fea70 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:06.883306 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-ec34e2d2-a2db-4385-8e49-293770011918 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:20:06.885174 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-ec34e2d2-a2db-4385-8e49-293770011918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:20:06.914056 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:20:06.998493 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6624b0-1018-46f3-b4a4-08ac6f13d98c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:07.003337 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6624b0-1018-46f3-b4a4-08ac6f13d98c admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:07.003816 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6624b0-1018-46f3-b4a4-08ac6f13d98c admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:07.004372 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6624b0-1018-46f3-b4a4-08ac6f13d98c admin admin] PATH_INFO: `/v3/projects/8fde8f171a6647bc85f9c5ce3343c21a/users/eaaa6aa9199741d9b9e2ffd652cbea40/roles/c37945a17623465f899d4f217e7af593` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:07.044897 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6624b0-1018-46f3-b4a4-08ac6f13d98c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8fde8f171a6647bc85f9c5ce3343c21a, user_id=eaaa6aa9199741d9b9e2ffd652cbea40, role_id=c37945a17623465f899d4f217e7af593)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:07.051323 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6624b0-1018-46f3-b4a4-08ac6f13d98c admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:07.054435 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1336/2692] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:20:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:20:07.070854 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec34e2d2-a2db-4385-8e49-293770011918 None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:07.073300 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-ec34e2d2-a2db-4385-8e49-293770011918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:20:07.087301 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1357/2693] 10.222.0.79 () {60 vars in 1483 bytes} [Tue Aug 30 01:20:06 2022] PUT /identity/v3/projects/8fde8f171a6647bc85f9c5ce3343c21a/users/eaaa6aa9199741d9b9e2ffd652cbea40/roles/c37945a17623465f899d4f217e7af593 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:20:07.098616 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bdf104-e9b1-4e73-99e2-bbc185f635fb None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:07.099002 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bdf104-e9b1-4e73-99e2-bbc185f635fb None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:07.099328 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bdf104-e9b1-4e73-99e2-bbc185f635fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:07.135065 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:20:07.136556 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-37bdf104-e9b1-4e73-99e2-bbc185f635fb None None] MFA Rules not processed for user `eaaa6aa9199741d9b9e2ffd652cbea40`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:20:07.138122 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-37bdf104-e9b1-4e73-99e2-bbc185f635fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:20:07.183636 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec34e2d2-a2db-4385-8e49-293770011918 None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:07.240031 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1358/2694] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:20:07 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:20:07.247163 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bdf104-e9b1-4e73-99e2-bbc185f635fb None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:07.263934 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f495fec-d560-406a-b3b4-73612df6642c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16e6a0ca26fc4ef892c188ad89a1e132', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:07.264775 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f495fec-d560-406a-b3b4-73612df6642c service neutron] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:07.265218 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f495fec-d560-406a-b3b4-73612df6642c service neutron] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:07.265668 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f495fec-d560-406a-b3b4-73612df6642c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:07.354096 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bdf104-e9b1-4e73-99e2-bbc185f635fb None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:07.359619 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f5e49e-5991-464b-8a73-f178d858dcd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:07.361100 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f5e49e-5991-464b-8a73-f178d858dcd7 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:07.361355 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f5e49e-5991-464b-8a73-f178d858dcd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:07.361636 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f5e49e-5991-464b-8a73-f178d858dcd7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:07.362484 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f5e49e-5991-464b-8a73-f178d858dcd7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:07.364646 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f5e49e-5991-464b-8a73-f178d858dcd7 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:07.376349 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f495fec-d560-406a-b3b4-73612df6642c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:07.378637 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f495fec-d560-406a-b3b4-73612df6642c service neutron] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:07.394388 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1337/2695] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:20:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:20:07.409025 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1359/2696] 10.222.0.79 () {60 vars in 1153 bytes} [Tue Aug 30 01:20:07 2022] POST /identity/v3/projects => generated 403 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:20:07.414148 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f495fec-d560-406a-b3b4-73612df6642c service neutron] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:07.431767 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f495fec-d560-406a-b3b4-73612df6642c service neutron] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:07.518279 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1959da9-530a-458d-a430-c584e8b3708d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:07.518818 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1959da9-530a-458d-a430-c584e8b3708d admin admin] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:07.519096 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1959da9-530a-458d-a430-c584e8b3708d admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:07.519398 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1959da9-530a-458d-a430-c584e8b3708d admin admin] PATH_INFO: `/v3/users` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:07.520044 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1959da9-530a-458d-a430-c584e8b3708d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:07.522603 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1959da9-530a-458d-a430-c584e8b3708d admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:07.555826 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1338/2697] 10.222.0.79 () {60 vars in 1144 bytes} [Tue Aug 30 01:20:07 2022] POST /identity/v3/users => generated 308 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:20:07.557243 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f5e49e-5991-464b-8a73-f178d858dcd7 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:07.569890 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f5e49e-5991-464b-8a73-f178d858dcd7 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:07.575742 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e6c6a4-ce18-4984-be69-2e895d95e573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:07.576503 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e6c6a4-ce18-4984-be69-2e895d95e573 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:07.577017 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e6c6a4-ce18-4984-be69-2e895d95e573 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:07.577515 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e6c6a4-ce18-4984-be69-2e895d95e573 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:07.578371 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e6c6a4-ce18-4984-be69-2e895d95e573 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:07.580423 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e6c6a4-ce18-4984-be69-2e895d95e573 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:07.594389 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1360/2698] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:20:07 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:20:07.599017 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1959da9-530a-458d-a430-c584e8b3708d admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:07.610090 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1959da9-530a-458d-a430-c584e8b3708d admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:07.616729 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc77abaf-a19e-4979-933b-f69f6ebc2940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:07.617571 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc77abaf-a19e-4979-933b-f69f6ebc2940 admin admin] REQUEST_METHOD: `PUT` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:07.618032 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc77abaf-a19e-4979-933b-f69f6ebc2940 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:07.618488 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc77abaf-a19e-4979-933b-f69f6ebc2940 admin admin] PATH_INFO: `/v3/projects/1615e50a740745fda3a4887b4c47756f/users/c68b2f40bd7840f49524c07bfca1ebbf/roles/d14c3070c9184d76a7b23df69bd3db07` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:07.649644 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc77abaf-a19e-4979-933b-f69f6ebc2940 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1615e50a740745fda3a4887b4c47756f, user_id=c68b2f40bd7840f49524c07bfca1ebbf, role_id=d14c3070c9184d76a7b23df69bd3db07)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:07.655014 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc77abaf-a19e-4979-933b-f69f6ebc2940 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:07.674821 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:20:07.685972 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1339/2699] 10.222.0.79 () {60 vars in 1483 bytes} [Tue Aug 30 01:20:07 2022] PUT /identity/v3/projects/1615e50a740745fda3a4887b4c47756f/users/c68b2f40bd7840f49524c07bfca1ebbf/roles/d14c3070c9184d76a7b23df69bd3db07 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:20:07.691944 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e6c6a4-ce18-4984-be69-2e895d95e573 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:07.706128 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e6c6a4-ce18-4984-be69-2e895d95e573 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:07.720084 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:20:07.791885 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc77abaf-a19e-4979-933b-f69f6ebc2940 admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:07.794479 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-fc77abaf-a19e-4979-933b-f69f6ebc2940 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:20:07.808610 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c511600d-a57f-461e-a7e7-3994803e12f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:07.809641 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c511600d-a57f-461e-a7e7-3994803e12f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:07.810031 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c511600d-a57f-461e-a7e7-3994803e12f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:07.810540 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c511600d-a57f-461e-a7e7-3994803e12f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:07.811882 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c511600d-a57f-461e-a7e7-3994803e12f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:07.814545 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c511600d-a57f-461e-a7e7-3994803e12f7 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:07.843210 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1361/2700] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:20:07 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:20:07.848821 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c511600d-a57f-461e-a7e7-3994803e12f7 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:07.860491 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c511600d-a57f-461e-a7e7-3994803e12f7 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:07.865550 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2b06c0-3c46-4d1d-ac41-cdba4a35bbdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:07.866704 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2b06c0-3c46-4d1d-ac41-cdba4a35bbdd admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:07.867074 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2b06c0-3c46-4d1d-ac41-cdba4a35bbdd admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:07.867397 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2b06c0-3c46-4d1d-ac41-cdba4a35bbdd admin admin] PATH_INFO: `/v3/projects/1615e50a740745fda3a4887b4c47756f/users/c68b2f40bd7840f49524c07bfca1ebbf/roles/d14c3070c9184d76a7b23df69bd3db07` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:07.869451 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2b06c0-3c46-4d1d-ac41-cdba4a35bbdd admin admin] RBAC: Authorizing `identity:create_grant(project_id=1615e50a740745fda3a4887b4c47756f, user_id=c68b2f40bd7840f49524c07bfca1ebbf, role_id=d14c3070c9184d76a7b23df69bd3db07)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:07.872233 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2b06c0-3c46-4d1d-ac41-cdba4a35bbdd admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:07.884651 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1362/2701] 10.222.0.79 () {60 vars in 1483 bytes} [Tue Aug 30 01:20:07 2022] PUT /identity/v3/projects/1615e50a740745fda3a4887b4c47756f/users/c68b2f40bd7840f49524c07bfca1ebbf/roles/d14c3070c9184d76a7b23df69bd3db07 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:20:07.901483 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd641d9-2079-4538-b382-e85cf7158118 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:07.902050 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd641d9-2079-4538-b382-e85cf7158118 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:07.902290 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc77abaf-a19e-4979-933b-f69f6ebc2940 admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:07.902537 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd641d9-2079-4538-b382-e85cf7158118 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:07.935953 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-fcd641d9-2079-4538-b382-e85cf7158118 None None] MFA Rules not processed for user `c68b2f40bd7840f49524c07bfca1ebbf`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:20:07.937229 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-fcd641d9-2079-4538-b382-e85cf7158118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:20:08.000730 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd43e948-2c2c-4d87-8c31-913535c9ea8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:08.001776 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd43e948-2c2c-4d87-8c31-913535c9ea8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:08.002259 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd43e948-2c2c-4d87-8c31-913535c9ea8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:08.002721 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd43e948-2c2c-4d87-8c31-913535c9ea8d admin admin] PATH_INFO: `/v3/projects/9f63ad1896f34188a4bb07dca6f83203` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:08.004780 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd43e948-2c2c-4d87-8c31-913535c9ea8d admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f63ad1896f34188a4bb07dca6f83203)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:08.009707 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd43e948-2c2c-4d87-8c31-913535c9ea8d admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:08.026781 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1363/2702] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:20:07 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:20:08.046732 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd641d9-2079-4538-b382-e85cf7158118 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:08.049899 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-fcd641d9-2079-4538-b382-e85cf7158118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:20:08.085050 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-bd43e948-2c2c-4d87-8c31-913535c9ea8d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f63ad1896f34188a4bb07dca6f83203', 'request_id': 'req-bd43e948-2c2c-4d87-8c31-913535c9ea8d'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:08.098969 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-bd43e948-2c2c-4d87-8c31-913535c9ea8d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f63ad1896f34188a4bb07dca6f83203', 'request_id': 'req-bd43e948-2c2c-4d87-8c31-913535c9ea8d'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:08.122655 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-bd43e948-2c2c-4d87-8c31-913535c9ea8d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f63ad1896f34188a4bb07dca6f83203', 'request_id': 'req-bd43e948-2c2c-4d87-8c31-913535c9ea8d'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:08.147814 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-bd43e948-2c2c-4d87-8c31-913535c9ea8d admin admin] The token cache is being invalidate because project 9f63ad1896f34188a4bb07dca6f83203 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81998) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:20:08.148110 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-bd43e948-2c2c-4d87-8c31-913535c9ea8d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:08.148833 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-bd43e948-2c2c-4d87-8c31-913535c9ea8d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:08.150748 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1340/2703] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 30 01:20:07 2022] DELETE /identity/v3/projects/9f63ad1896f34188a4bb07dca6f83203 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:20:08.154456 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd43e948-2c2c-4d87-8c31-913535c9ea8d admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:08.154937 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd641d9-2079-4538-b382-e85cf7158118 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:08.156113 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-bd43e948-2c2c-4d87-8c31-913535c9ea8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:20:08.221234 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:20:08.225687 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:20:08.246569 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd43e948-2c2c-4d87-8c31-913535c9ea8d admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:08.251236 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253c9123-bed1-4f64-85b2-4eafb1301747 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f827c7670b74d938ffe066ced88d1c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:08.251862 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253c9123-bed1-4f64-85b2-4eafb1301747 service cinder] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:08.252143 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253c9123-bed1-4f64-85b2-4eafb1301747 service cinder] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:08.252415 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253c9123-bed1-4f64-85b2-4eafb1301747 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:08.254938 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-253c9123-bed1-4f64-85b2-4eafb1301747 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:20:08.260884 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf628b39-dcec-4bc7-bbb1-d8950d91bd6e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f827c7670b74d938ffe066ced88d1c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:08.261949 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf628b39-dcec-4bc7-bbb1-d8950d91bd6e service cinder] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:08.262434 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf628b39-dcec-4bc7-bbb1-d8950d91bd6e service cinder] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:08.262893 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf628b39-dcec-4bc7-bbb1-d8950d91bd6e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:08.266173 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-bf628b39-dcec-4bc7-bbb1-d8950d91bd6e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:20:08.337799 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253c9123-bed1-4f64-85b2-4eafb1301747 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:08.339822 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253c9123-bed1-4f64-85b2-4eafb1301747 service cinder] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:08.352801 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1341/2704] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:20:08 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:20:08.353499 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253c9123-bed1-4f64-85b2-4eafb1301747 service cinder] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:08.354895 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-253c9123-bed1-4f64-85b2-4eafb1301747 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:20:08.361230 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf628b39-dcec-4bc7-bbb1-d8950d91bd6e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:08.364458 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf628b39-dcec-4bc7-bbb1-d8950d91bd6e service cinder] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:08.385965 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1364/2705] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:20:08 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 01:20:08.488949 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253c9123-bed1-4f64-85b2-4eafb1301747 service cinder] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:08.499730 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7534ec4b-3edb-4edc-ba18-aa11e8fe7cf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:08.501237 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7534ec4b-3edb-4edc-ba18-aa11e8fe7cf7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:08.502075 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7534ec4b-3edb-4edc-ba18-aa11e8fe7cf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:08.503089 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7534ec4b-3edb-4edc-ba18-aa11e8fe7cf7 admin admin] PATH_INFO: `/v3/users/448082629ce24602896bbcc2fa7d49b6` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:08.506661 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7534ec4b-3edb-4edc-ba18-aa11e8fe7cf7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=448082629ce24602896bbcc2fa7d49b6)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:08.510888 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7534ec4b-3edb-4edc-ba18-aa11e8fe7cf7 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:08.618309 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-7534ec4b-3edb-4edc-ba18-aa11e8fe7cf7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '448082629ce24602896bbcc2fa7d49b6'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:08.638200 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf628b39-dcec-4bc7-bbb1-d8950d91bd6e service cinder] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:08.640141 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-bf628b39-dcec-4bc7-bbb1-d8950d91bd6e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:20:08.643745 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-7534ec4b-3edb-4edc-ba18-aa11e8fe7cf7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '448082629ce24602896bbcc2fa7d49b6'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:08.658790 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf628b39-dcec-4bc7-bbb1-d8950d91bd6e service cinder] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:08.665127 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff900e9c-b5be-4687-9c45-74b1f1294c5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:08.665893 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff900e9c-b5be-4687-9c45-74b1f1294c5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:08.666267 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff900e9c-b5be-4687-9c45-74b1f1294c5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:08.666600 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff900e9c-b5be-4687-9c45-74b1f1294c5b admin admin] PATH_INFO: `/v3/users/eaaa6aa9199741d9b9e2ffd652cbea40` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:08.668088 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff900e9c-b5be-4687-9c45-74b1f1294c5b admin admin] RBAC: Authorizing `identity:delete_user(user_id=eaaa6aa9199741d9b9e2ffd652cbea40)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:08.670711 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff900e9c-b5be-4687-9c45-74b1f1294c5b admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:08.678923 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-7534ec4b-3edb-4edc-ba18-aa11e8fe7cf7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '448082629ce24602896bbcc2fa7d49b6'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:08.679835 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-7534ec4b-3edb-4edc-ba18-aa11e8fe7cf7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '448082629ce24602896bbcc2fa7d49b6'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:08.691056 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-7534ec4b-3edb-4edc-ba18-aa11e8fe7cf7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '448082629ce24602896bbcc2fa7d49b6'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:08.711695 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1342/2706] 10.222.0.79 () {58 vars in 1224 bytes} [Tue Aug 30 01:20:08 2022] DELETE /identity/v3/users/448082629ce24602896bbcc2fa7d49b6 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:20:08.747837 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-ff900e9c-b5be-4687-9c45-74b1f1294c5b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eaaa6aa9199741d9b9e2ffd652cbea40'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:08.761650 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-ff900e9c-b5be-4687-9c45-74b1f1294c5b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eaaa6aa9199741d9b9e2ffd652cbea40'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:08.772643 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-ff900e9c-b5be-4687-9c45-74b1f1294c5b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eaaa6aa9199741d9b9e2ffd652cbea40'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:08.773305 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-ff900e9c-b5be-4687-9c45-74b1f1294c5b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eaaa6aa9199741d9b9e2ffd652cbea40'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:08.789191 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-ff900e9c-b5be-4687-9c45-74b1f1294c5b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eaaa6aa9199741d9b9e2ffd652cbea40'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:08.797829 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1365/2707] 10.222.0.79 () {58 vars in 1224 bytes} [Tue Aug 30 01:20:08 2022] DELETE /identity/v3/users/eaaa6aa9199741d9b9e2ffd652cbea40 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:20:08.803641 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc61f0e-5f6d-48f1-933c-80e0696a3bc0 None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:08.804031 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc61f0e-5f6d-48f1-933c-80e0696a3bc0 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:08.804479 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc61f0e-5f6d-48f1-933c-80e0696a3bc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:08.820125 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:20:08.829121 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-cdc61f0e-5f6d-48f1-933c-80e0696a3bc0 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:20:08.830937 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-cdc61f0e-5f6d-48f1-933c-80e0696a3bc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:20:08.918118 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1343/2708] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:20:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:20:08.932090 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff900e9c-b5be-4687-9c45-74b1f1294c5b admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:08.934459 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-ff900e9c-b5be-4687-9c45-74b1f1294c5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:20:09.014351 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff900e9c-b5be-4687-9c45-74b1f1294c5b admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:09.018458 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24251383-e23b-4cd7-90dc-cdc700a90581 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16e6a0ca26fc4ef892c188ad89a1e132', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:09.019085 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24251383-e23b-4cd7-90dc-cdc700a90581 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:09.019423 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24251383-e23b-4cd7-90dc-cdc700a90581 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:09.019663 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24251383-e23b-4cd7-90dc-cdc700a90581 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:09.031186 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24251383-e23b-4cd7-90dc-cdc700a90581 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:09.032631 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24251383-e23b-4cd7-90dc-cdc700a90581 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:09.044676 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1366/2709] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:20:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:20:09.163638 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc61f0e-5f6d-48f1-933c-80e0696a3bc0 None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:09.165356 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-cdc61f0e-5f6d-48f1-933c-80e0696a3bc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:20:09.184044 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc61f0e-5f6d-48f1-933c-80e0696a3bc0 None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:09.194641 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfb8dc2-72d6-4f81-bf02-9e63958c39ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:09.196054 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfb8dc2-72d6-4f81-bf02-9e63958c39ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:09.196526 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfb8dc2-72d6-4f81-bf02-9e63958c39ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:09.197054 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfb8dc2-72d6-4f81-bf02-9e63958c39ec admin admin] PATH_INFO: `/v3/projects/c0b2fd18aef64220934afb8dfcdb62b2` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:09.199421 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfb8dc2-72d6-4f81-bf02-9e63958c39ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0b2fd18aef64220934afb8dfcdb62b2)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:09.203313 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfb8dc2-72d6-4f81-bf02-9e63958c39ec admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:09.292663 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-5dfb8dc2-72d6-4f81-bf02-9e63958c39ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0b2fd18aef64220934afb8dfcdb62b2', 'request_id': 'req-5dfb8dc2-72d6-4f81-bf02-9e63958c39ec'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:09.307377 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-5dfb8dc2-72d6-4f81-bf02-9e63958c39ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0b2fd18aef64220934afb8dfcdb62b2', 'request_id': 'req-5dfb8dc2-72d6-4f81-bf02-9e63958c39ec'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:09.321209 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-5dfb8dc2-72d6-4f81-bf02-9e63958c39ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0b2fd18aef64220934afb8dfcdb62b2', 'request_id': 'req-5dfb8dc2-72d6-4f81-bf02-9e63958c39ec'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:09.338388 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-5dfb8dc2-72d6-4f81-bf02-9e63958c39ec admin admin] The token cache is being invalidate because project c0b2fd18aef64220934afb8dfcdb62b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81998) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:20:09.338741 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-5dfb8dc2-72d6-4f81-bf02-9e63958c39ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:09.340209 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-5dfb8dc2-72d6-4f81-bf02-9e63958c39ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:09.342800 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1344/2710] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 30 01:20:09 2022] DELETE /identity/v3/projects/c0b2fd18aef64220934afb8dfcdb62b2 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:20:09.353134 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a237fd7c-35f5-4f67-a876-4b3fcb5bd14c None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:09.353909 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a237fd7c-35f5-4f67-a876-4b3fcb5bd14c None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:09.354090 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a237fd7c-35f5-4f67-a876-4b3fcb5bd14c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:09.368439 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:20:09.390473 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-a237fd7c-35f5-4f67-a876-4b3fcb5bd14c None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:20:09.392809 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-a237fd7c-35f5-4f67-a876-4b3fcb5bd14c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:20:09.480921 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfb8dc2-72d6-4f81-bf02-9e63958c39ec admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:09.483180 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-5dfb8dc2-72d6-4f81-bf02-9e63958c39ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:20:09.512560 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1367/2711] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:20:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:20:09.523261 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd23e3ed-086c-4698-8180-9e8a6e28e2ff None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:09.523829 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd23e3ed-086c-4698-8180-9e8a6e28e2ff None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:09.524322 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd23e3ed-086c-4698-8180-9e8a6e28e2ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:09.559246 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-dd23e3ed-086c-4698-8180-9e8a6e28e2ff None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:20:09.561520 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-dd23e3ed-086c-4698-8180-9e8a6e28e2ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:20:09.576937 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1368/2712] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:20:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:20:09.590207 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd23e3ed-086c-4698-8180-9e8a6e28e2ff None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:09.603956 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd23e3ed-086c-4698-8180-9e8a6e28e2ff None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:09.607116 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfb8dc2-72d6-4f81-bf02-9e63958c39ec admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:09.609964 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5e69ad-7839-4f91-b796-fc6683cbb008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:09.610997 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5e69ad-7839-4f91-b796-fc6683cbb008 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:09.611315 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5e69ad-7839-4f91-b796-fc6683cbb008 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:09.611584 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5e69ad-7839-4f91-b796-fc6683cbb008 admin admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:09.612276 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5e69ad-7839-4f91-b796-fc6683cbb008 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:20:09.612608 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5e69ad-7839-4f91-b796-fc6683cbb008 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:09.614297 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5e69ad-7839-4f91-b796-fc6683cbb008 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:09.615428 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bec0b4-52fe-4709-ab5e-16f1dab531be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:09.616565 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bec0b4-52fe-4709-ab5e-16f1dab531be admin admin] REQUEST_METHOD: `DELETE` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:09.617007 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bec0b4-52fe-4709-ab5e-16f1dab531be admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:09.617482 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bec0b4-52fe-4709-ab5e-16f1dab531be admin admin] PATH_INFO: `/v3/projects/8fde8f171a6647bc85f9c5ce3343c21a` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:09.619527 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bec0b4-52fe-4709-ab5e-16f1dab531be admin admin] RBAC: Authorizing `identity:delete_project(project_id=8fde8f171a6647bc85f9c5ce3343c21a)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:09.622711 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bec0b4-52fe-4709-ab5e-16f1dab531be admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:09.638821 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1369/2713] 10.222.0.79 () {58 vars in 1153 bytes} [Tue Aug 30 01:20:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:20:09.641773 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5e69ad-7839-4f91-b796-fc6683cbb008 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:09.653924 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5e69ad-7839-4f91-b796-fc6683cbb008 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:09.658926 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eabc4f2-3e61-41a7-9ff0-dcb9734a5a6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:09.659608 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eabc4f2-3e61-41a7-9ff0-dcb9734a5a6a admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:09.659885 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eabc4f2-3e61-41a7-9ff0-dcb9734a5a6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:09.660156 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eabc4f2-3e61-41a7-9ff0-dcb9734a5a6a admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:09.660803 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eabc4f2-3e61-41a7-9ff0-dcb9734a5a6a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:09.663315 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eabc4f2-3e61-41a7-9ff0-dcb9734a5a6a admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:09.682464 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:20:09.709721 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-93bec0b4-52fe-4709-ab5e-16f1dab531be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8fde8f171a6647bc85f9c5ce3343c21a', 'request_id': 'req-93bec0b4-52fe-4709-ab5e-16f1dab531be'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:09.709876 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1370/2714] 10.222.0.79 () {60 vars in 1153 bytes} [Tue Aug 30 01:20:09 2022] POST /identity/v3/projects => generated 375 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:20:09.717504 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eabc4f2-3e61-41a7-9ff0-dcb9734a5a6a admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:09.726368 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-93bec0b4-52fe-4709-ab5e-16f1dab531be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8fde8f171a6647bc85f9c5ce3343c21a', 'request_id': 'req-93bec0b4-52fe-4709-ab5e-16f1dab531be'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:09.738335 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-93bec0b4-52fe-4709-ab5e-16f1dab531be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8fde8f171a6647bc85f9c5ce3343c21a', 'request_id': 'req-93bec0b4-52fe-4709-ab5e-16f1dab531be'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:09.764201 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-93bec0b4-52fe-4709-ab5e-16f1dab531be admin admin] The token cache is being invalidate because project 8fde8f171a6647bc85f9c5ce3343c21a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81998) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:20:09.764513 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-93bec0b4-52fe-4709-ab5e-16f1dab531be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:09.765997 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-93bec0b4-52fe-4709-ab5e-16f1dab531be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:09.773606 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1345/2715] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 30 01:20:09 2022] DELETE /identity/v3/projects/8fde8f171a6647bc85f9c5ce3343c21a => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:20:09.775715 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bec0b4-52fe-4709-ab5e-16f1dab531be admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:09.778388 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-93bec0b4-52fe-4709-ab5e-16f1dab531be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:20:09.853171 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eabc4f2-3e61-41a7-9ff0-dcb9734a5a6a admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:09.860996 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483f7f1b-a7c7-4240-9580-22de02faf161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:09.861787 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483f7f1b-a7c7-4240-9580-22de02faf161 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:09.862062 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483f7f1b-a7c7-4240-9580-22de02faf161 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:09.862425 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483f7f1b-a7c7-4240-9580-22de02faf161 admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:09.863169 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483f7f1b-a7c7-4240-9580-22de02faf161 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:09.865110 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483f7f1b-a7c7-4240-9580-22de02faf161 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:09.885674 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bec0b4-52fe-4709-ab5e-16f1dab531be admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:09.891551 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d5a243-dd87-4fe8-8f59-0216f4c61a97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:09.892454 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d5a243-dd87-4fe8-8f59-0216f4c61a97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:09.892806 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d5a243-dd87-4fe8-8f59-0216f4c61a97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:09.893148 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d5a243-dd87-4fe8-8f59-0216f4c61a97 admin admin] PATH_INFO: `/v3/users/c68b2f40bd7840f49524c07bfca1ebbf` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:09.894505 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d5a243-dd87-4fe8-8f59-0216f4c61a97 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c68b2f40bd7840f49524c07bfca1ebbf)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:09.895705 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1371/2716] 10.222.0.79 () {60 vars in 1144 bytes} [Tue Aug 30 01:20:09 2022] POST /identity/v3/users => generated 288 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:20:09.896887 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d5a243-dd87-4fe8-8f59-0216f4c61a97 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:09.898753 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483f7f1b-a7c7-4240-9580-22de02faf161 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:09.901679 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-483f7f1b-a7c7-4240-9580-22de02faf161 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:20:09.924564 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483f7f1b-a7c7-4240-9580-22de02faf161 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:09.935495 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1688f7a9-fc65-42f6-949d-714fd91a2e2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:09.936369 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1688f7a9-fc65-42f6-949d-714fd91a2e2a admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:09.936874 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1688f7a9-fc65-42f6-949d-714fd91a2e2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:09.937314 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1688f7a9-fc65-42f6-949d-714fd91a2e2a admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:09.938531 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1688f7a9-fc65-42f6-949d-714fd91a2e2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:09.942141 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1688f7a9-fc65-42f6-949d-714fd91a2e2a admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:09.963975 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1372/2717] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:20:09 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:20:09.969259 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1688f7a9-fc65-42f6-949d-714fd91a2e2a admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:09.979807 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-48d5a243-dd87-4fe8-8f59-0216f4c61a97 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c68b2f40bd7840f49524c07bfca1ebbf'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:09.989024 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1688f7a9-fc65-42f6-949d-714fd91a2e2a admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:09.995205 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-48d5a243-dd87-4fe8-8f59-0216f4c61a97 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c68b2f40bd7840f49524c07bfca1ebbf'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:10.000188 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8aa75bd-37b6-4ece-9f64-277dc642bff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:10.000982 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aa75bd-37b6-4ece-9f64-277dc642bff4 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:10.001341 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aa75bd-37b6-4ece-9f64-277dc642bff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:10.001862 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aa75bd-37b6-4ece-9f64-277dc642bff4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:10.003182 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8aa75bd-37b6-4ece-9f64-277dc642bff4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:10.005187 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8aa75bd-37b6-4ece-9f64-277dc642bff4 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:10.019771 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-48d5a243-dd87-4fe8-8f59-0216f4c61a97 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c68b2f40bd7840f49524c07bfca1ebbf'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:10.021071 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-48d5a243-dd87-4fe8-8f59-0216f4c61a97 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c68b2f40bd7840f49524c07bfca1ebbf'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:10.024393 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1373/2718] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:20:09 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 01:20:10.029002 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8aa75bd-37b6-4ece-9f64-277dc642bff4 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:10.031264 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-c8aa75bd-37b6-4ece-9f64-277dc642bff4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:20:10.034892 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-48d5a243-dd87-4fe8-8f59-0216f4c61a97 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c68b2f40bd7840f49524c07bfca1ebbf'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:10.043802 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1346/2719] 10.222.0.79 () {58 vars in 1224 bytes} [Tue Aug 30 01:20:09 2022] DELETE /identity/v3/users/c68b2f40bd7840f49524c07bfca1ebbf => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:20:10.045494 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8aa75bd-37b6-4ece-9f64-277dc642bff4 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:10.098112 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:20:10.180944 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc45ffb-3648-483d-a597-d3acefb547de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:10.182187 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc45ffb-3648-483d-a597-d3acefb547de admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:10.182625 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc45ffb-3648-483d-a597-d3acefb547de admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:10.183105 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc45ffb-3648-483d-a597-d3acefb547de admin admin] PATH_INFO: `/v3/projects/f17802fdfd8a48699deda19ae0bc6668/users/a7fc51d83bbd4ee4aad62792e3fb2bc3/roles/c37945a17623465f899d4f217e7af593` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:10.218180 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc45ffb-3648-483d-a597-d3acefb547de admin admin] RBAC: Authorizing `identity:create_grant(project_id=f17802fdfd8a48699deda19ae0bc6668, user_id=a7fc51d83bbd4ee4aad62792e3fb2bc3, role_id=c37945a17623465f899d4f217e7af593)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:10.225273 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc45ffb-3648-483d-a597-d3acefb547de admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:10.283845 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1374/2720] 10.222.0.79 () {60 vars in 1483 bytes} [Tue Aug 30 01:20:10 2022] PUT /identity/v3/projects/f17802fdfd8a48699deda19ae0bc6668/users/a7fc51d83bbd4ee4aad62792e3fb2bc3/roles/c37945a17623465f899d4f217e7af593 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:20:10.306213 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5913299f-439d-4c9b-8dce-877bdb088a2d None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:10.306576 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5913299f-439d-4c9b-8dce-877bdb088a2d None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:10.307295 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5913299f-439d-4c9b-8dce-877bdb088a2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:10.346841 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-5913299f-439d-4c9b-8dce-877bdb088a2d None None] MFA Rules not processed for user `a7fc51d83bbd4ee4aad62792e3fb2bc3`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:20:10.348396 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-5913299f-439d-4c9b-8dce-877bdb088a2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:20:10.385408 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:20:10.435097 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1347/2721] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:20:10 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:20:10.440048 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc45ffb-3648-483d-a597-d3acefb547de admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:10.478569 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5913299f-439d-4c9b-8dce-877bdb088a2d None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:10.480823 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-5913299f-439d-4c9b-8dce-877bdb088a2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:20:10.552403 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc45ffb-3648-483d-a597-d3acefb547de admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:10.559259 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09a7064-27fe-49b5-8192-8abcb92762b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:10.560669 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09a7064-27fe-49b5-8192-8abcb92762b2 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:10.560927 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09a7064-27fe-49b5-8192-8abcb92762b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:10.561107 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09a7064-27fe-49b5-8192-8abcb92762b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:10.561808 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09a7064-27fe-49b5-8192-8abcb92762b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:10.564319 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09a7064-27fe-49b5-8192-8abcb92762b2 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:10.596307 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5913299f-439d-4c9b-8dce-877bdb088a2d None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:10.597976 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1375/2722] 10.222.0.79 () {60 vars in 1153 bytes} [Tue Aug 30 01:20:10 2022] POST /identity/v3/projects => generated 375 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:20:10.602640 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09a7064-27fe-49b5-8192-8abcb92762b2 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:10.670776 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e83c380-2494-4d73-98c8-306a7f2b913c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:10.671461 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e83c380-2494-4d73-98c8-306a7f2b913c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:10.671755 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e83c380-2494-4d73-98c8-306a7f2b913c admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:10.672025 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e83c380-2494-4d73-98c8-306a7f2b913c admin admin] PATH_INFO: `/v3/projects/1615e50a740745fda3a4887b4c47756f` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:10.673657 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e83c380-2494-4d73-98c8-306a7f2b913c admin admin] RBAC: Authorizing `identity:delete_project(project_id=1615e50a740745fda3a4887b4c47756f)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:10.675647 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e83c380-2494-4d73-98c8-306a7f2b913c admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:10.684066 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09a7064-27fe-49b5-8192-8abcb92762b2 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:10.688966 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ac6ede-a251-41a2-83d7-8ccd8be8e1ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:10.689585 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ac6ede-a251-41a2-83d7-8ccd8be8e1ac admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:10.689851 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ac6ede-a251-41a2-83d7-8ccd8be8e1ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:10.690188 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ac6ede-a251-41a2-83d7-8ccd8be8e1ac admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:10.690763 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ac6ede-a251-41a2-83d7-8ccd8be8e1ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:10.693002 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ac6ede-a251-41a2-83d7-8ccd8be8e1ac admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:10.730953 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1376/2723] 10.222.0.79 () {60 vars in 1144 bytes} [Tue Aug 30 01:20:10 2022] POST /identity/v3/users => generated 288 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:20:10.732645 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ac6ede-a251-41a2-83d7-8ccd8be8e1ac admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:10.733550 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-7e83c380-2494-4d73-98c8-306a7f2b913c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1615e50a740745fda3a4887b4c47756f', 'request_id': 'req-7e83c380-2494-4d73-98c8-306a7f2b913c'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:10.744280 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ac6ede-a251-41a2-83d7-8ccd8be8e1ac admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:10.746425 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-7e83c380-2494-4d73-98c8-306a7f2b913c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1615e50a740745fda3a4887b4c47756f', 'request_id': 'req-7e83c380-2494-4d73-98c8-306a7f2b913c'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:10.755203 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-7e83c380-2494-4d73-98c8-306a7f2b913c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1615e50a740745fda3a4887b4c47756f', 'request_id': 'req-7e83c380-2494-4d73-98c8-306a7f2b913c'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:10.771572 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-7e83c380-2494-4d73-98c8-306a7f2b913c admin admin] The token cache is being invalidate because project 1615e50a740745fda3a4887b4c47756f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81998) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:20:10.772419 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-7e83c380-2494-4d73-98c8-306a7f2b913c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:10.773291 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-7e83c380-2494-4d73-98c8-306a7f2b913c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:10.774851 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1348/2724] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 30 01:20:10 2022] DELETE /identity/v3/projects/1615e50a740745fda3a4887b4c47756f => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:20:10.780355 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1d0de1-927b-4fff-bad1-d7de8b9aae4b None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:10.780617 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1d0de1-927b-4fff-bad1-d7de8b9aae4b None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:10.780897 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1d0de1-927b-4fff-bad1-d7de8b9aae4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:10.790352 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:20:10.799793 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:20:10.806516 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-9f1d0de1-927b-4fff-bad1-d7de8b9aae4b None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:20:10.808113 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-9f1d0de1-927b-4fff-bad1-d7de8b9aae4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:20:10.838875 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c1562a-5caa-4d7c-ae69-1dfcfb5cd52f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:10.839741 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c1562a-5caa-4d7c-ae69-1dfcfb5cd52f admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:10.840091 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c1562a-5caa-4d7c-ae69-1dfcfb5cd52f admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:10.840542 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c1562a-5caa-4d7c-ae69-1dfcfb5cd52f admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:10.841291 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c1562a-5caa-4d7c-ae69-1dfcfb5cd52f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:10.843536 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c1562a-5caa-4d7c-ae69-1dfcfb5cd52f admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:10.856586 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1377/2725] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:20:10 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 01:20:10.861299 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c1562a-5caa-4d7c-ae69-1dfcfb5cd52f admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:10.863241 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-d9c1562a-5caa-4d7c-ae69-1dfcfb5cd52f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:20:10.878500 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c1562a-5caa-4d7c-ae69-1dfcfb5cd52f admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:10.885565 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1349/2726] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:20:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:20:10.886365 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804753e5-68e7-4809-bcbc-0e3803e08a10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:10.887347 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804753e5-68e7-4809-bcbc-0e3803e08a10 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:10.887618 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804753e5-68e7-4809-bcbc-0e3803e08a10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:10.887925 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804753e5-68e7-4809-bcbc-0e3803e08a10 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:10.889123 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804753e5-68e7-4809-bcbc-0e3803e08a10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:10.892185 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804753e5-68e7-4809-bcbc-0e3803e08a10 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:10.895233 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2779583-6df9-4320-befd-ba5f7b2f419c None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:10.895466 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2779583-6df9-4320-befd-ba5f7b2f419c None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:10.895714 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2779583-6df9-4320-befd-ba5f7b2f419c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:10.910105 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1378/2727] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:20:10 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 01:20:10.915294 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804753e5-68e7-4809-bcbc-0e3803e08a10 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:10.919641 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-b2779583-6df9-4320-befd-ba5f7b2f419c None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:20:10.920866 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-b2779583-6df9-4320-befd-ba5f7b2f419c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:20:10.926431 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804753e5-68e7-4809-bcbc-0e3803e08a10 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:10.930325 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1350/2728] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:20:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:20:10.932285 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c997c28-e51c-4362-81c8-ec045cd742ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:10.932993 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c997c28-e51c-4362-81c8-ec045cd742ec admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:10.933274 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c997c28-e51c-4362-81c8-ec045cd742ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:10.933549 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c997c28-e51c-4362-81c8-ec045cd742ec admin admin] PATH_INFO: `/v3/projects/d9a3dff912af49f3ab5703cce209b33b/users/c2cb4df9e008459d885f2fbdc1cdc811/roles/c37945a17623465f899d4f217e7af593` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:10.935408 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2779583-6df9-4320-befd-ba5f7b2f419c None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:10.947306 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2779583-6df9-4320-befd-ba5f7b2f419c None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:10.951042 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c997c28-e51c-4362-81c8-ec045cd742ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9a3dff912af49f3ab5703cce209b33b, user_id=c2cb4df9e008459d885f2fbdc1cdc811, role_id=c37945a17623465f899d4f217e7af593)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:10.953738 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c997c28-e51c-4362-81c8-ec045cd742ec admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:10.954612 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a27819b-1952-4e85-81fc-d9e4a53d2f2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:10.955588 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a27819b-1952-4e85-81fc-d9e4a53d2f2d admin admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:10.956021 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a27819b-1952-4e85-81fc-d9e4a53d2f2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:10.956456 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a27819b-1952-4e85-81fc-d9e4a53d2f2d admin admin] PATH_INFO: `/v3/domains` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:10.957456 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a27819b-1952-4e85-81fc-d9e4a53d2f2d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:20:10.957954 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a27819b-1952-4e85-81fc-d9e4a53d2f2d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:10.961077 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a27819b-1952-4e85-81fc-d9e4a53d2f2d admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:10.968821 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1379/2729] 10.222.0.79 () {60 vars in 1483 bytes} [Tue Aug 30 01:20:10 2022] PUT /identity/v3/projects/d9a3dff912af49f3ab5703cce209b33b/users/c2cb4df9e008459d885f2fbdc1cdc811/roles/c37945a17623465f899d4f217e7af593 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:20:10.983231 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1351/2730] 10.222.0.79 () {58 vars in 1153 bytes} [Tue Aug 30 01:20:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:20:10.985354 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7558cac0-cf05-4f75-992f-470d8e5535ed None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:10.985966 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7558cac0-cf05-4f75-992f-470d8e5535ed None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:10.986356 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7558cac0-cf05-4f75-992f-470d8e5535ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:10.987815 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a27819b-1952-4e85-81fc-d9e4a53d2f2d admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:10.998551 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a27819b-1952-4e85-81fc-d9e4a53d2f2d admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:11.025050 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-7558cac0-cf05-4f75-992f-470d8e5535ed None None] MFA Rules not processed for user `c2cb4df9e008459d885f2fbdc1cdc811`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:20:11.026277 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-7558cac0-cf05-4f75-992f-470d8e5535ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:20:11.082187 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cadcad-68f5-4f88-a7b3-43d2b7e024cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:11.082965 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cadcad-68f5-4f88-a7b3-43d2b7e024cc admin admin] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:11.083272 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cadcad-68f5-4f88-a7b3-43d2b7e024cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:11.083539 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cadcad-68f5-4f88-a7b3-43d2b7e024cc admin admin] PATH_INFO: `/v3/projects` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:11.084218 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cadcad-68f5-4f88-a7b3-43d2b7e024cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:11.086618 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cadcad-68f5-4f88-a7b3-43d2b7e024cc admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:11.105432 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1380/2731] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:20:10 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:20:11.110366 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7558cac0-cf05-4f75-992f-470d8e5535ed None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:11.119821 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1352/2732] 10.222.0.79 () {60 vars in 1153 bytes} [Tue Aug 30 01:20:10 2022] POST /identity/v3/projects => generated 393 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:20:11.124308 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cadcad-68f5-4f88-a7b3-43d2b7e024cc admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:11.124565 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7558cac0-cf05-4f75-992f-470d8e5535ed None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:11.190544 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7177d04d-f3db-48cf-9ab4-4a2c1abc4a3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:11.191472 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7177d04d-f3db-48cf-9ab4-4a2c1abc4a3c admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:11.191907 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7177d04d-f3db-48cf-9ab4-4a2c1abc4a3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:11.192521 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7177d04d-f3db-48cf-9ab4-4a2c1abc4a3c admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:11.193254 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7177d04d-f3db-48cf-9ab4-4a2c1abc4a3c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:11.196284 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7177d04d-f3db-48cf-9ab4-4a2c1abc4a3c admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:11.201023 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cadcad-68f5-4f88-a7b3-43d2b7e024cc admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:11.205851 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ff90c8-c833-4f85-856d-c86295c477e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:11.206457 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ff90c8-c833-4f85-856d-c86295c477e7 admin admin] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:11.206734 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ff90c8-c833-4f85-856d-c86295c477e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:11.207002 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ff90c8-c833-4f85-856d-c86295c477e7 admin admin] PATH_INFO: `/v3/users` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:11.207677 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ff90c8-c833-4f85-856d-c86295c477e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:11.210391 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ff90c8-c833-4f85-856d-c86295c477e7 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:11.242209 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1381/2733] 10.222.0.79 () {60 vars in 1153 bytes} [Tue Aug 30 01:20:11 2022] POST /identity/v3/projects => generated 375 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:20:11.243053 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1353/2734] 10.222.0.79 () {60 vars in 1144 bytes} [Tue Aug 30 01:20:11 2022] POST /identity/v3/users => generated 297 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:20:11.243777 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7177d04d-f3db-48cf-9ab4-4a2c1abc4a3c admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:11.247622 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ff90c8-c833-4f85-856d-c86295c477e7 admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:11.248518 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:20:11.253167 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:20:11.264752 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ff90c8-c833-4f85-856d-c86295c477e7 admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:11.337178 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7177d04d-f3db-48cf-9ab4-4a2c1abc4a3c admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:11.342417 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0eb1fe-bd89-4365-acdb-4b50c9460f18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:11.343035 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0eb1fe-bd89-4365-acdb-4b50c9460f18 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:11.343357 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0eb1fe-bd89-4365-acdb-4b50c9460f18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:11.343605 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0eb1fe-bd89-4365-acdb-4b50c9460f18 admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:11.344244 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0eb1fe-bd89-4365-acdb-4b50c9460f18 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:11.346151 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0eb1fe-bd89-4365-acdb-4b50c9460f18 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:11.356726 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7264cb1c-1ac7-436f-8305-8dbe00f45429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:11.357751 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7264cb1c-1ac7-436f-8305-8dbe00f45429 admin admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:11.358132 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7264cb1c-1ac7-436f-8305-8dbe00f45429 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:11.358573 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7264cb1c-1ac7-436f-8305-8dbe00f45429 admin admin] PATH_INFO: `/v3/roles` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:11.359764 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7264cb1c-1ac7-436f-8305-8dbe00f45429 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:11.362693 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7264cb1c-1ac7-436f-8305-8dbe00f45429 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:11.374358 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1382/2735] 10.222.0.79 () {60 vars in 1144 bytes} [Tue Aug 30 01:20:11 2022] POST /identity/v3/users => generated 294 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:20:11.378767 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0eb1fe-bd89-4365-acdb-4b50c9460f18 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:11.384581 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1354/2736] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:20:11 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 01:20:11.386539 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7264cb1c-1ac7-436f-8305-8dbe00f45429 admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:11.392330 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0eb1fe-bd89-4365-acdb-4b50c9460f18 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:11.400456 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734e3740-a3ca-4aa7-8e29-3aa881a47e8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:11.401642 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734e3740-a3ca-4aa7-8e29-3aa881a47e8b admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:11.402197 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734e3740-a3ca-4aa7-8e29-3aa881a47e8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:11.402786 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734e3740-a3ca-4aa7-8e29-3aa881a47e8b admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:11.404135 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734e3740-a3ca-4aa7-8e29-3aa881a47e8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:11.407523 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734e3740-a3ca-4aa7-8e29-3aa881a47e8b admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:11.417417 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7264cb1c-1ac7-436f-8305-8dbe00f45429 admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:11.425760 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b37886-1b05-4834-a8e8-c26304946666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:11.426897 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b37886-1b05-4834-a8e8-c26304946666 admin admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:11.427509 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b37886-1b05-4834-a8e8-c26304946666 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:11.428115 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b37886-1b05-4834-a8e8-c26304946666 admin admin] PATH_INFO: `/v3/roles` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:11.429331 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b37886-1b05-4834-a8e8-c26304946666 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:11.430984 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1383/2737] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:20:11 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:20:11.432601 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b37886-1b05-4834-a8e8-c26304946666 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:11.437735 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734e3740-a3ca-4aa7-8e29-3aa881a47e8b admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:11.452356 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734e3740-a3ca-4aa7-8e29-3aa881a47e8b admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:11.453416 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1355/2738] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:20:11 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:20:11.457106 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b37886-1b05-4834-a8e8-c26304946666 admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:11.463101 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8eda20d-dc08-40b3-9755-aa7ad131696f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:11.465117 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eda20d-dc08-40b3-9755-aa7ad131696f admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:11.465707 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eda20d-dc08-40b3-9755-aa7ad131696f admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:11.466270 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eda20d-dc08-40b3-9755-aa7ad131696f admin admin] PATH_INFO: `/v3/projects/d37f34840e434d02854a2a0bc88e318c/users/8d6c72a55a8a4a2b9b8924e161c0f185/roles/d14c3070c9184d76a7b23df69bd3db07` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:11.468457 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b37886-1b05-4834-a8e8-c26304946666 admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:11.478514 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839347c1-bdf6-4712-b87f-085cd626410a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:11.479609 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839347c1-bdf6-4712-b87f-085cd626410a admin admin] REQUEST_METHOD: `PUT` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:11.480061 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839347c1-bdf6-4712-b87f-085cd626410a admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:11.480522 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839347c1-bdf6-4712-b87f-085cd626410a admin admin] PATH_INFO: `/v3/projects/759c78b2e7d94556bd516114eff46b4b/users/1b58af6ce4ad4f959f80649c1b9f256f/roles/c37945a17623465f899d4f217e7af593` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:11.496852 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8eda20d-dc08-40b3-9755-aa7ad131696f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d37f34840e434d02854a2a0bc88e318c, user_id=8d6c72a55a8a4a2b9b8924e161c0f185, role_id=d14c3070c9184d76a7b23df69bd3db07)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:11.499658 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8eda20d-dc08-40b3-9755-aa7ad131696f admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:11.505994 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839347c1-bdf6-4712-b87f-085cd626410a admin admin] RBAC: Authorizing `identity:create_grant(project_id=759c78b2e7d94556bd516114eff46b4b, user_id=1b58af6ce4ad4f959f80649c1b9f256f, role_id=c37945a17623465f899d4f217e7af593)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:11.510315 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839347c1-bdf6-4712-b87f-085cd626410a admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:11.518437 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1384/2739] 10.222.0.79 () {60 vars in 1483 bytes} [Tue Aug 30 01:20:11 2022] PUT /identity/v3/projects/d37f34840e434d02854a2a0bc88e318c/users/8d6c72a55a8a4a2b9b8924e161c0f185/roles/d14c3070c9184d76a7b23df69bd3db07 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:20:11.523657 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8eda20d-dc08-40b3-9755-aa7ad131696f admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:11.533680 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1356/2740] 10.222.0.79 () {60 vars in 1483 bytes} [Tue Aug 30 01:20:11 2022] PUT /identity/v3/projects/759c78b2e7d94556bd516114eff46b4b/users/1b58af6ce4ad4f959f80649c1b9f256f/roles/c37945a17623465f899d4f217e7af593 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:20:11.550430 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ed999a-661d-470f-a37e-36f91917caff None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:11.550770 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ed999a-661d-470f-a37e-36f91917caff None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:11.551295 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ed999a-661d-470f-a37e-36f91917caff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:11.603733 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-25ed999a-661d-470f-a37e-36f91917caff None None] MFA Rules not processed for user `1b58af6ce4ad4f959f80649c1b9f256f`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:20:11.606150 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-25ed999a-661d-470f-a37e-36f91917caff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:20:11.616788 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8eda20d-dc08-40b3-9755-aa7ad131696f admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:11.702331 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1357/2741] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:20:11 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:20:11.708451 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ed999a-661d-470f-a37e-36f91917caff None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:11.715333 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95aef52e-3171-495a-86e3-40cacaf8b79d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:11.716501 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aef52e-3171-495a-86e3-40cacaf8b79d admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:11.717122 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aef52e-3171-495a-86e3-40cacaf8b79d admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:11.717486 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aef52e-3171-495a-86e3-40cacaf8b79d admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:11.718490 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95aef52e-3171-495a-86e3-40cacaf8b79d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:11.720973 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95aef52e-3171-495a-86e3-40cacaf8b79d admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:11.728388 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:20:11.730214 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ed999a-661d-470f-a37e-36f91917caff None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:11.734617 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1385/2742] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:20:11 2022] GET /identity/v3/roles => generated 1420 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:20:11.739928 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b778ba3-05f5-4326-8eb4-9215a3d88439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:11.740751 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95aef52e-3171-495a-86e3-40cacaf8b79d admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:11.741024 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b778ba3-05f5-4326-8eb4-9215a3d88439 admin admin] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:11.741590 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b778ba3-05f5-4326-8eb4-9215a3d88439 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:11.742143 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b778ba3-05f5-4326-8eb4-9215a3d88439 admin admin] PATH_INFO: `/v3/projects` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:11.743271 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b778ba3-05f5-4326-8eb4-9215a3d88439 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:11.747250 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b778ba3-05f5-4326-8eb4-9215a3d88439 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:11.759380 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95aef52e-3171-495a-86e3-40cacaf8b79d admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:11.765894 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b90d4f-3340-4a83-a82a-066de5224081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:11.766814 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b90d4f-3340-4a83-a82a-066de5224081 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:11.767530 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b90d4f-3340-4a83-a82a-066de5224081 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:11.767974 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b90d4f-3340-4a83-a82a-066de5224081 admin admin] PATH_INFO: `/v3/projects/d37f34840e434d02854a2a0bc88e318c/users/8d6c72a55a8a4a2b9b8924e161c0f185/roles/d14c3070c9184d76a7b23df69bd3db07` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:11.770309 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b90d4f-3340-4a83-a82a-066de5224081 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d37f34840e434d02854a2a0bc88e318c, user_id=8d6c72a55a8a4a2b9b8924e161c0f185, role_id=d14c3070c9184d76a7b23df69bd3db07)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:11.774942 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b90d4f-3340-4a83-a82a-066de5224081 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:11.791214 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1386/2743] 10.222.0.79 () {60 vars in 1483 bytes} [Tue Aug 30 01:20:11 2022] PUT /identity/v3/projects/d37f34840e434d02854a2a0bc88e318c/users/8d6c72a55a8a4a2b9b8924e161c0f185/roles/d14c3070c9184d76a7b23df69bd3db07 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:20:11.791538 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1358/2744] 10.222.0.79 () {60 vars in 1153 bytes} [Tue Aug 30 01:20:11 2022] POST /identity/v3/projects => generated 393 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:20:11.800371 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b90d4f-3340-4a83-a82a-066de5224081 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:11.862331 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f0ceec-4c3f-436c-a097-b23f6b787071 None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:11.862703 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f0ceec-4c3f-436c-a097-b23f6b787071 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:11.862890 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f0ceec-4c3f-436c-a097-b23f6b787071 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:11.894072 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b90d4f-3340-4a83-a82a-066de5224081 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:11.896359 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-23f0ceec-4c3f-436c-a097-b23f6b787071 None None] MFA Rules not processed for user `8d6c72a55a8a4a2b9b8924e161c0f185`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:20:11.898068 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-23f0ceec-4c3f-436c-a097-b23f6b787071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:20:11.920396 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:20:11.970431 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f6e69e-249e-4ed6-b3e0-ff1486db7005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:11.971620 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f6e69e-249e-4ed6-b3e0-ff1486db7005 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:11.971904 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f6e69e-249e-4ed6-b3e0-ff1486db7005 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:11.972174 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f6e69e-249e-4ed6-b3e0-ff1486db7005 admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:11.972854 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f6e69e-249e-4ed6-b3e0-ff1486db7005 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:11.975449 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f6e69e-249e-4ed6-b3e0-ff1486db7005 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:11.988573 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1359/2745] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:20:11 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:20:12.001759 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f0ceec-4c3f-436c-a097-b23f6b787071 None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:12.003446 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-23f0ceec-4c3f-436c-a097-b23f6b787071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:20:12.003891 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1387/2746] 10.222.0.79 () {60 vars in 1144 bytes} [Tue Aug 30 01:20:11 2022] POST /identity/v3/users => generated 303 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:20:12.009511 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f6e69e-249e-4ed6-b3e0-ff1486db7005 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:12.022915 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f6e69e-249e-4ed6-b3e0-ff1486db7005 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:12.029099 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69953d2e-1adc-4b9e-ae96-1346c30d987b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:12.029735 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69953d2e-1adc-4b9e-ae96-1346c30d987b admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:12.030012 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69953d2e-1adc-4b9e-ae96-1346c30d987b admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:12.030278 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69953d2e-1adc-4b9e-ae96-1346c30d987b admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:12.030925 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69953d2e-1adc-4b9e-ae96-1346c30d987b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:12.032599 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69953d2e-1adc-4b9e-ae96-1346c30d987b admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:12.047330 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1388/2747] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:20:12 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 01:20:12.050915 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69953d2e-1adc-4b9e-ae96-1346c30d987b admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:12.064528 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69953d2e-1adc-4b9e-ae96-1346c30d987b admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:12.072815 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82540c58-cbea-4060-9669-f32ffcd58e93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:12.073505 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82540c58-cbea-4060-9669-f32ffcd58e93 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:12.073783 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82540c58-cbea-4060-9669-f32ffcd58e93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:12.074066 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82540c58-cbea-4060-9669-f32ffcd58e93 admin admin] PATH_INFO: `/v3/projects/36616f6fbed248019bad7ee72b3795a9/users/30630a249255430687bbb5e44ff82db5/roles/d14c3070c9184d76a7b23df69bd3db07` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:12.077621 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f0ceec-4c3f-436c-a097-b23f6b787071 None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:12.082085 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaa67a9-1e70-42c6-9f36-5c7facd03447 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f827c7670b74d938ffe066ced88d1c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:12.082890 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaa67a9-1e70-42c6-9f36-5c7facd03447 service cinder] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:12.083357 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaa67a9-1e70-42c6-9f36-5c7facd03447 service cinder] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:12.083764 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaa67a9-1e70-42c6-9f36-5c7facd03447 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:12.086540 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-7eaa67a9-1e70-42c6-9f36-5c7facd03447 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:20:12.093135 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82540c58-cbea-4060-9669-f32ffcd58e93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=36616f6fbed248019bad7ee72b3795a9, user_id=30630a249255430687bbb5e44ff82db5, role_id=d14c3070c9184d76a7b23df69bd3db07)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:12.095921 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82540c58-cbea-4060-9669-f32ffcd58e93 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:12.113627 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1389/2748] 10.222.0.79 () {60 vars in 1483 bytes} [Tue Aug 30 01:20:12 2022] PUT /identity/v3/projects/36616f6fbed248019bad7ee72b3795a9/users/30630a249255430687bbb5e44ff82db5/roles/d14c3070c9184d76a7b23df69bd3db07 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:20:12.120009 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82540c58-cbea-4060-9669-f32ffcd58e93 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:12.182946 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaa67a9-1e70-42c6-9f36-5c7facd03447 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:12.184819 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaa67a9-1e70-42c6-9f36-5c7facd03447 service cinder] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:12.189698 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:20:12.200154 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1360/2749] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:20:12 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:20:12.207453 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82540c58-cbea-4060-9669-f32ffcd58e93 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:12.213794 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c9b3ed-092f-4c97-a320-04d794ce554d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:12.214622 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c9b3ed-092f-4c97-a320-04d794ce554d admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:12.215006 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c9b3ed-092f-4c97-a320-04d794ce554d admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:12.215455 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c9b3ed-092f-4c97-a320-04d794ce554d admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:12.216334 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c9b3ed-092f-4c97-a320-04d794ce554d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:12.218236 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c9b3ed-092f-4c97-a320-04d794ce554d admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:12.230431 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1390/2750] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:20:12 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:20:12.234716 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaa67a9-1e70-42c6-9f36-5c7facd03447 service cinder] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:12.246921 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaa67a9-1e70-42c6-9f36-5c7facd03447 service cinder] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:12.255568 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35396e4-e31b-45f3-ac4b-1b126460790c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:12.257364 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35396e4-e31b-45f3-ac4b-1b126460790c admin admin] REQUEST_METHOD: `PUT` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:12.258227 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35396e4-e31b-45f3-ac4b-1b126460790c admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:12.258866 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35396e4-e31b-45f3-ac4b-1b126460790c admin admin] PATH_INFO: `/v3/projects/36616f6fbed248019bad7ee72b3795a9/users/30630a249255430687bbb5e44ff82db5/roles/d14c3070c9184d76a7b23df69bd3db07` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:12.262660 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35396e4-e31b-45f3-ac4b-1b126460790c admin admin] RBAC: Authorizing `identity:create_grant(project_id=36616f6fbed248019bad7ee72b3795a9, user_id=30630a249255430687bbb5e44ff82db5, role_id=d14c3070c9184d76a7b23df69bd3db07)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:12.268405 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35396e4-e31b-45f3-ac4b-1b126460790c admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:12.283834 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1361/2751] 10.222.0.79 () {60 vars in 1483 bytes} [Tue Aug 30 01:20:12 2022] PUT /identity/v3/projects/36616f6fbed248019bad7ee72b3795a9/users/30630a249255430687bbb5e44ff82db5/roles/d14c3070c9184d76a7b23df69bd3db07 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:20:12.295073 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de1ee33-f435-43e6-811a-05da5ee731fa None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:12.295368 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de1ee33-f435-43e6-811a-05da5ee731fa None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:12.295649 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de1ee33-f435-43e6-811a-05da5ee731fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:12.333111 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-6de1ee33-f435-43e6-811a-05da5ee731fa None None] MFA Rules not processed for user `30630a249255430687bbb5e44ff82db5`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:20:12.334398 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-6de1ee33-f435-43e6-811a-05da5ee731fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:20:12.428846 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1391/2752] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:20:12 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:20:12.446502 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35396e4-e31b-45f3-ac4b-1b126460790c admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:12.449050 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-b35396e4-e31b-45f3-ac4b-1b126460790c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:20:12.556233 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35396e4-e31b-45f3-ac4b-1b126460790c admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:12.561958 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d393a2-5a36-42a7-a86e-9b55ca41c9f9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f827c7670b74d938ffe066ced88d1c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:12.562892 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d393a2-5a36-42a7-a86e-9b55ca41c9f9 service cinder] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:12.563438 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d393a2-5a36-42a7-a86e-9b55ca41c9f9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:12.563933 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d393a2-5a36-42a7-a86e-9b55ca41c9f9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:12.581669 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d393a2-5a36-42a7-a86e-9b55ca41c9f9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:12.583558 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d393a2-5a36-42a7-a86e-9b55ca41c9f9 service cinder] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:12.591625 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:20:12.598533 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1362/2753] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:20:12 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:20:12.657328 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de1ee33-f435-43e6-811a-05da5ee731fa None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:12.672122 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de1ee33-f435-43e6-811a-05da5ee731fa None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:12.675520 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0b1ed0-40b0-4474-8491-80df26f73c40 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f827c7670b74d938ffe066ced88d1c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:12.676144 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0b1ed0-40b0-4474-8491-80df26f73c40 service cinder] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:12.676423 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0b1ed0-40b0-4474-8491-80df26f73c40 service cinder] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:12.676694 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0b1ed0-40b0-4474-8491-80df26f73c40 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:12.704735 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d393a2-5a36-42a7-a86e-9b55ca41c9f9 service cinder] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:12.706666 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-95d393a2-5a36-42a7-a86e-9b55ca41c9f9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:20:12.770301 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0b1ed0-40b0-4474-8491-80df26f73c40 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:12.773649 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0b1ed0-40b0-4474-8491-80df26f73c40 service cinder] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:12.789969 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1392/2754] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:20:12 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:20:12.800965 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d393a2-5a36-42a7-a86e-9b55ca41c9f9 service cinder] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:12.809519 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcc426e-f647-4776-8f97-568a038b123a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:12.810246 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcc426e-f647-4776-8f97-568a038b123a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:12.810662 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcc426e-f647-4776-8f97-568a038b123a admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:12.811111 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcc426e-f647-4776-8f97-568a038b123a admin admin] PATH_INFO: `/v3/users/1e819844fc6a4f749437f35c95f9cc04` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:12.813072 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcc426e-f647-4776-8f97-568a038b123a admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e819844fc6a4f749437f35c95f9cc04)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:12.817079 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcc426e-f647-4776-8f97-568a038b123a admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:12.896269 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-4dcc426e-f647-4776-8f97-568a038b123a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e819844fc6a4f749437f35c95f9cc04'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:12.908242 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-4dcc426e-f647-4776-8f97-568a038b123a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e819844fc6a4f749437f35c95f9cc04'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:12.929411 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-4dcc426e-f647-4776-8f97-568a038b123a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e819844fc6a4f749437f35c95f9cc04'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:12.930406 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-4dcc426e-f647-4776-8f97-568a038b123a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e819844fc6a4f749437f35c95f9cc04'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:12.942848 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-4dcc426e-f647-4776-8f97-568a038b123a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e819844fc6a4f749437f35c95f9cc04'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:12.953786 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1363/2755] 10.222.0.79 () {58 vars in 1224 bytes} [Tue Aug 30 01:20:12 2022] DELETE /identity/v3/users/1e819844fc6a4f749437f35c95f9cc04 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:20:12.958474 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34bead6-0cd8-4b88-9a11-5a61427b3ada None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:12.958875 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34bead6-0cd8-4b88-9a11-5a61427b3ada None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:12.959223 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34bead6-0cd8-4b88-9a11-5a61427b3ada None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:12.984766 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-f34bead6-0cd8-4b88-9a11-5a61427b3ada None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:20:12.986112 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-f34bead6-0cd8-4b88-9a11-5a61427b3ada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:20:13.067892 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1393/2756] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:20:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:20:13.079741 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcc426e-f647-4776-8f97-568a038b123a admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:13.081372 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-4dcc426e-f647-4776-8f97-568a038b123a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:20:13.190981 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcc426e-f647-4776-8f97-568a038b123a admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:13.197245 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13eaebf9-1143-49ef-9710-8011fe4eccc2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16e6a0ca26fc4ef892c188ad89a1e132', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:13.198028 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13eaebf9-1143-49ef-9710-8011fe4eccc2 service neutron] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:13.198382 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13eaebf9-1143-49ef-9710-8011fe4eccc2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:13.198693 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13eaebf9-1143-49ef-9710-8011fe4eccc2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:13.223194 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13eaebf9-1143-49ef-9710-8011fe4eccc2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:13.223194 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13eaebf9-1143-49ef-9710-8011fe4eccc2 service neutron] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:13.230774 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1364/2757] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:20:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:20:13.576841 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34bead6-0cd8-4b88-9a11-5a61427b3ada None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:13.579272 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-f34bead6-0cd8-4b88-9a11-5a61427b3ada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:20:13.606305 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34bead6-0cd8-4b88-9a11-5a61427b3ada None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:13.620407 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670d7d80-842c-45cd-a334-a131d9036b9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:13.621760 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670d7d80-842c-45cd-a334-a131d9036b9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:13.622412 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670d7d80-842c-45cd-a334-a131d9036b9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:13.622980 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670d7d80-842c-45cd-a334-a131d9036b9c admin admin] PATH_INFO: `/v3/projects/2820e32fc5314652b664bf10eed383e9` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:13.625291 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670d7d80-842c-45cd-a334-a131d9036b9c admin admin] RBAC: Authorizing `identity:delete_project(project_id=2820e32fc5314652b664bf10eed383e9)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:13.629944 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670d7d80-842c-45cd-a334-a131d9036b9c admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:13.643960 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=100 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:20:13.716048 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-670d7d80-842c-45cd-a334-a131d9036b9c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2820e32fc5314652b664bf10eed383e9', 'request_id': 'req-670d7d80-842c-45cd-a334-a131d9036b9c'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:13.730126 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-670d7d80-842c-45cd-a334-a131d9036b9c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2820e32fc5314652b664bf10eed383e9', 'request_id': 'req-670d7d80-842c-45cd-a334-a131d9036b9c'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:13.741260 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-670d7d80-842c-45cd-a334-a131d9036b9c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2820e32fc5314652b664bf10eed383e9', 'request_id': 'req-670d7d80-842c-45cd-a334-a131d9036b9c'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:13.760369 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-670d7d80-842c-45cd-a334-a131d9036b9c admin admin] The token cache is being invalidate because project 2820e32fc5314652b664bf10eed383e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:20:13.760997 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-670d7d80-842c-45cd-a334-a131d9036b9c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:13.762145 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-670d7d80-842c-45cd-a334-a131d9036b9c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:13.764805 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1394/2758] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 30 01:20:13 2022] DELETE /identity/v3/projects/2820e32fc5314652b664bf10eed383e9 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:20:13.771341 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13eaebf9-1143-49ef-9710-8011fe4eccc2 service neutron] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:13.785011 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13eaebf9-1143-49ef-9710-8011fe4eccc2 service neutron] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:13.810270 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:20:13.828186 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670d7d80-842c-45cd-a334-a131d9036b9c admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:13.830921 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-670d7d80-842c-45cd-a334-a131d9036b9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:20:13.872049 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8f2627-4cf4-434e-b98e-fce7b036cbbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:13.872884 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8f2627-4cf4-434e-b98e-fce7b036cbbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:13.873286 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8f2627-4cf4-434e-b98e-fce7b036cbbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:13.874312 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8f2627-4cf4-434e-b98e-fce7b036cbbf admin admin] PATH_INFO: `/v3/users/3593795ae541491fbae5c14807e6d07a` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:13.875428 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8f2627-4cf4-434e-b98e-fce7b036cbbf admin admin] RBAC: Authorizing `identity:delete_user(user_id=3593795ae541491fbae5c14807e6d07a)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:13.877811 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8f2627-4cf4-434e-b98e-fce7b036cbbf admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:13.907560 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670d7d80-842c-45cd-a334-a131d9036b9c admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:13.911618 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0475b292-0202-4ec0-9043-072a16ef5679 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f827c7670b74d938ffe066ced88d1c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:13.912872 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0475b292-0202-4ec0-9043-072a16ef5679 service cinder] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:13.913334 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0475b292-0202-4ec0-9043-072a16ef5679 service cinder] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:13.913647 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0475b292-0202-4ec0-9043-072a16ef5679 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:13.919880 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-0475b292-0202-4ec0-9043-072a16ef5679 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:20:13.957974 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-ab8f2627-4cf4-434e-b98e-fce7b036cbbf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3593795ae541491fbae5c14807e6d07a'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:13.970621 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-ab8f2627-4cf4-434e-b98e-fce7b036cbbf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3593795ae541491fbae5c14807e6d07a'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:13.987035 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-ab8f2627-4cf4-434e-b98e-fce7b036cbbf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3593795ae541491fbae5c14807e6d07a'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:13.987826 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-ab8f2627-4cf4-434e-b98e-fce7b036cbbf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3593795ae541491fbae5c14807e6d07a'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:14.000623 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-ab8f2627-4cf4-434e-b98e-fce7b036cbbf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3593795ae541491fbae5c14807e6d07a'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:14.012287 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1365/2759] 10.222.0.79 () {58 vars in 1224 bytes} [Tue Aug 30 01:20:13 2022] DELETE /identity/v3/users/3593795ae541491fbae5c14807e6d07a => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:20:14.014759 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0475b292-0202-4ec0-9043-072a16ef5679 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:14.016390 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0475b292-0202-4ec0-9043-072a16ef5679 service cinder] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:14.031408 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1395/2760] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:20:13 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 01:20:14.486912 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8f2627-4cf4-434e-b98e-fce7b036cbbf admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:14.489930 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-ab8f2627-4cf4-434e-b98e-fce7b036cbbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:20:14.627967 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8f2627-4cf4-434e-b98e-fce7b036cbbf admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:14.638190 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64e1f26-c727-44f7-809a-20204a1d59b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:14.639912 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64e1f26-c727-44f7-809a-20204a1d59b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:14.639912 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64e1f26-c727-44f7-809a-20204a1d59b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:14.640285 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64e1f26-c727-44f7-809a-20204a1d59b1 admin admin] PATH_INFO: `/v3/projects/aaa6b1bcd1f54d71a7832ff4c42ee4f5` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:14.642040 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64e1f26-c727-44f7-809a-20204a1d59b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aaa6b1bcd1f54d71a7832ff4c42ee4f5)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:14.645664 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64e1f26-c727-44f7-809a-20204a1d59b1 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:14.730955 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:20:14.739862 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-d64e1f26-c727-44f7-809a-20204a1d59b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aaa6b1bcd1f54d71a7832ff4c42ee4f5', 'request_id': 'req-d64e1f26-c727-44f7-809a-20204a1d59b1'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:14.755574 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-d64e1f26-c727-44f7-809a-20204a1d59b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aaa6b1bcd1f54d71a7832ff4c42ee4f5', 'request_id': 'req-d64e1f26-c727-44f7-809a-20204a1d59b1'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:14.765041 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-d64e1f26-c727-44f7-809a-20204a1d59b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aaa6b1bcd1f54d71a7832ff4c42ee4f5', 'request_id': 'req-d64e1f26-c727-44f7-809a-20204a1d59b1'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:14.784428 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-d64e1f26-c727-44f7-809a-20204a1d59b1 admin admin] The token cache is being invalidate because project aaa6b1bcd1f54d71a7832ff4c42ee4f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81998) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:20:14.785542 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-d64e1f26-c727-44f7-809a-20204a1d59b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:14.785896 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-d64e1f26-c727-44f7-809a-20204a1d59b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:14.788360 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1366/2761] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 30 01:20:14 2022] DELETE /identity/v3/projects/aaa6b1bcd1f54d71a7832ff4c42ee4f5 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:20:14.794534 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf50efe-46f6-483e-b8ff-ade2a2fbcc9d None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:14.795394 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf50efe-46f6-483e-b8ff-ade2a2fbcc9d None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:14.795704 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf50efe-46f6-483e-b8ff-ade2a2fbcc9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:14.819995 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64e1f26-c727-44f7-809a-20204a1d59b1 admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:14.822390 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-6cf50efe-46f6-483e-b8ff-ade2a2fbcc9d None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:20:14.822644 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-d64e1f26-c727-44f7-809a-20204a1d59b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:20:14.824953 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-6cf50efe-46f6-483e-b8ff-ade2a2fbcc9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:20:14.893538 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:20:14.919699 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1396/2762] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:20:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:20:14.931837 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64e1f26-c727-44f7-809a-20204a1d59b1 admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:14.932639 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2df9755-e1d5-48ea-b8d5-b81789c9822d None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:14.932974 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2df9755-e1d5-48ea-b8d5-b81789c9822d None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:14.933705 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2df9755-e1d5-48ea-b8d5-b81789c9822d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:14.939614 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703206a8-7f68-4250-b446-b602fb3ed533 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f827c7670b74d938ffe066ced88d1c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:14.940614 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703206a8-7f68-4250-b446-b602fb3ed533 service cinder] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:14.940990 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703206a8-7f68-4250-b446-b602fb3ed533 service cinder] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:14.941331 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703206a8-7f68-4250-b446-b602fb3ed533 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:14.944898 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-703206a8-7f68-4250-b446-b602fb3ed533 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:20:14.965984 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-b2df9755-e1d5-48ea-b8d5-b81789c9822d None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:20:14.968429 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-b2df9755-e1d5-48ea-b8d5-b81789c9822d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:20:14.982863 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1397/2763] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:20:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:20:14.991408 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2df9755-e1d5-48ea-b8d5-b81789c9822d None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:15.016170 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2df9755-e1d5-48ea-b8d5-b81789c9822d None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:15.016170 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817dc46e-c701-47f3-abf6-97c9ae44cef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:15.016738 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817dc46e-c701-47f3-abf6-97c9ae44cef4 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:15.017358 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817dc46e-c701-47f3-abf6-97c9ae44cef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:15.017770 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817dc46e-c701-47f3-abf6-97c9ae44cef4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:15.018530 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817dc46e-c701-47f3-abf6-97c9ae44cef4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:20:15.018864 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817dc46e-c701-47f3-abf6-97c9ae44cef4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:15.020763 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817dc46e-c701-47f3-abf6-97c9ae44cef4 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:15.034773 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1398/2764] 10.222.0.79 () {58 vars in 1153 bytes} [Tue Aug 30 01:20:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:20:15.040675 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703206a8-7f68-4250-b446-b602fb3ed533 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:15.042118 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703206a8-7f68-4250-b446-b602fb3ed533 service cinder] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:15.042350 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817dc46e-c701-47f3-abf6-97c9ae44cef4 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:15.057429 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817dc46e-c701-47f3-abf6-97c9ae44cef4 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:15.060617 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1367/2765] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:20:14 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 01:20:15.062394 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89888e9c-c907-45f2-a0b2-90cee49877e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:15.062996 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89888e9c-c907-45f2-a0b2-90cee49877e0 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:15.063323 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89888e9c-c907-45f2-a0b2-90cee49877e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:15.063640 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89888e9c-c907-45f2-a0b2-90cee49877e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:15.064222 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89888e9c-c907-45f2-a0b2-90cee49877e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:15.066283 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89888e9c-c907-45f2-a0b2-90cee49877e0 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:15.107005 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1399/2766] 10.222.0.79 () {60 vars in 1153 bytes} [Tue Aug 30 01:20:15 2022] POST /identity/v3/projects => generated 385 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:20:15.108297 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703206a8-7f68-4250-b446-b602fb3ed533 service cinder] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:15.121269 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703206a8-7f68-4250-b446-b602fb3ed533 service cinder] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:15.220354 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59e4c9c-7266-41c2-afaa-4c204a7c9519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:15.221348 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59e4c9c-7266-41c2-afaa-4c204a7c9519 admin admin] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:15.221743 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59e4c9c-7266-41c2-afaa-4c204a7c9519 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:15.222207 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59e4c9c-7266-41c2-afaa-4c204a7c9519 admin admin] PATH_INFO: `/v3/users` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:15.222893 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59e4c9c-7266-41c2-afaa-4c204a7c9519 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:15.225229 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59e4c9c-7266-41c2-afaa-4c204a7c9519 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:15.258265 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1368/2767] 10.222.0.79 () {60 vars in 1144 bytes} [Tue Aug 30 01:20:15 2022] POST /identity/v3/users => generated 293 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:20:15.263642 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89888e9c-c907-45f2-a0b2-90cee49877e0 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:15.283376 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89888e9c-c907-45f2-a0b2-90cee49877e0 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:15.292478 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e478af-dbdd-4dd2-8349-7de82657cf9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:15.293554 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e478af-dbdd-4dd2-8349-7de82657cf9e admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:15.294153 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e478af-dbdd-4dd2-8349-7de82657cf9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:15.294632 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e478af-dbdd-4dd2-8349-7de82657cf9e admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:15.296099 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e478af-dbdd-4dd2-8349-7de82657cf9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:15.298635 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e478af-dbdd-4dd2-8349-7de82657cf9e admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:15.321008 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1400/2768] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:20:15 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:20:15.322467 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59e4c9c-7266-41c2-afaa-4c204a7c9519 admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:15.337680 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59e4c9c-7266-41c2-afaa-4c204a7c9519 admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:15.345646 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fd4971-4cd1-4a2f-930c-358e73374054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:15.346488 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fd4971-4cd1-4a2f-930c-358e73374054 admin admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:15.346928 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fd4971-4cd1-4a2f-930c-358e73374054 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:15.347348 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fd4971-4cd1-4a2f-930c-358e73374054 admin admin] PATH_INFO: `/v3/roles` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:15.348171 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fd4971-4cd1-4a2f-930c-358e73374054 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:15.350574 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fd4971-4cd1-4a2f-930c-358e73374054 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:15.361633 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:20:15.367273 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1369/2769] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:20:15 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 01:20:15.373640 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e478af-dbdd-4dd2-8349-7de82657cf9e admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:15.389132 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e478af-dbdd-4dd2-8349-7de82657cf9e admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:15.394348 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e848f2-d3a5-4b38-bca9-528448f061a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:15.395017 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e848f2-d3a5-4b38-bca9-528448f061a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:15.395326 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e848f2-d3a5-4b38-bca9-528448f061a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:15.395608 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e848f2-d3a5-4b38-bca9-528448f061a6 admin admin] PATH_INFO: `/v3/projects/809ea3cdac044d6b92a6669093b7f8d2/users/1fbf2d0e8cb54a528a692372fd69a7dc/roles/c37945a17623465f899d4f217e7af593` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:15.413856 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e848f2-d3a5-4b38-bca9-528448f061a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=809ea3cdac044d6b92a6669093b7f8d2, user_id=1fbf2d0e8cb54a528a692372fd69a7dc, role_id=c37945a17623465f899d4f217e7af593)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:15.416534 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e848f2-d3a5-4b38-bca9-528448f061a6 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:15.433397 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1401/2770] 10.222.0.79 () {60 vars in 1483 bytes} [Tue Aug 30 01:20:15 2022] PUT /identity/v3/projects/809ea3cdac044d6b92a6669093b7f8d2/users/1fbf2d0e8cb54a528a692372fd69a7dc/roles/c37945a17623465f899d4f217e7af593 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:20:15.450761 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a38541-dab8-48e9-8b1c-12025d05620d None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:15.451292 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a38541-dab8-48e9-8b1c-12025d05620d None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:15.451783 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a38541-dab8-48e9-8b1c-12025d05620d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:15.504159 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-11a38541-dab8-48e9-8b1c-12025d05620d None None] MFA Rules not processed for user `1fbf2d0e8cb54a528a692372fd69a7dc`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:20:15.505432 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-11a38541-dab8-48e9-8b1c-12025d05620d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:20:15.619909 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1370/2771] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:20:15 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:20:15.626850 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e848f2-d3a5-4b38-bca9-528448f061a6 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:15.713113 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e848f2-d3a5-4b38-bca9-528448f061a6 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:15.721029 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c696f08d-acb6-4b61-b9a4-011a901ad320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:15.721829 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c696f08d-acb6-4b61-b9a4-011a901ad320 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:15.722272 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c696f08d-acb6-4b61-b9a4-011a901ad320 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:15.722628 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c696f08d-acb6-4b61-b9a4-011a901ad320 admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:15.723764 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c696f08d-acb6-4b61-b9a4-011a901ad320 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:15.726484 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c696f08d-acb6-4b61-b9a4-011a901ad320 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:15.766959 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1402/2772] 10.222.0.79 () {60 vars in 1153 bytes} [Tue Aug 30 01:20:15 2022] POST /identity/v3/projects => generated 385 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:20:15.773077 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a38541-dab8-48e9-8b1c-12025d05620d None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:15.784839 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a38541-dab8-48e9-8b1c-12025d05620d None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:15.853553 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33744c9a-fe35-4674-85f9-a15f99dc2764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:15.854177 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33744c9a-fe35-4674-85f9-a15f99dc2764 admin admin] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:15.854453 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33744c9a-fe35-4674-85f9-a15f99dc2764 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:15.854723 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33744c9a-fe35-4674-85f9-a15f99dc2764 admin admin] PATH_INFO: `/v3/users` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:15.855415 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33744c9a-fe35-4674-85f9-a15f99dc2764 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:15.857382 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33744c9a-fe35-4674-85f9-a15f99dc2764 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:15.883593 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1371/2773] 10.222.0.79 () {60 vars in 1144 bytes} [Tue Aug 30 01:20:15 2022] POST /identity/v3/users => generated 299 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:20:15.888006 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c696f08d-acb6-4b61-b9a4-011a901ad320 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:15.901033 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c696f08d-acb6-4b61-b9a4-011a901ad320 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:15.906035 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e00750b-0053-4f6c-881f-55a10a3af8e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:15.906659 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e00750b-0053-4f6c-881f-55a10a3af8e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:15.906965 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e00750b-0053-4f6c-881f-55a10a3af8e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:15.907501 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e00750b-0053-4f6c-881f-55a10a3af8e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:15.908170 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e00750b-0053-4f6c-881f-55a10a3af8e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:15.909792 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e00750b-0053-4f6c-881f-55a10a3af8e3 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:15.923450 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1403/2774] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:20:15 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 01:20:15.930395 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33744c9a-fe35-4674-85f9-a15f99dc2764 admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:15.941667 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33744c9a-fe35-4674-85f9-a15f99dc2764 admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:15.947955 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23968430-e3d3-41ec-b8f1-97eacceb27f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:15.948652 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23968430-e3d3-41ec-b8f1-97eacceb27f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:15.948976 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23968430-e3d3-41ec-b8f1-97eacceb27f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:15.949395 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23968430-e3d3-41ec-b8f1-97eacceb27f1 admin admin] PATH_INFO: `/v3/projects/d1cb7d4e1b06458c9fda99436be8f046/users/427139b12e6345098b69545296137c57/roles/d14c3070c9184d76a7b23df69bd3db07` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:15.967645 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23968430-e3d3-41ec-b8f1-97eacceb27f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1cb7d4e1b06458c9fda99436be8f046, user_id=427139b12e6345098b69545296137c57, role_id=d14c3070c9184d76a7b23df69bd3db07)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:15.970706 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23968430-e3d3-41ec-b8f1-97eacceb27f1 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:15.993727 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1372/2775] 10.222.0.79 () {60 vars in 1483 bytes} [Tue Aug 30 01:20:15 2022] PUT /identity/v3/projects/d1cb7d4e1b06458c9fda99436be8f046/users/427139b12e6345098b69545296137c57/roles/d14c3070c9184d76a7b23df69bd3db07 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:20:16.000028 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e00750b-0053-4f6c-881f-55a10a3af8e3 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:16.013342 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e00750b-0053-4f6c-881f-55a10a3af8e3 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:16.072559 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:20:16.100158 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409d7670-0ba5-4e27-9fe4-48ebda00ef33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:16.101222 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409d7670-0ba5-4e27-9fe4-48ebda00ef33 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:16.101716 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409d7670-0ba5-4e27-9fe4-48ebda00ef33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:16.102190 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409d7670-0ba5-4e27-9fe4-48ebda00ef33 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:16.103416 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409d7670-0ba5-4e27-9fe4-48ebda00ef33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:16.106174 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409d7670-0ba5-4e27-9fe4-48ebda00ef33 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:16.124992 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1404/2776] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:20:15 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 01:20:16.130602 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23968430-e3d3-41ec-b8f1-97eacceb27f1 admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:16.142735 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23968430-e3d3-41ec-b8f1-97eacceb27f1 admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:16.147886 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e0c9d9-8ac5-4fa8-8a9a-f5e69927b8e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:16.148585 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e0c9d9-8ac5-4fa8-8a9a-f5e69927b8e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:16.148855 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e0c9d9-8ac5-4fa8-8a9a-f5e69927b8e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:16.149124 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e0c9d9-8ac5-4fa8-8a9a-f5e69927b8e1 admin admin] PATH_INFO: `/v3/projects/d1cb7d4e1b06458c9fda99436be8f046/users/427139b12e6345098b69545296137c57/roles/d14c3070c9184d76a7b23df69bd3db07` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:16.151044 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e0c9d9-8ac5-4fa8-8a9a-f5e69927b8e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1cb7d4e1b06458c9fda99436be8f046, user_id=427139b12e6345098b69545296137c57, role_id=d14c3070c9184d76a7b23df69bd3db07)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:16.153714 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e0c9d9-8ac5-4fa8-8a9a-f5e69927b8e1 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:16.165752 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1373/2777] 10.222.0.79 () {60 vars in 1483 bytes} [Tue Aug 30 01:20:16 2022] PUT /identity/v3/projects/d1cb7d4e1b06458c9fda99436be8f046/users/427139b12e6345098b69545296137c57/roles/d14c3070c9184d76a7b23df69bd3db07 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:20:16.176784 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad980d1-8d24-4f1e-91b6-7c9c3ccb19fa None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:16.177062 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad980d1-8d24-4f1e-91b6-7c9c3ccb19fa None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:16.177323 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad980d1-8d24-4f1e-91b6-7c9c3ccb19fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:16.209792 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-cad980d1-8d24-4f1e-91b6-7c9c3ccb19fa None None] MFA Rules not processed for user `427139b12e6345098b69545296137c57`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:20:16.211009 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-cad980d1-8d24-4f1e-91b6-7c9c3ccb19fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:20:16.303794 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1405/2778] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:20:16 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:20:16.317059 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e0c9d9-8ac5-4fa8-8a9a-f5e69927b8e1 admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:16.384173 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:20:16.398449 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e0c9d9-8ac5-4fa8-8a9a-f5e69927b8e1 admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:16.402792 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1a4d30-73ae-4f57-8a94-c1f199f0b70b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f827c7670b74d938ffe066ced88d1c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:16.403455 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1a4d30-73ae-4f57-8a94-c1f199f0b70b service cinder] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:16.403737 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1a4d30-73ae-4f57-8a94-c1f199f0b70b service cinder] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:16.404003 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1a4d30-73ae-4f57-8a94-c1f199f0b70b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:16.417437 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1a4d30-73ae-4f57-8a94-c1f199f0b70b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:16.418924 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1a4d30-73ae-4f57-8a94-c1f199f0b70b service cinder] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:16.430904 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1374/2779] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:20:16 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:20:16.517483 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad980d1-8d24-4f1e-91b6-7c9c3ccb19fa None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:16.620805 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad980d1-8d24-4f1e-91b6-7c9c3ccb19fa None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:16.626219 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c38775-7633-4c6a-abe0-ff26712a32e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:16.626890 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c38775-7633-4c6a-abe0-ff26712a32e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:16.627210 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c38775-7633-4c6a-abe0-ff26712a32e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:16.627486 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c38775-7633-4c6a-abe0-ff26712a32e4 admin admin] PATH_INFO: `/v3/users/1fbf2d0e8cb54a528a692372fd69a7dc` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:16.629408 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c38775-7633-4c6a-abe0-ff26712a32e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1fbf2d0e8cb54a528a692372fd69a7dc)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:16.632917 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c38775-7633-4c6a-abe0-ff26712a32e4 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:16.724451 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b8c38775-7633-4c6a-abe0-ff26712a32e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1fbf2d0e8cb54a528a692372fd69a7dc'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:16.733946 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b8c38775-7633-4c6a-abe0-ff26712a32e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1fbf2d0e8cb54a528a692372fd69a7dc'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:16.747552 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b8c38775-7633-4c6a-abe0-ff26712a32e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1fbf2d0e8cb54a528a692372fd69a7dc'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:16.748304 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b8c38775-7633-4c6a-abe0-ff26712a32e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1fbf2d0e8cb54a528a692372fd69a7dc'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:16.754357 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:20:16.767632 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b8c38775-7633-4c6a-abe0-ff26712a32e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1fbf2d0e8cb54a528a692372fd69a7dc'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:16.776265 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1406/2780] 10.222.0.79 () {58 vars in 1224 bytes} [Tue Aug 30 01:20:16 2022] DELETE /identity/v3/users/1fbf2d0e8cb54a528a692372fd69a7dc => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:20:16.781161 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ce41d7-4f6c-409c-adb5-7607f0b84594 None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:16.781522 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ce41d7-4f6c-409c-adb5-7607f0b84594 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:16.781857 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ce41d7-4f6c-409c-adb5-7607f0b84594 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:16.804224 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-14ce41d7-4f6c-409c-adb5-7607f0b84594 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:20:16.805600 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-14ce41d7-4f6c-409c-adb5-7607f0b84594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:20:16.858397 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c38775-7633-4c6a-abe0-ff26712a32e4 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:16.859852 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-b8c38775-7633-4c6a-abe0-ff26712a32e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:20:16.902177 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1375/2781] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:20:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:20:16.916027 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ce41d7-4f6c-409c-adb5-7607f0b84594 None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:16.919032 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-14ce41d7-4f6c-409c-adb5-7607f0b84594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:20:16.953347 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c38775-7633-4c6a-abe0-ff26712a32e4 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:16.958540 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd068b7-2631-4b32-b9bc-784c1796bbeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:16.959336 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd068b7-2631-4b32-b9bc-784c1796bbeb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:16.959622 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd068b7-2631-4b32-b9bc-784c1796bbeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:16.959969 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd068b7-2631-4b32-b9bc-784c1796bbeb admin admin] PATH_INFO: `/v3/users/1b58af6ce4ad4f959f80649c1b9f256f` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:16.961167 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd068b7-2631-4b32-b9bc-784c1796bbeb admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b58af6ce4ad4f959f80649c1b9f256f)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:16.963100 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd068b7-2631-4b32-b9bc-784c1796bbeb admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:17.014562 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ce41d7-4f6c-409c-adb5-7607f0b84594 None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:17.018296 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09810116-dcc2-40c8-9958-3e4a8805e84c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16e6a0ca26fc4ef892c188ad89a1e132', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:17.018934 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09810116-dcc2-40c8-9958-3e4a8805e84c service neutron] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:17.019248 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09810116-dcc2-40c8-9958-3e4a8805e84c service neutron] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:17.019504 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09810116-dcc2-40c8-9958-3e4a8805e84c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:17.030283 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09810116-dcc2-40c8-9958-3e4a8805e84c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:17.030533 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-bcd068b7-2631-4b32-b9bc-784c1796bbeb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b58af6ce4ad4f959f80649c1b9f256f'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:17.031823 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09810116-dcc2-40c8-9958-3e4a8805e84c service neutron] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:17.041006 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-bcd068b7-2631-4b32-b9bc-784c1796bbeb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b58af6ce4ad4f959f80649c1b9f256f'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:17.043343 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1376/2782] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:20:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:20:17.056060 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-bcd068b7-2631-4b32-b9bc-784c1796bbeb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b58af6ce4ad4f959f80649c1b9f256f'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:17.057231 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-bcd068b7-2631-4b32-b9bc-784c1796bbeb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b58af6ce4ad4f959f80649c1b9f256f'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:17.079543 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-bcd068b7-2631-4b32-b9bc-784c1796bbeb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b58af6ce4ad4f959f80649c1b9f256f'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:17.090547 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1407/2783] 10.222.0.79 () {58 vars in 1224 bytes} [Tue Aug 30 01:20:16 2022] DELETE /identity/v3/users/1b58af6ce4ad4f959f80649c1b9f256f => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:20:17.098528 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50968102-cb63-46eb-abe6-c9e02e62b7f2 None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:17.098821 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50968102-cb63-46eb-abe6-c9e02e62b7f2 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:17.099120 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50968102-cb63-46eb-abe6-c9e02e62b7f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:17.131245 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-50968102-cb63-46eb-abe6-c9e02e62b7f2 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:20:17.133701 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-50968102-cb63-46eb-abe6-c9e02e62b7f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:20:17.232693 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1377/2784] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:20:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:20:17.252700 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd068b7-2631-4b32-b9bc-784c1796bbeb admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:17.254262 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-bcd068b7-2631-4b32-b9bc-784c1796bbeb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:20:17.327796 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd068b7-2631-4b32-b9bc-784c1796bbeb admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:17.331886 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbb4e77-ea7d-4259-a5cb-904e0416b44b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16e6a0ca26fc4ef892c188ad89a1e132', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:17.332582 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbb4e77-ea7d-4259-a5cb-904e0416b44b service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:17.332927 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbb4e77-ea7d-4259-a5cb-904e0416b44b service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:17.333263 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbb4e77-ea7d-4259-a5cb-904e0416b44b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:17.344419 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbb4e77-ea7d-4259-a5cb-904e0416b44b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:17.345863 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbb4e77-ea7d-4259-a5cb-904e0416b44b service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:17.356392 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1408/2785] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:20:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 01:20:17.426559 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50968102-cb63-46eb-abe6-c9e02e62b7f2 None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:17.428981 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-50968102-cb63-46eb-abe6-c9e02e62b7f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:20:17.442759 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50968102-cb63-46eb-abe6-c9e02e62b7f2 None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:17.450003 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb71878-f352-4bca-bc11-08b225546439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:17.450672 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb71878-f352-4bca-bc11-08b225546439 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:17.451105 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb71878-f352-4bca-bc11-08b225546439 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:17.451264 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb71878-f352-4bca-bc11-08b225546439 admin admin] PATH_INFO: `/v3/projects/809ea3cdac044d6b92a6669093b7f8d2` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:17.452541 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb71878-f352-4bca-bc11-08b225546439 admin admin] RBAC: Authorizing `identity:delete_project(project_id=809ea3cdac044d6b92a6669093b7f8d2)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:17.454559 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb71878-f352-4bca-bc11-08b225546439 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:17.492787 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:20:17.530872 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-7bb71878-f352-4bca-bc11-08b225546439 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '809ea3cdac044d6b92a6669093b7f8d2', 'request_id': 'req-7bb71878-f352-4bca-bc11-08b225546439'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:17.548313 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-7bb71878-f352-4bca-bc11-08b225546439 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '809ea3cdac044d6b92a6669093b7f8d2', 'request_id': 'req-7bb71878-f352-4bca-bc11-08b225546439'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:17.556042 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-7bb71878-f352-4bca-bc11-08b225546439 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '809ea3cdac044d6b92a6669093b7f8d2', 'request_id': 'req-7bb71878-f352-4bca-bc11-08b225546439'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:17.572324 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-7bb71878-f352-4bca-bc11-08b225546439 admin admin] The token cache is being invalidate because project 809ea3cdac044d6b92a6669093b7f8d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81998) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:20:17.572621 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-7bb71878-f352-4bca-bc11-08b225546439 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:17.573309 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-7bb71878-f352-4bca-bc11-08b225546439 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:17.574867 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1378/2786] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 30 01:20:17 2022] DELETE /identity/v3/projects/809ea3cdac044d6b92a6669093b7f8d2 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:20:17.579118 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbb4e77-ea7d-4259-a5cb-904e0416b44b service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:17.592801 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbb4e77-ea7d-4259-a5cb-904e0416b44b service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:17.598040 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:20:17.674834 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b34f62-0b37-41e9-947d-add80061c3b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:17.675364 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b34f62-0b37-41e9-947d-add80061c3b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:17.675630 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b34f62-0b37-41e9-947d-add80061c3b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:17.675896 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b34f62-0b37-41e9-947d-add80061c3b8 admin admin] PATH_INFO: `/v3/users/427139b12e6345098b69545296137c57` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:17.677089 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b34f62-0b37-41e9-947d-add80061c3b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=427139b12e6345098b69545296137c57)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:17.679969 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b34f62-0b37-41e9-947d-add80061c3b8 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:17.700474 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb71878-f352-4bca-bc11-08b225546439 admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:17.702629 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-7bb71878-f352-4bca-bc11-08b225546439 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:20:17.737205 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb71878-f352-4bca-bc11-08b225546439 admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:17.748084 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-e9b34f62-0b37-41e9-947d-add80061c3b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '427139b12e6345098b69545296137c57'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:17.750013 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1f69da-f089-41e8-98c1-239c74c1053a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:17.752010 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1f69da-f089-41e8-98c1-239c74c1053a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:17.752662 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1f69da-f089-41e8-98c1-239c74c1053a admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:17.753766 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1f69da-f089-41e8-98c1-239c74c1053a admin admin] PATH_INFO: `/v3/projects/759c78b2e7d94556bd516114eff46b4b` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:17.756308 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1f69da-f089-41e8-98c1-239c74c1053a admin admin] RBAC: Authorizing `identity:delete_project(project_id=759c78b2e7d94556bd516114eff46b4b)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:17.761711 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1f69da-f089-41e8-98c1-239c74c1053a admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:17.778486 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-e9b34f62-0b37-41e9-947d-add80061c3b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '427139b12e6345098b69545296137c57'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:17.786152 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-e9b34f62-0b37-41e9-947d-add80061c3b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '427139b12e6345098b69545296137c57'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:17.787758 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-e9b34f62-0b37-41e9-947d-add80061c3b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '427139b12e6345098b69545296137c57'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:17.806901 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-e9b34f62-0b37-41e9-947d-add80061c3b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '427139b12e6345098b69545296137c57'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:17.822427 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1409/2787] 10.222.0.79 () {58 vars in 1224 bytes} [Tue Aug 30 01:20:17 2022] DELETE /identity/v3/users/427139b12e6345098b69545296137c57 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:20:17.836065 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-bf1f69da-f089-41e8-98c1-239c74c1053a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '759c78b2e7d94556bd516114eff46b4b', 'request_id': 'req-bf1f69da-f089-41e8-98c1-239c74c1053a'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:17.845773 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-bf1f69da-f089-41e8-98c1-239c74c1053a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '759c78b2e7d94556bd516114eff46b4b', 'request_id': 'req-bf1f69da-f089-41e8-98c1-239c74c1053a'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:17.854457 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-bf1f69da-f089-41e8-98c1-239c74c1053a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '759c78b2e7d94556bd516114eff46b4b', 'request_id': 'req-bf1f69da-f089-41e8-98c1-239c74c1053a'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:17.869570 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-bf1f69da-f089-41e8-98c1-239c74c1053a admin admin] The token cache is being invalidate because project 759c78b2e7d94556bd516114eff46b4b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81998) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:20:17.869847 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-bf1f69da-f089-41e8-98c1-239c74c1053a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:17.870882 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-bf1f69da-f089-41e8-98c1-239c74c1053a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:17.872810 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1379/2788] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 30 01:20:17 2022] DELETE /identity/v3/projects/759c78b2e7d94556bd516114eff46b4b => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:20:17.876792 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b34f62-0b37-41e9-947d-add80061c3b8 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:17.878281 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-e9b34f62-0b37-41e9-947d-add80061c3b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:20:17.965106 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b34f62-0b37-41e9-947d-add80061c3b8 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:18.004748 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:20:18.059940 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8001fd02-3ba2-48e8-b814-e767faa35a82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:18.061060 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8001fd02-3ba2-48e8-b814-e767faa35a82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:18.061594 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8001fd02-3ba2-48e8-b814-e767faa35a82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:18.062068 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8001fd02-3ba2-48e8-b814-e767faa35a82 admin admin] PATH_INFO: `/v3/users/30630a249255430687bbb5e44ff82db5` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:18.065365 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8001fd02-3ba2-48e8-b814-e767faa35a82 admin admin] RBAC: Authorizing `identity:delete_user(user_id=30630a249255430687bbb5e44ff82db5)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:18.070910 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8001fd02-3ba2-48e8-b814-e767faa35a82 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:18.160422 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-8001fd02-3ba2-48e8-b814-e767faa35a82 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30630a249255430687bbb5e44ff82db5'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:18.171040 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-8001fd02-3ba2-48e8-b814-e767faa35a82 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30630a249255430687bbb5e44ff82db5'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:18.183673 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-8001fd02-3ba2-48e8-b814-e767faa35a82 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30630a249255430687bbb5e44ff82db5'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:18.185206 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-8001fd02-3ba2-48e8-b814-e767faa35a82 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30630a249255430687bbb5e44ff82db5'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:18.221017 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-8001fd02-3ba2-48e8-b814-e767faa35a82 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30630a249255430687bbb5e44ff82db5'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:18.236039 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1f69da-f089-41e8-98c1-239c74c1053a admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:18.243181 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-bf1f69da-f089-41e8-98c1-239c74c1053a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:20:18.255312 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1410/2789] 10.222.0.79 () {58 vars in 1224 bytes} [Tue Aug 30 01:20:17 2022] DELETE /identity/v3/users/30630a249255430687bbb5e44ff82db5 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:20:18.280225 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1f69da-f089-41e8-98c1-239c74c1053a admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:18.404414 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c872f9cc-fe79-47e9-bec2-d743e2a9f88b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:18.405806 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c872f9cc-fe79-47e9-bec2-d743e2a9f88b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:18.406260 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c872f9cc-fe79-47e9-bec2-d743e2a9f88b admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:18.407275 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c872f9cc-fe79-47e9-bec2-d743e2a9f88b admin admin] PATH_INFO: `/v3/projects/d1cb7d4e1b06458c9fda99436be8f046` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:18.408543 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c872f9cc-fe79-47e9-bec2-d743e2a9f88b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1cb7d4e1b06458c9fda99436be8f046)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:18.410487 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c872f9cc-fe79-47e9-bec2-d743e2a9f88b admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:18.466797 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:20:18.479361 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-c872f9cc-fe79-47e9-bec2-d743e2a9f88b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1cb7d4e1b06458c9fda99436be8f046', 'request_id': 'req-c872f9cc-fe79-47e9-bec2-d743e2a9f88b'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:18.489031 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-c872f9cc-fe79-47e9-bec2-d743e2a9f88b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1cb7d4e1b06458c9fda99436be8f046', 'request_id': 'req-c872f9cc-fe79-47e9-bec2-d743e2a9f88b'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:18.496707 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-c872f9cc-fe79-47e9-bec2-d743e2a9f88b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1cb7d4e1b06458c9fda99436be8f046', 'request_id': 'req-c872f9cc-fe79-47e9-bec2-d743e2a9f88b'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:18.510198 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-c872f9cc-fe79-47e9-bec2-d743e2a9f88b admin admin] The token cache is being invalidate because project d1cb7d4e1b06458c9fda99436be8f046 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81998) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:20:18.510508 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-c872f9cc-fe79-47e9-bec2-d743e2a9f88b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:18.511708 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-c872f9cc-fe79-47e9-bec2-d743e2a9f88b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:18.512945 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1380/2790] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 30 01:20:18 2022] DELETE /identity/v3/projects/d1cb7d4e1b06458c9fda99436be8f046 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:20:18.522018 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f278531-acfb-4b2f-81fe-f3b7aae2a734 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:18.522533 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f278531-acfb-4b2f-81fe-f3b7aae2a734 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:18.523121 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f278531-acfb-4b2f-81fe-f3b7aae2a734 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:18.573854 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-9f278531-acfb-4b2f-81fe-f3b7aae2a734 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:20:18.576243 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-9f278531-acfb-4b2f-81fe-f3b7aae2a734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:20:18.660845 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1411/2791] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:20:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:20:18.670096 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0872ae86-dedc-443c-b981-88580a86e299 None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:18.670407 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0872ae86-dedc-443c-b981-88580a86e299 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:18.670666 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0872ae86-dedc-443c-b981-88580a86e299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:18.693612 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-0872ae86-dedc-443c-b981-88580a86e299 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:20:18.694939 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-0872ae86-dedc-443c-b981-88580a86e299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:20:18.703732 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1381/2792] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:20:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:20:18.709738 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f278531-acfb-4b2f-81fe-f3b7aae2a734 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:18.721996 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f278531-acfb-4b2f-81fe-f3b7aae2a734 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:18.728515 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb644e9-3063-45ed-b5ae-26154589ca03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:18.729335 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb644e9-3063-45ed-b5ae-26154589ca03 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:18.729753 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb644e9-3063-45ed-b5ae-26154589ca03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:18.730073 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb644e9-3063-45ed-b5ae-26154589ca03 admin admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:18.731018 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb644e9-3063-45ed-b5ae-26154589ca03 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:20:18.731388 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb644e9-3063-45ed-b5ae-26154589ca03 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:18.733646 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb644e9-3063-45ed-b5ae-26154589ca03 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:18.746574 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0872ae86-dedc-443c-b981-88580a86e299 None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:18.748914 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-0872ae86-dedc-443c-b981-88580a86e299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:20:18.750866 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1412/2793] 10.222.0.79 () {58 vars in 1153 bytes} [Tue Aug 30 01:20:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:20:18.755415 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb644e9-3063-45ed-b5ae-26154589ca03 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:18.765800 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0872ae86-dedc-443c-b981-88580a86e299 None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:18.769029 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb644e9-3063-45ed-b5ae-26154589ca03 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:18.775818 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf68fe0-402f-41c7-ad4b-f62b8c85dfdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:18.776661 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf68fe0-402f-41c7-ad4b-f62b8c85dfdc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:18.777152 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf68fe0-402f-41c7-ad4b-f62b8c85dfdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:18.777689 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf68fe0-402f-41c7-ad4b-f62b8c85dfdc admin admin] PATH_INFO: `/v3/projects/36616f6fbed248019bad7ee72b3795a9` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:18.778853 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf68fe0-402f-41c7-ad4b-f62b8c85dfdc admin admin] RBAC: Authorizing `identity:delete_project(project_id=36616f6fbed248019bad7ee72b3795a9)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:18.780960 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf68fe0-402f-41c7-ad4b-f62b8c85dfdc admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:18.781439 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1990d1-3917-4f10-a8ad-104258396ab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:18.782474 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1990d1-3917-4f10-a8ad-104258396ab6 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:18.784240 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1990d1-3917-4f10-a8ad-104258396ab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:18.784615 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1990d1-3917-4f10-a8ad-104258396ab6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:18.785617 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1990d1-3917-4f10-a8ad-104258396ab6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:18.790134 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1990d1-3917-4f10-a8ad-104258396ab6 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:18.832656 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1413/2794] 10.222.0.79 () {60 vars in 1153 bytes} [Tue Aug 30 01:20:18 2022] POST /identity/v3/projects => generated 383 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:20:18.839040 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1990d1-3917-4f10-a8ad-104258396ab6 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:18.852229 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-7cf68fe0-402f-41c7-ad4b-f62b8c85dfdc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36616f6fbed248019bad7ee72b3795a9', 'request_id': 'req-7cf68fe0-402f-41c7-ad4b-f62b8c85dfdc'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:18.865775 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-7cf68fe0-402f-41c7-ad4b-f62b8c85dfdc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36616f6fbed248019bad7ee72b3795a9', 'request_id': 'req-7cf68fe0-402f-41c7-ad4b-f62b8c85dfdc'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:18.872252 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:20:18.875809 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-7cf68fe0-402f-41c7-ad4b-f62b8c85dfdc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36616f6fbed248019bad7ee72b3795a9', 'request_id': 'req-7cf68fe0-402f-41c7-ad4b-f62b8c85dfdc'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:18.890835 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-7cf68fe0-402f-41c7-ad4b-f62b8c85dfdc admin admin] The token cache is being invalidate because project 36616f6fbed248019bad7ee72b3795a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81998) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:20:18.891154 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-7cf68fe0-402f-41c7-ad4b-f62b8c85dfdc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:18.891853 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-7cf68fe0-402f-41c7-ad4b-f62b8c85dfdc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:18.894406 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1382/2795] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 30 01:20:18 2022] DELETE /identity/v3/projects/36616f6fbed248019bad7ee72b3795a9 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:20:18.900716 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e94427-f572-4fdf-b228-ea35afb6ae6b None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:18.901113 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e94427-f572-4fdf-b228-ea35afb6ae6b None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:18.901546 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e94427-f572-4fdf-b228-ea35afb6ae6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:18.939466 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-76e94427-f572-4fdf-b228-ea35afb6ae6b None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:20:18.941049 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-76e94427-f572-4fdf-b228-ea35afb6ae6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:20:18.945613 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1990d1-3917-4f10-a8ad-104258396ab6 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:18.950831 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69eadf4f-b32d-4041-a507-15d0bdb7d2bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:18.951569 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1383/2796] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:20:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:20:18.957239 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eadf4f-b32d-4041-a507-15d0bdb7d2bf admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:18.957239 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eadf4f-b32d-4041-a507-15d0bdb7d2bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:18.957239 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eadf4f-b32d-4041-a507-15d0bdb7d2bf admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:18.957239 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69eadf4f-b32d-4041-a507-15d0bdb7d2bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:18.957239 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69eadf4f-b32d-4041-a507-15d0bdb7d2bf admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:18.960848 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb32449-17b7-4909-ade9-da782143f7ca None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:18.961137 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb32449-17b7-4909-ade9-da782143f7ca None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:18.961406 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb32449-17b7-4909-ade9-da782143f7ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:18.983161 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1414/2797] 10.222.0.79 () {60 vars in 1144 bytes} [Tue Aug 30 01:20:18 2022] POST /identity/v3/users => generated 292 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:20:18.984507 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-1bb32449-17b7-4909-ade9-da782143f7ca None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:20:18.985725 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-1bb32449-17b7-4909-ade9-da782143f7ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:20:18.987293 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69eadf4f-b32d-4041-a507-15d0bdb7d2bf admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:18.989005 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-69eadf4f-b32d-4041-a507-15d0bdb7d2bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:20:18.995533 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1384/2798] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:20:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:20:18.999868 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb32449-17b7-4909-ade9-da782143f7ca None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:19.004093 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69eadf4f-b32d-4041-a507-15d0bdb7d2bf admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:19.010877 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fcf556-5f45-478b-904b-c118286e6529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:19.011178 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb32449-17b7-4909-ade9-da782143f7ca None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:19.011799 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fcf556-5f45-478b-904b-c118286e6529 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:19.012184 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fcf556-5f45-478b-904b-c118286e6529 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:19.012482 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fcf556-5f45-478b-904b-c118286e6529 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:19.013209 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fcf556-5f45-478b-904b-c118286e6529 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:19.014915 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fcf556-5f45-478b-904b-c118286e6529 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:19.015999 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33efa202-2912-4b18-be04-501f03e69ac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:19.016607 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33efa202-2912-4b18-be04-501f03e69ac3 admin admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:19.016884 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33efa202-2912-4b18-be04-501f03e69ac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:19.017173 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33efa202-2912-4b18-be04-501f03e69ac3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:19.017806 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33efa202-2912-4b18-be04-501f03e69ac3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:20:19.018106 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33efa202-2912-4b18-be04-501f03e69ac3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:19.019753 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33efa202-2912-4b18-be04-501f03e69ac3 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:19.026899 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1415/2799] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:20:18 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 01:20:19.031244 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fcf556-5f45-478b-904b-c118286e6529 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:19.036123 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1385/2800] 10.222.0.79 () {58 vars in 1153 bytes} [Tue Aug 30 01:20:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:20:19.039054 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33efa202-2912-4b18-be04-501f03e69ac3 admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:19.042346 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fcf556-5f45-478b-904b-c118286e6529 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:19.047520 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad11d30c-fc68-41b5-bae2-c5d60530a807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:19.048258 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad11d30c-fc68-41b5-bae2-c5d60530a807 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:19.048545 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad11d30c-fc68-41b5-bae2-c5d60530a807 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:19.048819 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad11d30c-fc68-41b5-bae2-c5d60530a807 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:19.049540 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad11d30c-fc68-41b5-bae2-c5d60530a807 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:19.051077 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad11d30c-fc68-41b5-bae2-c5d60530a807 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:19.054707 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33efa202-2912-4b18-be04-501f03e69ac3 admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:19.061052 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad59cf9b-2726-4e15-b2c6-0219e06a0afd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:19.061666 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad59cf9b-2726-4e15-b2c6-0219e06a0afd admin admin] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:19.061945 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad59cf9b-2726-4e15-b2c6-0219e06a0afd admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:19.062216 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad59cf9b-2726-4e15-b2c6-0219e06a0afd admin admin] PATH_INFO: `/v3/projects` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:19.062880 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad59cf9b-2726-4e15-b2c6-0219e06a0afd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:19.063661 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1416/2801] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:20:19 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 01:20:19.064889 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad59cf9b-2726-4e15-b2c6-0219e06a0afd admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:19.068142 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad11d30c-fc68-41b5-bae2-c5d60530a807 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:19.078841 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad11d30c-fc68-41b5-bae2-c5d60530a807 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:19.084801 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b38e4ee-fe6c-4290-93af-2954b6253374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:19.085770 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b38e4ee-fe6c-4290-93af-2954b6253374 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:19.086052 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b38e4ee-fe6c-4290-93af-2954b6253374 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:19.086325 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b38e4ee-fe6c-4290-93af-2954b6253374 admin admin] PATH_INFO: `/v3/projects/b70aab4a4f1440de9df945835d027805/users/3045f7ddc7654c628eeacfaddd2dc800/roles/c37945a17623465f899d4f217e7af593` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:19.097462 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1386/2802] 10.222.0.79 () {60 vars in 1153 bytes} [Tue Aug 30 01:20:19 2022] POST /identity/v3/projects => generated 389 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:20:19.102587 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad59cf9b-2726-4e15-b2c6-0219e06a0afd admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:19.102925 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b38e4ee-fe6c-4290-93af-2954b6253374 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b70aab4a4f1440de9df945835d027805, user_id=3045f7ddc7654c628eeacfaddd2dc800, role_id=c37945a17623465f899d4f217e7af593)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:19.105626 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b38e4ee-fe6c-4290-93af-2954b6253374 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:19.121410 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1417/2803] 10.222.0.79 () {60 vars in 1483 bytes} [Tue Aug 30 01:20:19 2022] PUT /identity/v3/projects/b70aab4a4f1440de9df945835d027805/users/3045f7ddc7654c628eeacfaddd2dc800/roles/c37945a17623465f899d4f217e7af593 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:20:19.133036 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04fec3b-af28-4b00-a262-38f0ba579528 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:19.133304 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04fec3b-af28-4b00-a262-38f0ba579528 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:19.133563 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04fec3b-af28-4b00-a262-38f0ba579528 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:19.164094 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-c04fec3b-af28-4b00-a262-38f0ba579528 None None] MFA Rules not processed for user `3045f7ddc7654c628eeacfaddd2dc800`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:20:19.165351 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-c04fec3b-af28-4b00-a262-38f0ba579528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:20:19.180599 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:20:19.199173 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad59cf9b-2726-4e15-b2c6-0219e06a0afd admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:19.261980 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1418/2804] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:20:19 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:20:19.272301 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd1f310-4eab-493e-a256-115e31ca1aab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:19.272982 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd1f310-4eab-493e-a256-115e31ca1aab admin admin] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:19.273264 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd1f310-4eab-493e-a256-115e31ca1aab admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:19.273473 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04fec3b-af28-4b00-a262-38f0ba579528 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:19.273583 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd1f310-4eab-493e-a256-115e31ca1aab admin admin] PATH_INFO: `/v3/users` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:19.274652 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd1f310-4eab-493e-a256-115e31ca1aab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:19.274934 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-c04fec3b-af28-4b00-a262-38f0ba579528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:20:19.276618 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd1f310-4eab-493e-a256-115e31ca1aab admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:19.303637 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1387/2805] 10.222.0.79 () {60 vars in 1144 bytes} [Tue Aug 30 01:20:19 2022] POST /identity/v3/users => generated 295 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:20:19.307843 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd1f310-4eab-493e-a256-115e31ca1aab admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:19.320748 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd1f310-4eab-493e-a256-115e31ca1aab admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:19.326803 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c218497c-9133-433e-9635-98f779b17386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:19.327598 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c218497c-9133-433e-9635-98f779b17386 admin admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:19.328056 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c218497c-9133-433e-9635-98f779b17386 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:19.328416 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c218497c-9133-433e-9635-98f779b17386 admin admin] PATH_INFO: `/v3/roles` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:19.329244 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c218497c-9133-433e-9635-98f779b17386 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:19.331340 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c218497c-9133-433e-9635-98f779b17386 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:19.344802 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04fec3b-af28-4b00-a262-38f0ba579528 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:19.346466 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1388/2806] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:20:19 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 01:20:19.347479 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c218497c-9133-433e-9635-98f779b17386 admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:19.352545 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e584451-3fc1-4438-bb3f-d09909daa9c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f827c7670b74d938ffe066ced88d1c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:19.353512 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e584451-3fc1-4438-bb3f-d09909daa9c9 service cinder] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:19.353960 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e584451-3fc1-4438-bb3f-d09909daa9c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:19.354350 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e584451-3fc1-4438-bb3f-d09909daa9c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:19.359594 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c218497c-9133-433e-9635-98f779b17386 admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:19.363616 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:20:19.364627 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bf9344-bcb0-4386-a79e-be9cce8c3161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:19.366228 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bf9344-bcb0-4386-a79e-be9cce8c3161 admin admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:19.366513 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bf9344-bcb0-4386-a79e-be9cce8c3161 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:19.366789 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bf9344-bcb0-4386-a79e-be9cce8c3161 admin admin] PATH_INFO: `/v3/roles` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:19.367882 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bf9344-bcb0-4386-a79e-be9cce8c3161 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:19.369579 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bf9344-bcb0-4386-a79e-be9cce8c3161 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:19.377400 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e584451-3fc1-4438-bb3f-d09909daa9c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:19.379357 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e584451-3fc1-4438-bb3f-d09909daa9c9 service cinder] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:19.386520 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1389/2807] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:20:19 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:20:19.391038 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1419/2808] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:20:19 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:20:19.391983 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bf9344-bcb0-4386-a79e-be9cce8c3161 admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:19.408009 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bf9344-bcb0-4386-a79e-be9cce8c3161 admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:19.412622 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75888b9-222b-4f75-988f-92b9cf266f31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:19.413314 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75888b9-222b-4f75-988f-92b9cf266f31 admin admin] REQUEST_METHOD: `PUT` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:19.413757 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75888b9-222b-4f75-988f-92b9cf266f31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:19.414268 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75888b9-222b-4f75-988f-92b9cf266f31 admin admin] PATH_INFO: `/v3/projects/ce716485e90346348042a602fb013e2e/users/f6573e5006484383a529b73b82d80134/roles/c37945a17623465f899d4f217e7af593` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:19.415265 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e584451-3fc1-4438-bb3f-d09909daa9c9 service cinder] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:19.431368 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e584451-3fc1-4438-bb3f-d09909daa9c9 service cinder] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:19.436131 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75888b9-222b-4f75-988f-92b9cf266f31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce716485e90346348042a602fb013e2e, user_id=f6573e5006484383a529b73b82d80134, role_id=c37945a17623465f899d4f217e7af593)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:19.438913 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75888b9-222b-4f75-988f-92b9cf266f31 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:19.439216 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aab8bba-1353-4b0b-8796-3791fb00c037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:19.439665 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aab8bba-1353-4b0b-8796-3791fb00c037 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:19.439938 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aab8bba-1353-4b0b-8796-3791fb00c037 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:19.440204 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aab8bba-1353-4b0b-8796-3791fb00c037 admin admin] PATH_INFO: `/v3/users/3045f7ddc7654c628eeacfaddd2dc800` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:19.441367 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aab8bba-1353-4b0b-8796-3791fb00c037 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3045f7ddc7654c628eeacfaddd2dc800)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:19.443736 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aab8bba-1353-4b0b-8796-3791fb00c037 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:19.458418 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1390/2809] 10.222.0.79 () {60 vars in 1483 bytes} [Tue Aug 30 01:20:19 2022] PUT /identity/v3/projects/ce716485e90346348042a602fb013e2e/users/f6573e5006484383a529b73b82d80134/roles/c37945a17623465f899d4f217e7af593 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:20:19.458418 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75888b9-222b-4f75-988f-92b9cf266f31 admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:19.458418 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-e75888b9-222b-4f75-988f-92b9cf266f31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:20:19.514691 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-0aab8bba-1353-4b0b-8796-3791fb00c037 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3045f7ddc7654c628eeacfaddd2dc800'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:19.526757 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-0aab8bba-1353-4b0b-8796-3791fb00c037 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3045f7ddc7654c628eeacfaddd2dc800'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:19.538175 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-0aab8bba-1353-4b0b-8796-3791fb00c037 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3045f7ddc7654c628eeacfaddd2dc800'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:19.539090 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-0aab8bba-1353-4b0b-8796-3791fb00c037 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3045f7ddc7654c628eeacfaddd2dc800'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:19.555848 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75888b9-222b-4f75-988f-92b9cf266f31 admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:19.558369 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-0aab8bba-1353-4b0b-8796-3791fb00c037 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3045f7ddc7654c628eeacfaddd2dc800'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:19.560768 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0aaa01f-c526-4892-ab11-c344dfdbf41f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:19.561600 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aaa01f-c526-4892-ab11-c344dfdbf41f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:19.561922 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aaa01f-c526-4892-ab11-c344dfdbf41f admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:19.562243 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aaa01f-c526-4892-ab11-c344dfdbf41f admin admin] PATH_INFO: `/v3/users/a7fc51d83bbd4ee4aad62792e3fb2bc3` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:19.563660 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0aaa01f-c526-4892-ab11-c344dfdbf41f admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7fc51d83bbd4ee4aad62792e3fb2bc3)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:19.563781 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1420/2810] 10.222.0.79 () {58 vars in 1224 bytes} [Tue Aug 30 01:20:19 2022] DELETE /identity/v3/users/3045f7ddc7654c628eeacfaddd2dc800 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:20:19.565071 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d80cd5-494b-43cb-8e25-307821a99e2b None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:19.565376 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d80cd5-494b-43cb-8e25-307821a99e2b None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:19.565680 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d80cd5-494b-43cb-8e25-307821a99e2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:19.567646 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0aaa01f-c526-4892-ab11-c344dfdbf41f admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:19.602038 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-32d80cd5-494b-43cb-8e25-307821a99e2b None None] MFA Rules not processed for user `f6573e5006484383a529b73b82d80134`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:20:19.603588 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-32d80cd5-494b-43cb-8e25-307821a99e2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:20:19.627732 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:20:19.630160 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-c0aaa01f-c526-4892-ab11-c344dfdbf41f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7fc51d83bbd4ee4aad62792e3fb2bc3'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:19.640306 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-c0aaa01f-c526-4892-ab11-c344dfdbf41f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7fc51d83bbd4ee4aad62792e3fb2bc3'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:19.659776 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-c0aaa01f-c526-4892-ab11-c344dfdbf41f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7fc51d83bbd4ee4aad62792e3fb2bc3'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:19.660844 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-c0aaa01f-c526-4892-ab11-c344dfdbf41f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7fc51d83bbd4ee4aad62792e3fb2bc3'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:19.670725 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-c0aaa01f-c526-4892-ab11-c344dfdbf41f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7fc51d83bbd4ee4aad62792e3fb2bc3'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:19.678141 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1391/2811] 10.222.0.79 () {58 vars in 1224 bytes} [Tue Aug 30 01:20:19 2022] DELETE /identity/v3/users/a7fc51d83bbd4ee4aad62792e3fb2bc3 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:20:19.680562 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727d1e88-b9f1-4df1-af94-256a60a34c22 None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:19.681046 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727d1e88-b9f1-4df1-af94-256a60a34c22 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:19.681553 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727d1e88-b9f1-4df1-af94-256a60a34c22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:19.697724 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1421/2812] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:20:19 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:20:19.699038 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6db61e-4668-4f88-bbd4-ca91d4c52263 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:19.699355 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6db61e-4668-4f88-bbd4-ca91d4c52263 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:19.699639 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6db61e-4668-4f88-bbd4-ca91d4c52263 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:19.710109 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-727d1e88-b9f1-4df1-af94-256a60a34c22 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:20:19.711458 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-727d1e88-b9f1-4df1-af94-256a60a34c22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:20:19.721664 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-ed6db61e-4668-4f88-bbd4-ca91d4c52263 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:20:19.722905 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-ed6db61e-4668-4f88-bbd4-ca91d4c52263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:20:19.778581 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:20:19.780190 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1392/2813] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:20:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:20:19.780739 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727d1e88-b9f1-4df1-af94-256a60a34c22 None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:19.782103 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-727d1e88-b9f1-4df1-af94-256a60a34c22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:20:19.794705 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727d1e88-b9f1-4df1-af94-256a60a34c22 None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:19.799512 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218f582b-84a5-45d4-b55b-19588a284d8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:19.800094 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218f582b-84a5-45d4-b55b-19588a284d8a admin admin] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:19.800317 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218f582b-84a5-45d4-b55b-19588a284d8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:19.800577 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218f582b-84a5-45d4-b55b-19588a284d8a admin admin] PATH_INFO: `/v3/projects` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:19.801227 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218f582b-84a5-45d4-b55b-19588a284d8a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:19.803466 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218f582b-84a5-45d4-b55b-19588a284d8a admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:19.807099 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1422/2814] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:20:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:20:19.807755 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6db61e-4668-4f88-bbd4-ca91d4c52263 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:19.809098 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-ed6db61e-4668-4f88-bbd4-ca91d4c52263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:20:19.847718 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1393/2815] 10.222.0.79 () {60 vars in 1153 bytes} [Tue Aug 30 01:20:19 2022] POST /identity/v3/projects => generated 387 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:20:19.848583 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218f582b-84a5-45d4-b55b-19588a284d8a admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:19.850877 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-218f582b-84a5-45d4-b55b-19588a284d8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:20:19.881987 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6db61e-4668-4f88-bbd4-ca91d4c52263 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:19.922636 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218f582b-84a5-45d4-b55b-19588a284d8a admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:19.928622 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ff218b-76c8-4802-8ee1-cc4caabe8968 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16e6a0ca26fc4ef892c188ad89a1e132', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:19.929363 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ff218b-76c8-4802-8ee1-cc4caabe8968 service neutron] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:19.929662 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ff218b-76c8-4802-8ee1-cc4caabe8968 service neutron] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:19.929927 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ff218b-76c8-4802-8ee1-cc4caabe8968 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:19.942148 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3859ab94-055f-4cbc-b367-951b59119833 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16e6a0ca26fc4ef892c188ad89a1e132', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:19.943015 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3859ab94-055f-4cbc-b367-951b59119833 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:19.943851 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3859ab94-055f-4cbc-b367-951b59119833 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:19.944123 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3859ab94-055f-4cbc-b367-951b59119833 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:19.997539 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:20:20.012263 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3859ab94-055f-4cbc-b367-951b59119833 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:20.014465 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3859ab94-055f-4cbc-b367-951b59119833 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:20.017372 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ff218b-76c8-4802-8ee1-cc4caabe8968 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:20.019674 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ff218b-76c8-4802-8ee1-cc4caabe8968 service neutron] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:20.027197 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1423/2816] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:20:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:20:20.028159 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3859ab94-055f-4cbc-b367-951b59119833 service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:20.035542 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1394/2817] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:20:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:20:20.038359 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3859ab94-055f-4cbc-b367-951b59119833 service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:20.043270 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5533213e-bd43-4fde-b56d-9b230b6675d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:20.043890 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5533213e-bd43-4fde-b56d-9b230b6675d9 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:20.044168 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5533213e-bd43-4fde-b56d-9b230b6675d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:20.044437 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5533213e-bd43-4fde-b56d-9b230b6675d9 admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:20.045078 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5533213e-bd43-4fde-b56d-9b230b6675d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:20.047008 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5533213e-bd43-4fde-b56d-9b230b6675d9 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:20.070916 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1424/2818] 10.222.0.79 () {60 vars in 1144 bytes} [Tue Aug 30 01:20:20 2022] POST /identity/v3/users => generated 300 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:20:20.074772 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ff218b-76c8-4802-8ee1-cc4caabe8968 service neutron] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:20.085597 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ff218b-76c8-4802-8ee1-cc4caabe8968 service neutron] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:20.090512 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d1e369-8f17-48ea-9785-c62fce226d09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:20.091115 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d1e369-8f17-48ea-9785-c62fce226d09 admin admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:20.091424 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d1e369-8f17-48ea-9785-c62fce226d09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:20.091685 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d1e369-8f17-48ea-9785-c62fce226d09 admin admin] PATH_INFO: `/v3/roles` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:20.092326 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d1e369-8f17-48ea-9785-c62fce226d09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:20.093921 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d1e369-8f17-48ea-9785-c62fce226d09 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:20.105457 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1395/2819] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:20:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:20:20.109838 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5533213e-bd43-4fde-b56d-9b230b6675d9 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:20.120340 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5533213e-bd43-4fde-b56d-9b230b6675d9 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:20.125211 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37913f50-ba60-444f-9bbe-c89835147a44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:20.126002 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37913f50-ba60-444f-9bbe-c89835147a44 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:20.126659 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37913f50-ba60-444f-9bbe-c89835147a44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:20.126659 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37913f50-ba60-444f-9bbe-c89835147a44 admin admin] PATH_INFO: `/v3/projects/2e4105958af846fb962d456f58e814fa/users/8104b1ceb7864c61bd1a49ad94643e15/roles/d14c3070c9184d76a7b23df69bd3db07` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:20.144386 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37913f50-ba60-444f-9bbe-c89835147a44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e4105958af846fb962d456f58e814fa, user_id=8104b1ceb7864c61bd1a49ad94643e15, role_id=d14c3070c9184d76a7b23df69bd3db07)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:20.148310 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37913f50-ba60-444f-9bbe-c89835147a44 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:20.163978 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1425/2820] 10.222.0.79 () {60 vars in 1483 bytes} [Tue Aug 30 01:20:20 2022] PUT /identity/v3/projects/2e4105958af846fb962d456f58e814fa/users/8104b1ceb7864c61bd1a49ad94643e15/roles/d14c3070c9184d76a7b23df69bd3db07 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:20:20.168298 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d1e369-8f17-48ea-9785-c62fce226d09 admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:20.181606 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d1e369-8f17-48ea-9785-c62fce226d09 admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:20.261216 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fc4d64-0325-4d2a-b729-8f13b79a7fdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:20.262231 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fc4d64-0325-4d2a-b729-8f13b79a7fdb admin admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:20.262515 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fc4d64-0325-4d2a-b729-8f13b79a7fdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:20.262885 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fc4d64-0325-4d2a-b729-8f13b79a7fdb admin admin] PATH_INFO: `/v3/roles` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:20.263532 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fc4d64-0325-4d2a-b729-8f13b79a7fdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:20.265396 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fc4d64-0325-4d2a-b729-8f13b79a7fdb admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:20.280041 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1396/2821] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:20:20 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 01:20:20.281523 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37913f50-ba60-444f-9bbe-c89835147a44 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:20.292714 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37913f50-ba60-444f-9bbe-c89835147a44 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:20.297467 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a438e81-0ca3-459f-859c-d919dc29aac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:20.298141 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a438e81-0ca3-459f-859c-d919dc29aac7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:20.298426 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a438e81-0ca3-459f-859c-d919dc29aac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:20.298696 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a438e81-0ca3-459f-859c-d919dc29aac7 admin admin] PATH_INFO: `/v3/projects/2e4105958af846fb962d456f58e814fa/users/8104b1ceb7864c61bd1a49ad94643e15/roles/d14c3070c9184d76a7b23df69bd3db07` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:20.300718 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a438e81-0ca3-459f-859c-d919dc29aac7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e4105958af846fb962d456f58e814fa, user_id=8104b1ceb7864c61bd1a49ad94643e15, role_id=d14c3070c9184d76a7b23df69bd3db07)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:20.303983 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a438e81-0ca3-459f-859c-d919dc29aac7 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:20.315112 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1426/2822] 10.222.0.79 () {60 vars in 1483 bytes} [Tue Aug 30 01:20:20 2022] PUT /identity/v3/projects/2e4105958af846fb962d456f58e814fa/users/8104b1ceb7864c61bd1a49ad94643e15/roles/d14c3070c9184d76a7b23df69bd3db07 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:20:20.327961 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21df7f90-343e-4759-a6b6-96eb2859c36c None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:20.328151 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21df7f90-343e-4759-a6b6-96eb2859c36c None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:20.328412 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21df7f90-343e-4759-a6b6-96eb2859c36c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:20.359183 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-21df7f90-343e-4759-a6b6-96eb2859c36c None None] MFA Rules not processed for user `8104b1ceb7864c61bd1a49ad94643e15`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:20:20.360461 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-21df7f90-343e-4759-a6b6-96eb2859c36c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:20:20.439613 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1397/2823] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:20:20 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:20:20.451899 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a438e81-0ca3-459f-859c-d919dc29aac7 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:20.453768 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-6a438e81-0ca3-459f-859c-d919dc29aac7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:20:20.469989 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:20:20.551403 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a438e81-0ca3-459f-859c-d919dc29aac7 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:20.555778 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f258fe7-b054-4d2d-a901-e8d5deec80bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f827c7670b74d938ffe066ced88d1c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:20.556398 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f258fe7-b054-4d2d-a901-e8d5deec80bc service cinder] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:20.556680 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f258fe7-b054-4d2d-a901-e8d5deec80bc service cinder] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:20.556939 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f258fe7-b054-4d2d-a901-e8d5deec80bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:20.567957 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f258fe7-b054-4d2d-a901-e8d5deec80bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:20.570680 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f258fe7-b054-4d2d-a901-e8d5deec80bc service cinder] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:20.582200 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1427/2824] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:20:20 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:20:20.623773 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21df7f90-343e-4759-a6b6-96eb2859c36c None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:20.625622 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-21df7f90-343e-4759-a6b6-96eb2859c36c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:20:20.742455 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21df7f90-343e-4759-a6b6-96eb2859c36c None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:20.752040 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e860eec-2327-4574-857a-e6ef829dc584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:20.754189 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f258fe7-b054-4d2d-a901-e8d5deec80bc service cinder] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:20.755400 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e860eec-2327-4574-857a-e6ef829dc584 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:20.755934 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e860eec-2327-4574-857a-e6ef829dc584 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:20.756558 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e860eec-2327-4574-857a-e6ef829dc584 admin admin] PATH_INFO: `/v3/projects/f17802fdfd8a48699deda19ae0bc6668` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:20.756781 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-5f258fe7-b054-4d2d-a901-e8d5deec80bc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:20:20.758462 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e860eec-2327-4574-857a-e6ef829dc584 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f17802fdfd8a48699deda19ae0bc6668)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:20.760597 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e860eec-2327-4574-857a-e6ef829dc584 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:20.764142 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=100 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:20:20.796123 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f258fe7-b054-4d2d-a901-e8d5deec80bc service cinder] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:20.804825 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4406d9bb-bf5e-4208-b838-92939270528c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:20.806125 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4406d9bb-bf5e-4208-b838-92939270528c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:20.806629 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4406d9bb-bf5e-4208-b838-92939270528c admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:20.807208 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4406d9bb-bf5e-4208-b838-92939270528c admin admin] PATH_INFO: `/v3/projects/b70aab4a4f1440de9df945835d027805` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:20.809401 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4406d9bb-bf5e-4208-b838-92939270528c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b70aab4a4f1440de9df945835d027805)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:20.813204 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4406d9bb-bf5e-4208-b838-92939270528c admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:20.844435 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-9e860eec-2327-4574-857a-e6ef829dc584 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f17802fdfd8a48699deda19ae0bc6668', 'request_id': 'req-9e860eec-2327-4574-857a-e6ef829dc584'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:20.856814 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-9e860eec-2327-4574-857a-e6ef829dc584 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f17802fdfd8a48699deda19ae0bc6668', 'request_id': 'req-9e860eec-2327-4574-857a-e6ef829dc584'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:20.866083 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-9e860eec-2327-4574-857a-e6ef829dc584 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f17802fdfd8a48699deda19ae0bc6668', 'request_id': 'req-9e860eec-2327-4574-857a-e6ef829dc584'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:20.886279 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-9e860eec-2327-4574-857a-e6ef829dc584 admin admin] The token cache is being invalidate because project f17802fdfd8a48699deda19ae0bc6668 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81998) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:20:20.886556 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-9e860eec-2327-4574-857a-e6ef829dc584 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:20.887300 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-9e860eec-2327-4574-857a-e6ef829dc584 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:20.889000 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1398/2825] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 30 01:20:20 2022] DELETE /identity/v3/projects/f17802fdfd8a48699deda19ae0bc6668 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:20:20.889821 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e860eec-2327-4574-857a-e6ef829dc584 admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:20.891266 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-9e860eec-2327-4574-857a-e6ef829dc584 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:20:20.920752 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-4406d9bb-bf5e-4208-b838-92939270528c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b70aab4a4f1440de9df945835d027805', 'request_id': 'req-4406d9bb-bf5e-4208-b838-92939270528c'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:20.932131 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-4406d9bb-bf5e-4208-b838-92939270528c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b70aab4a4f1440de9df945835d027805', 'request_id': 'req-4406d9bb-bf5e-4208-b838-92939270528c'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:20.941288 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-4406d9bb-bf5e-4208-b838-92939270528c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b70aab4a4f1440de9df945835d027805', 'request_id': 'req-4406d9bb-bf5e-4208-b838-92939270528c'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:20.957228 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-4406d9bb-bf5e-4208-b838-92939270528c admin admin] The token cache is being invalidate because project b70aab4a4f1440de9df945835d027805 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:20:20.957670 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-4406d9bb-bf5e-4208-b838-92939270528c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:20.958525 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-4406d9bb-bf5e-4208-b838-92939270528c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:20.960861 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1428/2826] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 30 01:20:20 2022] DELETE /identity/v3/projects/b70aab4a4f1440de9df945835d027805 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:20:20.963924 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4406d9bb-bf5e-4208-b838-92939270528c admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:20.965792 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-4406d9bb-bf5e-4208-b838-92939270528c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:20:20.969187 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e860eec-2327-4574-857a-e6ef829dc584 admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:21.051046 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20d65a2-20f5-4a7b-8d1c-80b57bf4be2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:21.051966 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20d65a2-20f5-4a7b-8d1c-80b57bf4be2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:21.052405 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20d65a2-20f5-4a7b-8d1c-80b57bf4be2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:21.053506 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20d65a2-20f5-4a7b-8d1c-80b57bf4be2f admin admin] PATH_INFO: `/v3/users/f6573e5006484383a529b73b82d80134` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:21.055311 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20d65a2-20f5-4a7b-8d1c-80b57bf4be2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6573e5006484383a529b73b82d80134)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:21.057797 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20d65a2-20f5-4a7b-8d1c-80b57bf4be2f admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:21.085760 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4406d9bb-bf5e-4208-b838-92939270528c admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:21.094322 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f02f3a-d3f8-41d6-9ee1-2e5f671505eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:21.095866 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f02f3a-d3f8-41d6-9ee1-2e5f671505eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:21.096464 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f02f3a-d3f8-41d6-9ee1-2e5f671505eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:21.096988 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f02f3a-d3f8-41d6-9ee1-2e5f671505eb admin admin] PATH_INFO: `/v3/users/c2cb4df9e008459d885f2fbdc1cdc811` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:21.099589 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f02f3a-d3f8-41d6-9ee1-2e5f671505eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2cb4df9e008459d885f2fbdc1cdc811)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:21.103411 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f02f3a-d3f8-41d6-9ee1-2e5f671505eb admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:21.120193 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:20:21.130033 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-e20d65a2-20f5-4a7b-8d1c-80b57bf4be2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6573e5006484383a529b73b82d80134'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:21.148556 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-e20d65a2-20f5-4a7b-8d1c-80b57bf4be2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6573e5006484383a529b73b82d80134'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:21.172769 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:20:21.173520 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-e20d65a2-20f5-4a7b-8d1c-80b57bf4be2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6573e5006484383a529b73b82d80134'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:21.175644 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-e20d65a2-20f5-4a7b-8d1c-80b57bf4be2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6573e5006484383a529b73b82d80134'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:21.192156 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-e20d65a2-20f5-4a7b-8d1c-80b57bf4be2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6573e5006484383a529b73b82d80134'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:21.195160 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-d3f02f3a-d3f8-41d6-9ee1-2e5f671505eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2cb4df9e008459d885f2fbdc1cdc811'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:21.205471 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1399/2827] 10.222.0.79 () {58 vars in 1224 bytes} [Tue Aug 30 01:20:20 2022] DELETE /identity/v3/users/f6573e5006484383a529b73b82d80134 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:20:21.213738 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2362a252-2ca4-464a-aa0d-621a90245d16 None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:21.214256 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2362a252-2ca4-464a-aa0d-621a90245d16 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:21.214734 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2362a252-2ca4-464a-aa0d-621a90245d16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:21.216416 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-d3f02f3a-d3f8-41d6-9ee1-2e5f671505eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2cb4df9e008459d885f2fbdc1cdc811'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:21.245842 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-d3f02f3a-d3f8-41d6-9ee1-2e5f671505eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2cb4df9e008459d885f2fbdc1cdc811'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:21.246727 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-d3f02f3a-d3f8-41d6-9ee1-2e5f671505eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2cb4df9e008459d885f2fbdc1cdc811'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:21.261086 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-2362a252-2ca4-464a-aa0d-621a90245d16 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:20:21.262506 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-d3f02f3a-d3f8-41d6-9ee1-2e5f671505eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2cb4df9e008459d885f2fbdc1cdc811'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:21.263727 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-2362a252-2ca4-464a-aa0d-621a90245d16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:20:21.269085 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1429/2828] 10.222.0.79 () {58 vars in 1224 bytes} [Tue Aug 30 01:20:20 2022] DELETE /identity/v3/users/c2cb4df9e008459d885f2fbdc1cdc811 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:20:21.353805 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1400/2829] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:20:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:20:21.363908 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f02f3a-d3f8-41d6-9ee1-2e5f671505eb admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:21.366037 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-d3f02f3a-d3f8-41d6-9ee1-2e5f671505eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:20:21.444936 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f02f3a-d3f8-41d6-9ee1-2e5f671505eb admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:21.451901 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15589227-5dba-43e7-9396-98b1a0a26435 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16e6a0ca26fc4ef892c188ad89a1e132', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:21.452548 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15589227-5dba-43e7-9396-98b1a0a26435 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:21.453044 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15589227-5dba-43e7-9396-98b1a0a26435 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:21.453531 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15589227-5dba-43e7-9396-98b1a0a26435 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:21.549852 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15589227-5dba-43e7-9396-98b1a0a26435 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:21.551578 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15589227-5dba-43e7-9396-98b1a0a26435 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:21.564206 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1430/2830] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:20:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:20:21.694269 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2362a252-2ca4-464a-aa0d-621a90245d16 None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:21.695890 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-2362a252-2ca4-464a-aa0d-621a90245d16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:20:21.711751 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2362a252-2ca4-464a-aa0d-621a90245d16 None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:21.717644 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef10d6b-78c1-4af3-bccf-945fe7a5d8d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:21.718518 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef10d6b-78c1-4af3-bccf-945fe7a5d8d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:21.718770 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef10d6b-78c1-4af3-bccf-945fe7a5d8d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:21.719042 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef10d6b-78c1-4af3-bccf-945fe7a5d8d6 admin admin] PATH_INFO: `/v3/projects/d9a3dff912af49f3ab5703cce209b33b` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:21.720433 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef10d6b-78c1-4af3-bccf-945fe7a5d8d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9a3dff912af49f3ab5703cce209b33b)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:21.722630 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef10d6b-78c1-4af3-bccf-945fe7a5d8d6 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:21.802266 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-1ef10d6b-78c1-4af3-bccf-945fe7a5d8d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9a3dff912af49f3ab5703cce209b33b', 'request_id': 'req-1ef10d6b-78c1-4af3-bccf-945fe7a5d8d6'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:21.816761 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-1ef10d6b-78c1-4af3-bccf-945fe7a5d8d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9a3dff912af49f3ab5703cce209b33b', 'request_id': 'req-1ef10d6b-78c1-4af3-bccf-945fe7a5d8d6'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:21.829129 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-1ef10d6b-78c1-4af3-bccf-945fe7a5d8d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9a3dff912af49f3ab5703cce209b33b', 'request_id': 'req-1ef10d6b-78c1-4af3-bccf-945fe7a5d8d6'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:21.850776 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-1ef10d6b-78c1-4af3-bccf-945fe7a5d8d6 admin admin] The token cache is being invalidate because project d9a3dff912af49f3ab5703cce209b33b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81998) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:20:21.851315 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-1ef10d6b-78c1-4af3-bccf-945fe7a5d8d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:21.852384 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-1ef10d6b-78c1-4af3-bccf-945fe7a5d8d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:21.854911 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1401/2831] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 30 01:20:21 2022] DELETE /identity/v3/projects/d9a3dff912af49f3ab5703cce209b33b => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:20:21.861004 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15589227-5dba-43e7-9396-98b1a0a26435 service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:21.879547 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15589227-5dba-43e7-9396-98b1a0a26435 service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:21.957814 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e510af-90f0-40aa-ab4e-6ef1b10fc5d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:21.958370 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e510af-90f0-40aa-ab4e-6ef1b10fc5d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:21.958654 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e510af-90f0-40aa-ab4e-6ef1b10fc5d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:21.958962 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e510af-90f0-40aa-ab4e-6ef1b10fc5d3 admin admin] PATH_INFO: `/v3/users/8d6c72a55a8a4a2b9b8924e161c0f185` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:21.960206 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e510af-90f0-40aa-ab4e-6ef1b10fc5d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d6c72a55a8a4a2b9b8924e161c0f185)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:21.962152 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e510af-90f0-40aa-ab4e-6ef1b10fc5d3 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:21.965087 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:20:22.022206 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-d8e510af-90f0-40aa-ab4e-6ef1b10fc5d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d6c72a55a8a4a2b9b8924e161c0f185'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:22.034179 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-d8e510af-90f0-40aa-ab4e-6ef1b10fc5d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d6c72a55a8a4a2b9b8924e161c0f185'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:22.046525 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-d8e510af-90f0-40aa-ab4e-6ef1b10fc5d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d6c72a55a8a4a2b9b8924e161c0f185'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:22.047183 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-d8e510af-90f0-40aa-ab4e-6ef1b10fc5d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d6c72a55a8a4a2b9b8924e161c0f185'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:22.069707 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-d8e510af-90f0-40aa-ab4e-6ef1b10fc5d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d6c72a55a8a4a2b9b8924e161c0f185'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:22.070349 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef10d6b-78c1-4af3-bccf-945fe7a5d8d6 admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:22.072661 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-1ef10d6b-78c1-4af3-bccf-945fe7a5d8d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:20:22.080583 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1431/2832] 10.222.0.79 () {58 vars in 1224 bytes} [Tue Aug 30 01:20:21 2022] DELETE /identity/v3/users/8d6c72a55a8a4a2b9b8924e161c0f185 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:20:22.088443 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef10d6b-78c1-4af3-bccf-945fe7a5d8d6 admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:22.140184 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:20:22.164043 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ed2cfb-f0cd-4ab1-b8f3-48de2acd886e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:22.164976 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ed2cfb-f0cd-4ab1-b8f3-48de2acd886e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:22.165274 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ed2cfb-f0cd-4ab1-b8f3-48de2acd886e admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:22.165539 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ed2cfb-f0cd-4ab1-b8f3-48de2acd886e admin admin] PATH_INFO: `/v3/projects/ce716485e90346348042a602fb013e2e` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:22.166975 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ed2cfb-f0cd-4ab1-b8f3-48de2acd886e admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce716485e90346348042a602fb013e2e)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:22.168977 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ed2cfb-f0cd-4ab1-b8f3-48de2acd886e admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:22.229594 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-85ed2cfb-f0cd-4ab1-b8f3-48de2acd886e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce716485e90346348042a602fb013e2e', 'request_id': 'req-85ed2cfb-f0cd-4ab1-b8f3-48de2acd886e'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:22.245024 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-85ed2cfb-f0cd-4ab1-b8f3-48de2acd886e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce716485e90346348042a602fb013e2e', 'request_id': 'req-85ed2cfb-f0cd-4ab1-b8f3-48de2acd886e'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:22.254495 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-85ed2cfb-f0cd-4ab1-b8f3-48de2acd886e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce716485e90346348042a602fb013e2e', 'request_id': 'req-85ed2cfb-f0cd-4ab1-b8f3-48de2acd886e'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:22.274212 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-85ed2cfb-f0cd-4ab1-b8f3-48de2acd886e admin admin] The token cache is being invalidate because project ce716485e90346348042a602fb013e2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81998) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:20:22.274575 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-85ed2cfb-f0cd-4ab1-b8f3-48de2acd886e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:22.275637 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-85ed2cfb-f0cd-4ab1-b8f3-48de2acd886e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:22.277544 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1402/2833] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 30 01:20:22 2022] DELETE /identity/v3/projects/ce716485e90346348042a602fb013e2e => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:20:22.281839 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e510af-90f0-40aa-ab4e-6ef1b10fc5d3 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:22.284323 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-d8e510af-90f0-40aa-ab4e-6ef1b10fc5d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:20:22.306616 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e510af-90f0-40aa-ab4e-6ef1b10fc5d3 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:22.391106 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce618f6-b906-472d-b174-2e400c9e2724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:22.392243 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce618f6-b906-472d-b174-2e400c9e2724 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:22.392723 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce618f6-b906-472d-b174-2e400c9e2724 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:22.393257 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce618f6-b906-472d-b174-2e400c9e2724 admin admin] PATH_INFO: `/v3/users/8104b1ceb7864c61bd1a49ad94643e15` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:22.395590 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce618f6-b906-472d-b174-2e400c9e2724 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8104b1ceb7864c61bd1a49ad94643e15)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:22.399511 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce618f6-b906-472d-b174-2e400c9e2724 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:22.405914 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ed2cfb-f0cd-4ab1-b8f3-48de2acd886e admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:22.407428 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-85ed2cfb-f0cd-4ab1-b8f3-48de2acd886e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:20:22.422141 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ed2cfb-f0cd-4ab1-b8f3-48de2acd886e admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:22.428311 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c162e1-facf-4c5e-8229-a9eaacec4400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:22.429227 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c162e1-facf-4c5e-8229-a9eaacec4400 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:22.429507 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c162e1-facf-4c5e-8229-a9eaacec4400 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:22.429782 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c162e1-facf-4c5e-8229-a9eaacec4400 admin admin] PATH_INFO: `/v3/projects/d37f34840e434d02854a2a0bc88e318c` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:22.430966 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c162e1-facf-4c5e-8229-a9eaacec4400 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d37f34840e434d02854a2a0bc88e318c)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:22.432933 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c162e1-facf-4c5e-8229-a9eaacec4400 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:22.460483 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-1ce618f6-b906-472d-b174-2e400c9e2724 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8104b1ceb7864c61bd1a49ad94643e15'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:22.468584 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-1ce618f6-b906-472d-b174-2e400c9e2724 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8104b1ceb7864c61bd1a49ad94643e15'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:22.478056 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-1ce618f6-b906-472d-b174-2e400c9e2724 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8104b1ceb7864c61bd1a49ad94643e15'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:22.478946 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-1ce618f6-b906-472d-b174-2e400c9e2724 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8104b1ceb7864c61bd1a49ad94643e15'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:22.486281 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-57c162e1-facf-4c5e-8229-a9eaacec4400 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd37f34840e434d02854a2a0bc88e318c', 'request_id': 'req-57c162e1-facf-4c5e-8229-a9eaacec4400'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:22.491246 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-1ce618f6-b906-472d-b174-2e400c9e2724 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8104b1ceb7864c61bd1a49ad94643e15'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:22.493781 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:20:22.494512 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-57c162e1-facf-4c5e-8229-a9eaacec4400 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd37f34840e434d02854a2a0bc88e318c', 'request_id': 'req-57c162e1-facf-4c5e-8229-a9eaacec4400'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:22.499536 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1432/2834] 10.222.0.79 () {58 vars in 1224 bytes} [Tue Aug 30 01:20:22 2022] DELETE /identity/v3/users/8104b1ceb7864c61bd1a49ad94643e15 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:20:22.505415 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-57c162e1-facf-4c5e-8229-a9eaacec4400 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd37f34840e434d02854a2a0bc88e318c', 'request_id': 'req-57c162e1-facf-4c5e-8229-a9eaacec4400'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:22.517462 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-57c162e1-facf-4c5e-8229-a9eaacec4400 admin admin] The token cache is being invalidate because project d37f34840e434d02854a2a0bc88e318c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81998) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:20:22.517754 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-57c162e1-facf-4c5e-8229-a9eaacec4400 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:22.518424 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-57c162e1-facf-4c5e-8229-a9eaacec4400 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:22.519982 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1403/2835] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 30 01:20:22 2022] DELETE /identity/v3/projects/d37f34840e434d02854a2a0bc88e318c => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:20:22.526265 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cea4ef7-b687-4cd7-afa7-22a5be8ccb8c None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:22.526551 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cea4ef7-b687-4cd7-afa7-22a5be8ccb8c None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:22.526927 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cea4ef7-b687-4cd7-afa7-22a5be8ccb8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:22.547840 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-9cea4ef7-b687-4cd7-afa7-22a5be8ccb8c None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:20:22.549303 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-9cea4ef7-b687-4cd7-afa7-22a5be8ccb8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:20:22.613950 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1433/2836] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:20:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:20:22.622104 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5892fdf8-804b-4ccc-9c33-0b2c88d32678 None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:22.622441 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5892fdf8-804b-4ccc-9c33-0b2c88d32678 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:22.622718 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5892fdf8-804b-4ccc-9c33-0b2c88d32678 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:22.643241 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-5892fdf8-804b-4ccc-9c33-0b2c88d32678 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:20:22.644569 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-5892fdf8-804b-4ccc-9c33-0b2c88d32678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:20:22.656280 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1404/2837] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:20:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:20:22.664248 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cea4ef7-b687-4cd7-afa7-22a5be8ccb8c None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:22.673319 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cea4ef7-b687-4cd7-afa7-22a5be8ccb8c None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:22.678512 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee61e74-afea-470a-8669-8a3c4703aef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:22.679116 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee61e74-afea-470a-8669-8a3c4703aef2 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:22.679626 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee61e74-afea-470a-8669-8a3c4703aef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:22.679902 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee61e74-afea-470a-8669-8a3c4703aef2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:22.680563 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee61e74-afea-470a-8669-8a3c4703aef2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:20:22.680872 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee61e74-afea-470a-8669-8a3c4703aef2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:22.682484 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee61e74-afea-470a-8669-8a3c4703aef2 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:22.699542 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1434/2838] 10.222.0.79 () {58 vars in 1153 bytes} [Tue Aug 30 01:20:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:20:22.700774 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5892fdf8-804b-4ccc-9c33-0b2c88d32678 None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:22.711620 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5892fdf8-804b-4ccc-9c33-0b2c88d32678 None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:22.717594 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28620d77-a8e5-4a51-b855-9c451a36b0a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:22.718272 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28620d77-a8e5-4a51-b855-9c451a36b0a5 admin admin] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:22.718555 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28620d77-a8e5-4a51-b855-9c451a36b0a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:22.718832 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28620d77-a8e5-4a51-b855-9c451a36b0a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:22.719878 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28620d77-a8e5-4a51-b855-9c451a36b0a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:22.722027 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28620d77-a8e5-4a51-b855-9c451a36b0a5 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:22.763969 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1405/2839] 10.222.0.79 () {60 vars in 1153 bytes} [Tue Aug 30 01:20:22 2022] POST /identity/v3/projects => generated 365 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:20:22.766070 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee61e74-afea-470a-8669-8a3c4703aef2 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:22.778018 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee61e74-afea-470a-8669-8a3c4703aef2 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:22.797864 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28620d77-a8e5-4a51-b855-9c451a36b0a5 admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:22.799778 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-28620d77-a8e5-4a51-b855-9c451a36b0a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:20:22.837929 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:20:22.854030 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683d0d6e-827d-4604-8a86-4d31791d7f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:22.854870 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683d0d6e-827d-4604-8a86-4d31791d7f22 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:22.855218 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683d0d6e-827d-4604-8a86-4d31791d7f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:22.855498 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683d0d6e-827d-4604-8a86-4d31791d7f22 admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:22.856203 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683d0d6e-827d-4604-8a86-4d31791d7f22 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:22.858135 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683d0d6e-827d-4604-8a86-4d31791d7f22 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:22.878590 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28620d77-a8e5-4a51-b855-9c451a36b0a5 admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:22.881800 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1435/2840] 10.222.0.79 () {60 vars in 1144 bytes} [Tue Aug 30 01:20:22 2022] POST /identity/v3/users => generated 283 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:20:22.884608 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2d3fcf-6e97-4d19-ba87-4705243c0820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:22.885215 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2d3fcf-6e97-4d19-ba87-4705243c0820 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:22.885493 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2d3fcf-6e97-4d19-ba87-4705243c0820 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:22.885740 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683d0d6e-827d-4604-8a86-4d31791d7f22 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:22.885850 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2d3fcf-6e97-4d19-ba87-4705243c0820 admin admin] PATH_INFO: `/v3/projects/2e4105958af846fb962d456f58e814fa` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:22.886910 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2d3fcf-6e97-4d19-ba87-4705243c0820 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e4105958af846fb962d456f58e814fa)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:22.888845 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2d3fcf-6e97-4d19-ba87-4705243c0820 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:22.895534 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683d0d6e-827d-4604-8a86-4d31791d7f22 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:22.901049 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8bc874-040e-4a63-a384-8fa0d03c56fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:22.901646 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8bc874-040e-4a63-a384-8fa0d03c56fa admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:22.901927 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8bc874-040e-4a63-a384-8fa0d03c56fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:22.902200 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8bc874-040e-4a63-a384-8fa0d03c56fa admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:22.902848 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8bc874-040e-4a63-a384-8fa0d03c56fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:22.904472 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8bc874-040e-4a63-a384-8fa0d03c56fa admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:22.915547 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1436/2841] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:20:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 01:20:22.919470 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8bc874-040e-4a63-a384-8fa0d03c56fa admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:22.929387 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8bc874-040e-4a63-a384-8fa0d03c56fa admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:22.938832 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-3e2d3fcf-6e97-4d19-ba87-4705243c0820 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e4105958af846fb962d456f58e814fa', 'request_id': 'req-3e2d3fcf-6e97-4d19-ba87-4705243c0820'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:22.948681 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-3e2d3fcf-6e97-4d19-ba87-4705243c0820 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e4105958af846fb962d456f58e814fa', 'request_id': 'req-3e2d3fcf-6e97-4d19-ba87-4705243c0820'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:22.954730 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-3e2d3fcf-6e97-4d19-ba87-4705243c0820 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e4105958af846fb962d456f58e814fa', 'request_id': 'req-3e2d3fcf-6e97-4d19-ba87-4705243c0820'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:22.967311 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-3e2d3fcf-6e97-4d19-ba87-4705243c0820 admin admin] The token cache is being invalidate because project 2e4105958af846fb962d456f58e814fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81998) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:20:22.967661 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-3e2d3fcf-6e97-4d19-ba87-4705243c0820 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:22.968267 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-3e2d3fcf-6e97-4d19-ba87-4705243c0820 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:22.969759 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1406/2842] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 30 01:20:22 2022] DELETE /identity/v3/projects/2e4105958af846fb962d456f58e814fa => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:20:22.974519 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8937baec-c4f6-4230-ab7d-444e457e806e None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:22.974889 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8937baec-c4f6-4230-ab7d-444e457e806e None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:22.975531 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8937baec-c4f6-4230-ab7d-444e457e806e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:22.993778 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a38023a-01fc-4be0-8adb-adf40cc47761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:22.994386 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a38023a-01fc-4be0-8adb-adf40cc47761 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:22.994657 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a38023a-01fc-4be0-8adb-adf40cc47761 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:22.995093 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a38023a-01fc-4be0-8adb-adf40cc47761 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:22.995603 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a38023a-01fc-4be0-8adb-adf40cc47761 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:22.996894 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-8937baec-c4f6-4230-ab7d-444e457e806e None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:20:22.997190 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a38023a-01fc-4be0-8adb-adf40cc47761 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:22.998118 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-8937baec-c4f6-4230-ab7d-444e457e806e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:20:23.011802 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1437/2843] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:20:22 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 01:20:23.012905 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a38023a-01fc-4be0-8adb-adf40cc47761 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:23.014217 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1407/2844] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:20:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:20:23.014824 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-3a38023a-01fc-4be0-8adb-adf40cc47761 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:20:23.015580 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e559fe47-9b1d-47d5-aecb-b82ffb1f6524 None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:23.015865 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e559fe47-9b1d-47d5-aecb-b82ffb1f6524 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:23.016131 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e559fe47-9b1d-47d5-aecb-b82ffb1f6524 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:23.023149 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:20:23.029711 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a38023a-01fc-4be0-8adb-adf40cc47761 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:23.035802 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6f24dd-e0e3-4f7b-b5c7-680370b8bcbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:23.036463 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6f24dd-e0e3-4f7b-b5c7-680370b8bcbb admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:23.036733 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-e559fe47-9b1d-47d5-aecb-b82ffb1f6524 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:20:23.036873 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6f24dd-e0e3-4f7b-b5c7-680370b8bcbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:23.037041 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6f24dd-e0e3-4f7b-b5c7-680370b8bcbb admin admin] PATH_INFO: `/v3/projects/9defd939626541178749656f334ab579/users/cfd08b4d355a42c8841fbc7a11284762/roles/c37945a17623465f899d4f217e7af593` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:23.038418 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-e559fe47-9b1d-47d5-aecb-b82ffb1f6524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:20:23.046981 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1408/2845] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:20:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:20:23.051258 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e559fe47-9b1d-47d5-aecb-b82ffb1f6524 None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:23.054913 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6f24dd-e0e3-4f7b-b5c7-680370b8bcbb admin admin] RBAC: Authorizing `identity:create_grant(project_id=9defd939626541178749656f334ab579, user_id=cfd08b4d355a42c8841fbc7a11284762, role_id=c37945a17623465f899d4f217e7af593)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:23.057610 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6f24dd-e0e3-4f7b-b5c7-680370b8bcbb admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:23.061828 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e559fe47-9b1d-47d5-aecb-b82ffb1f6524 None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:23.066779 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058caa84-e024-4156-ba96-83a39cc03954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:23.067669 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058caa84-e024-4156-ba96-83a39cc03954 admin admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:23.068724 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058caa84-e024-4156-ba96-83a39cc03954 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:23.068724 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058caa84-e024-4156-ba96-83a39cc03954 admin admin] PATH_INFO: `/v3/domains` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:23.069343 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058caa84-e024-4156-ba96-83a39cc03954 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:20:23.069751 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058caa84-e024-4156-ba96-83a39cc03954 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:23.071395 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058caa84-e024-4156-ba96-83a39cc03954 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:23.073156 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1438/2846] 10.222.0.79 () {60 vars in 1483 bytes} [Tue Aug 30 01:20:23 2022] PUT /identity/v3/projects/9defd939626541178749656f334ab579/users/cfd08b4d355a42c8841fbc7a11284762/roles/c37945a17623465f899d4f217e7af593 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:20:23.088272 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1409/2847] 10.222.0.79 () {58 vars in 1153 bytes} [Tue Aug 30 01:20:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:20:23.088474 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3b9a98-2f5c-4ecc-bbf5-f77cb259c8ee None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:23.088474 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3b9a98-2f5c-4ecc-bbf5-f77cb259c8ee None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:23.088474 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3b9a98-2f5c-4ecc-bbf5-f77cb259c8ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:23.089547 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058caa84-e024-4156-ba96-83a39cc03954 admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:23.099413 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058caa84-e024-4156-ba96-83a39cc03954 admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:23.113800 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-0f3b9a98-2f5c-4ecc-bbf5-f77cb259c8ee None None] MFA Rules not processed for user `cfd08b4d355a42c8841fbc7a11284762`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:20:23.115440 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-0f3b9a98-2f5c-4ecc-bbf5-f77cb259c8ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:20:23.163756 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd3c9fd-92bc-4c1b-9994-6a6eb5905b2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:23.164745 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd3c9fd-92bc-4c1b-9994-6a6eb5905b2e admin admin] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:23.165030 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd3c9fd-92bc-4c1b-9994-6a6eb5905b2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:23.165303 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd3c9fd-92bc-4c1b-9994-6a6eb5905b2e admin admin] PATH_INFO: `/v3/projects` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:23.165938 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd3c9fd-92bc-4c1b-9994-6a6eb5905b2e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:23.167991 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd3c9fd-92bc-4c1b-9994-6a6eb5905b2e admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:23.179956 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1439/2848] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:20:23 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:20:23.191828 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3b9a98-2f5c-4ecc-bbf5-f77cb259c8ee None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:23.194007 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-0f3b9a98-2f5c-4ecc-bbf5-f77cb259c8ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:20:23.199569 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1410/2849] 10.222.0.79 () {60 vars in 1153 bytes} [Tue Aug 30 01:20:23 2022] POST /identity/v3/projects => generated 359 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:20:23.203509 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd3c9fd-92bc-4c1b-9994-6a6eb5905b2e admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:23.221191 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:20:23.260456 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3b9a98-2f5c-4ecc-bbf5-f77cb259c8ee None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:23.280541 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd3c9fd-92bc-4c1b-9994-6a6eb5905b2e admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:23.285213 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113311e4-654c-459b-906b-6f0eb1e045c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:23.285928 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113311e4-654c-459b-906b-6f0eb1e045c0 admin admin] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:23.286229 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113311e4-654c-459b-906b-6f0eb1e045c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:23.286480 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113311e4-654c-459b-906b-6f0eb1e045c0 admin admin] PATH_INFO: `/v3/users` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:23.287173 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113311e4-654c-459b-906b-6f0eb1e045c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:23.289103 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113311e4-654c-459b-906b-6f0eb1e045c0 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:23.314107 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1411/2850] 10.222.0.79 () {60 vars in 1144 bytes} [Tue Aug 30 01:20:23 2022] POST /identity/v3/users => generated 280 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:20:23.314350 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceda5b2-da95-4316-87d0-ab32a9abf224 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f827c7670b74d938ffe066ced88d1c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:23.315054 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceda5b2-da95-4316-87d0-ab32a9abf224 service cinder] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:23.315329 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceda5b2-da95-4316-87d0-ab32a9abf224 service cinder] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:23.315606 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceda5b2-da95-4316-87d0-ab32a9abf224 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:23.320604 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113311e4-654c-459b-906b-6f0eb1e045c0 admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:23.333705 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113311e4-654c-459b-906b-6f0eb1e045c0 admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:23.340753 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a65d97c-60d4-4924-9471-f1ce059ffe3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:23.341377 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a65d97c-60d4-4924-9471-f1ce059ffe3c admin admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:23.341655 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a65d97c-60d4-4924-9471-f1ce059ffe3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:23.341929 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a65d97c-60d4-4924-9471-f1ce059ffe3c admin admin] PATH_INFO: `/v3/roles` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:23.342594 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a65d97c-60d4-4924-9471-f1ce059ffe3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:23.344261 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a65d97c-60d4-4924-9471-f1ce059ffe3c admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:23.355265 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1412/2851] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:20:23 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 01:20:23.359416 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a65d97c-60d4-4924-9471-f1ce059ffe3c admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:23.370538 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a65d97c-60d4-4924-9471-f1ce059ffe3c admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:23.375468 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719c775c-99fd-4c9c-9ce4-b5f7e2b0855d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:23.376082 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719c775c-99fd-4c9c-9ce4-b5f7e2b0855d admin admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:23.376363 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719c775c-99fd-4c9c-9ce4-b5f7e2b0855d admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:23.376633 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719c775c-99fd-4c9c-9ce4-b5f7e2b0855d admin admin] PATH_INFO: `/v3/roles` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:23.377468 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719c775c-99fd-4c9c-9ce4-b5f7e2b0855d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:23.379108 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719c775c-99fd-4c9c-9ce4-b5f7e2b0855d admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:23.379908 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:20:23.396508 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1413/2852] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:20:23 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 01:20:23.401117 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719c775c-99fd-4c9c-9ce4-b5f7e2b0855d admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:23.411661 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719c775c-99fd-4c9c-9ce4-b5f7e2b0855d admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:23.416776 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09295aa-28f1-4623-b04a-1ae642763e8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:23.417459 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09295aa-28f1-4623-b04a-1ae642763e8e admin admin] REQUEST_METHOD: `PUT` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:23.417737 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09295aa-28f1-4623-b04a-1ae642763e8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:23.418006 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09295aa-28f1-4623-b04a-1ae642763e8e admin admin] PATH_INFO: `/v3/projects/746e41b451ca4a2983c1c9d3f5a03788/users/ad366b83519245148e1ff3f3c4f36bc1/roles/c37945a17623465f899d4f217e7af593` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:23.420732 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ceda5b2-da95-4316-87d0-ab32a9abf224 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:23.422986 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ceda5b2-da95-4316-87d0-ab32a9abf224 service cinder] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:23.436818 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1440/2853] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:20:23 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 01:20:23.438503 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09295aa-28f1-4623-b04a-1ae642763e8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=746e41b451ca4a2983c1c9d3f5a03788, user_id=ad366b83519245148e1ff3f3c4f36bc1, role_id=c37945a17623465f899d4f217e7af593)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:23.441359 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09295aa-28f1-4623-b04a-1ae642763e8e admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:23.458048 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1414/2854] 10.222.0.79 () {60 vars in 1483 bytes} [Tue Aug 30 01:20:23 2022] PUT /identity/v3/projects/746e41b451ca4a2983c1c9d3f5a03788/users/ad366b83519245148e1ff3f3c4f36bc1/roles/c37945a17623465f899d4f217e7af593 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:20:23.470739 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518c940b-41c9-4cf1-b530-17d48509a0ac None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:23.471024 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518c940b-41c9-4cf1-b530-17d48509a0ac None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:23.471486 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518c940b-41c9-4cf1-b530-17d48509a0ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:23.503818 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-518c940b-41c9-4cf1-b530-17d48509a0ac None None] MFA Rules not processed for user `ad366b83519245148e1ff3f3c4f36bc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:20:23.505084 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-518c940b-41c9-4cf1-b530-17d48509a0ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:20:23.594058 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1441/2855] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:20:23 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:20:23.633587 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09295aa-28f1-4623-b04a-1ae642763e8e admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:23.635573 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-c09295aa-28f1-4623-b04a-1ae642763e8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:20:23.711977 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09295aa-28f1-4623-b04a-1ae642763e8e admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:23.716570 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7246d8ab-ba18-458a-bb10-2938eaa57e32 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f827c7670b74d938ffe066ced88d1c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:23.717379 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7246d8ab-ba18-458a-bb10-2938eaa57e32 service cinder] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:23.717775 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7246d8ab-ba18-458a-bb10-2938eaa57e32 service cinder] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:23.718154 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7246d8ab-ba18-458a-bb10-2938eaa57e32 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:23.730566 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7246d8ab-ba18-458a-bb10-2938eaa57e32 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:23.733350 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7246d8ab-ba18-458a-bb10-2938eaa57e32 service cinder] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:23.750307 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1415/2856] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:20:23 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:20:23.769648 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518c940b-41c9-4cf1-b530-17d48509a0ac None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:23.864562 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518c940b-41c9-4cf1-b530-17d48509a0ac None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:23.877986 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cf87ea-a226-475e-a984-e8b083ef71a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:23.878650 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cf87ea-a226-475e-a984-e8b083ef71a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:23.878928 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cf87ea-a226-475e-a984-e8b083ef71a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:23.879218 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cf87ea-a226-475e-a984-e8b083ef71a0 admin admin] PATH_INFO: `/v3/users/ad366b83519245148e1ff3f3c4f36bc1` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:23.880450 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cf87ea-a226-475e-a984-e8b083ef71a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad366b83519245148e1ff3f3c4f36bc1)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:23.883255 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cf87ea-a226-475e-a984-e8b083ef71a0 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:23.931371 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-18cf87ea-a226-475e-a984-e8b083ef71a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad366b83519245148e1ff3f3c4f36bc1'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:23.938218 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-18cf87ea-a226-475e-a984-e8b083ef71a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad366b83519245148e1ff3f3c4f36bc1'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:23.945977 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-18cf87ea-a226-475e-a984-e8b083ef71a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad366b83519245148e1ff3f3c4f36bc1'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:23.946539 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-18cf87ea-a226-475e-a984-e8b083ef71a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad366b83519245148e1ff3f3c4f36bc1'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:23.952302 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:20:23.965639 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-18cf87ea-a226-475e-a984-e8b083ef71a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad366b83519245148e1ff3f3c4f36bc1'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:23.975226 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1442/2857] 10.222.0.79 () {58 vars in 1224 bytes} [Tue Aug 30 01:20:23 2022] DELETE /identity/v3/users/ad366b83519245148e1ff3f3c4f36bc1 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:20:23.979929 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f808de-7ae9-4e03-916a-d71ac8a2d08a None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:23.980203 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f808de-7ae9-4e03-916a-d71ac8a2d08a None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:23.980473 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f808de-7ae9-4e03-916a-d71ac8a2d08a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:24.001197 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-84f808de-7ae9-4e03-916a-d71ac8a2d08a None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:20:24.002410 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-84f808de-7ae9-4e03-916a-d71ac8a2d08a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:20:24.068780 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1416/2858] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:20:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:20:24.078688 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cf87ea-a226-475e-a984-e8b083ef71a0 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:24.080125 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-18cf87ea-a226-475e-a984-e8b083ef71a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:20:24.149067 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cf87ea-a226-475e-a984-e8b083ef71a0 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:24.154153 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e73c47a-761b-4d28-bc25-6b0394b9f91f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16e6a0ca26fc4ef892c188ad89a1e132', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:24.154807 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e73c47a-761b-4d28-bc25-6b0394b9f91f service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:24.155087 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e73c47a-761b-4d28-bc25-6b0394b9f91f service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:24.155394 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e73c47a-761b-4d28-bc25-6b0394b9f91f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:24.165586 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e73c47a-761b-4d28-bc25-6b0394b9f91f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:24.167033 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e73c47a-761b-4d28-bc25-6b0394b9f91f service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:24.178412 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1443/2859] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:20:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:20:24.460816 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f808de-7ae9-4e03-916a-d71ac8a2d08a None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:24.462277 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-84f808de-7ae9-4e03-916a-d71ac8a2d08a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:20:24.469529 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:20:24.481479 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f808de-7ae9-4e03-916a-d71ac8a2d08a None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:24.486931 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2cf758-4afe-49cd-8b6a-42589b686b11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:24.487680 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2cf758-4afe-49cd-8b6a-42589b686b11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:24.487961 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2cf758-4afe-49cd-8b6a-42589b686b11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:24.488218 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2cf758-4afe-49cd-8b6a-42589b686b11 admin admin] PATH_INFO: `/v3/projects/746e41b451ca4a2983c1c9d3f5a03788` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:24.489464 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2cf758-4afe-49cd-8b6a-42589b686b11 admin admin] RBAC: Authorizing `identity:delete_project(project_id=746e41b451ca4a2983c1c9d3f5a03788)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:24.492104 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2cf758-4afe-49cd-8b6a-42589b686b11 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:24.540847 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-0a2cf758-4afe-49cd-8b6a-42589b686b11 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '746e41b451ca4a2983c1c9d3f5a03788', 'request_id': 'req-0a2cf758-4afe-49cd-8b6a-42589b686b11'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:24.554381 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-0a2cf758-4afe-49cd-8b6a-42589b686b11 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '746e41b451ca4a2983c1c9d3f5a03788', 'request_id': 'req-0a2cf758-4afe-49cd-8b6a-42589b686b11'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:24.560864 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-0a2cf758-4afe-49cd-8b6a-42589b686b11 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '746e41b451ca4a2983c1c9d3f5a03788', 'request_id': 'req-0a2cf758-4afe-49cd-8b6a-42589b686b11'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:24.575712 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-0a2cf758-4afe-49cd-8b6a-42589b686b11 admin admin] The token cache is being invalidate because project 746e41b451ca4a2983c1c9d3f5a03788 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81998) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:20:24.576151 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-0a2cf758-4afe-49cd-8b6a-42589b686b11 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:24.576941 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-0a2cf758-4afe-49cd-8b6a-42589b686b11 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:24.578757 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1417/2860] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 30 01:20:24 2022] DELETE /identity/v3/projects/746e41b451ca4a2983c1c9d3f5a03788 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:20:24.584336 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096b73f8-f79e-46b6-b303-db2780245d06 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:24.585213 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096b73f8-f79e-46b6-b303-db2780245d06 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:24.585462 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096b73f8-f79e-46b6-b303-db2780245d06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:24.608608 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-096b73f8-f79e-46b6-b303-db2780245d06 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:20:24.609868 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-096b73f8-f79e-46b6-b303-db2780245d06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:20:24.688512 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1444/2861] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:20:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:20:24.698463 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1615341c-d9b9-4323-b97d-b2ff600318c0 None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:24.698748 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1615341c-d9b9-4323-b97d-b2ff600318c0 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:24.698992 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1615341c-d9b9-4323-b97d-b2ff600318c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:24.721029 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-1615341c-d9b9-4323-b97d-b2ff600318c0 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:20:24.722240 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-1615341c-d9b9-4323-b97d-b2ff600318c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:20:24.731224 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1418/2862] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:20:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:20:24.735930 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096b73f8-f79e-46b6-b303-db2780245d06 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:24.746309 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096b73f8-f79e-46b6-b303-db2780245d06 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:24.751110 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9aa90e-755c-46d2-8661-547b3f5cd180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:24.751768 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9aa90e-755c-46d2-8661-547b3f5cd180 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:24.752060 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9aa90e-755c-46d2-8661-547b3f5cd180 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:24.752325 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9aa90e-755c-46d2-8661-547b3f5cd180 admin admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:24.752990 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9aa90e-755c-46d2-8661-547b3f5cd180 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:20:24.753289 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9aa90e-755c-46d2-8661-547b3f5cd180 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:24.754908 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9aa90e-755c-46d2-8661-547b3f5cd180 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:24.767442 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1445/2863] 10.222.0.79 () {58 vars in 1153 bytes} [Tue Aug 30 01:20:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:20:24.772357 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1615341c-d9b9-4323-b97d-b2ff600318c0 None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:24.782782 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1615341c-d9b9-4323-b97d-b2ff600318c0 None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:24.788381 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7ec2f8-374d-4003-95dd-8237654acfea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:24.788980 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7ec2f8-374d-4003-95dd-8237654acfea admin admin] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:24.789252 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7ec2f8-374d-4003-95dd-8237654acfea admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:24.789517 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7ec2f8-374d-4003-95dd-8237654acfea admin admin] PATH_INFO: `/v3/projects` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:24.790147 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7ec2f8-374d-4003-95dd-8237654acfea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:24.792072 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7ec2f8-374d-4003-95dd-8237654acfea admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:24.823332 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1419/2864] 10.222.0.79 () {60 vars in 1153 bytes} [Tue Aug 30 01:20:24 2022] POST /identity/v3/projects => generated 369 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:20:24.827651 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9aa90e-755c-46d2-8661-547b3f5cd180 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:24.839033 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9aa90e-755c-46d2-8661-547b3f5cd180 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:24.905680 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a52237-ebf4-44fc-9fb1-37ddbc51944f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:24.906310 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a52237-ebf4-44fc-9fb1-37ddbc51944f admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:24.906581 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a52237-ebf4-44fc-9fb1-37ddbc51944f admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:24.906846 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a52237-ebf4-44fc-9fb1-37ddbc51944f admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:24.907502 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a52237-ebf4-44fc-9fb1-37ddbc51944f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:24.909356 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a52237-ebf4-44fc-9fb1-37ddbc51944f admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:24.938677 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1446/2865] 10.222.0.79 () {60 vars in 1144 bytes} [Tue Aug 30 01:20:24 2022] POST /identity/v3/users => generated 285 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:20:24.943078 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7ec2f8-374d-4003-95dd-8237654acfea admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:24.954559 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7ec2f8-374d-4003-95dd-8237654acfea admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:24.959722 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d755b5-b2ba-4acc-89d3-18929e919d2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:24.960319 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d755b5-b2ba-4acc-89d3-18929e919d2e admin admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:24.960592 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d755b5-b2ba-4acc-89d3-18929e919d2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:24.960858 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d755b5-b2ba-4acc-89d3-18929e919d2e admin admin] PATH_INFO: `/v3/roles` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:24.961498 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d755b5-b2ba-4acc-89d3-18929e919d2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:24.963227 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d755b5-b2ba-4acc-89d3-18929e919d2e admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:24.974935 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1420/2866] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:20:24 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:20:24.979442 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a52237-ebf4-44fc-9fb1-37ddbc51944f admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:24.989588 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a52237-ebf4-44fc-9fb1-37ddbc51944f admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:24.996627 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1574b079-aac9-4c61-8347-d7a045726407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:24.997230 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1574b079-aac9-4c61-8347-d7a045726407 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:24.997502 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1574b079-aac9-4c61-8347-d7a045726407 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:24.997766 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1574b079-aac9-4c61-8347-d7a045726407 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:24.998433 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1574b079-aac9-4c61-8347-d7a045726407 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:25.000059 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1574b079-aac9-4c61-8347-d7a045726407 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:25.001681 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:20:25.017440 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1447/2867] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:20:24 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:20:25.020468 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d755b5-b2ba-4acc-89d3-18929e919d2e admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:25.031913 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d755b5-b2ba-4acc-89d3-18929e919d2e admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:25.038220 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe0098a-e6da-46f9-84c2-098fda960276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:25.038733 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe0098a-e6da-46f9-84c2-098fda960276 admin admin] REQUEST_METHOD: `PUT` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:25.039009 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe0098a-e6da-46f9-84c2-098fda960276 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:25.039308 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe0098a-e6da-46f9-84c2-098fda960276 admin admin] PATH_INFO: `/v3/projects/bf0f1eb0caad4a8ea554cbdabc1997a5/users/429d401d7c234e27b6a537fcd6fe557b/roles/c37945a17623465f899d4f217e7af593` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:25.059693 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe0098a-e6da-46f9-84c2-098fda960276 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf0f1eb0caad4a8ea554cbdabc1997a5, user_id=429d401d7c234e27b6a537fcd6fe557b, role_id=c37945a17623465f899d4f217e7af593)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:25.062476 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe0098a-e6da-46f9-84c2-098fda960276 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:25.078761 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1421/2868] 10.222.0.79 () {60 vars in 1483 bytes} [Tue Aug 30 01:20:25 2022] PUT /identity/v3/projects/bf0f1eb0caad4a8ea554cbdabc1997a5/users/429d401d7c234e27b6a537fcd6fe557b/roles/c37945a17623465f899d4f217e7af593 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:20:25.090277 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e64294-4845-4db0-b8c7-cae4d0137f4f None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:25.090562 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e64294-4845-4db0-b8c7-cae4d0137f4f None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:25.090840 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e64294-4845-4db0-b8c7-cae4d0137f4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:25.126581 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-84e64294-4845-4db0-b8c7-cae4d0137f4f None None] MFA Rules not processed for user `429d401d7c234e27b6a537fcd6fe557b`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:20:25.128141 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-84e64294-4845-4db0-b8c7-cae4d0137f4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:20:25.198383 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1448/2869] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:20:25 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:20:25.210783 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe0098a-e6da-46f9-84c2-098fda960276 admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:25.212746 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-3fe0098a-e6da-46f9-84c2-098fda960276 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:20:25.279964 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe0098a-e6da-46f9-84c2-098fda960276 admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:25.285808 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed01afc1-f03a-40b0-b427-1a0afb3ebe25 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e37a5c33c064c488fd4667170f7703a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:25.286489 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed01afc1-f03a-40b0-b427-1a0afb3ebe25 service glance] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:25.286765 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed01afc1-f03a-40b0-b427-1a0afb3ebe25 service glance] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:25.287029 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed01afc1-f03a-40b0-b427-1a0afb3ebe25 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:25.298784 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed01afc1-f03a-40b0-b427-1a0afb3ebe25 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:25.301415 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed01afc1-f03a-40b0-b427-1a0afb3ebe25 service glance] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:25.314553 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1422/2870] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:20:25 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:20:35.194811 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=34 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:20:35.309262 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=79,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:20:49.449735 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e64294-4845-4db0-b8c7-cae4d0137f4f None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:49.514212 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e64294-4845-4db0-b8c7-cae4d0137f4f None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:49.519327 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5761b3-0962-4eba-a426-616f970f9da1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:49.520006 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5761b3-0962-4eba-a426-616f970f9da1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:49.520766 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5761b3-0962-4eba-a426-616f970f9da1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:49.520766 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5761b3-0962-4eba-a426-616f970f9da1 admin admin] PATH_INFO: `/v3/users/429d401d7c234e27b6a537fcd6fe557b` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:49.522259 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5761b3-0962-4eba-a426-616f970f9da1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=429d401d7c234e27b6a537fcd6fe557b)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:49.524857 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5761b3-0962-4eba-a426-616f970f9da1 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:49.576587 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-bf5761b3-0962-4eba-a426-616f970f9da1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '429d401d7c234e27b6a537fcd6fe557b'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:49.584592 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-bf5761b3-0962-4eba-a426-616f970f9da1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '429d401d7c234e27b6a537fcd6fe557b'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:49.607242 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-bf5761b3-0962-4eba-a426-616f970f9da1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '429d401d7c234e27b6a537fcd6fe557b'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:49.607905 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-bf5761b3-0962-4eba-a426-616f970f9da1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '429d401d7c234e27b6a537fcd6fe557b'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:49.626246 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-bf5761b3-0962-4eba-a426-616f970f9da1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '429d401d7c234e27b6a537fcd6fe557b'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:49.634746 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1449/2871] 10.222.0.79 () {58 vars in 1224 bytes} [Tue Aug 30 01:20:49 2022] DELETE /identity/v3/users/429d401d7c234e27b6a537fcd6fe557b => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:20:49.639492 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8485cff0-adc9-4615-97c3-24bf9fdcebb4 None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:49.640035 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8485cff0-adc9-4615-97c3-24bf9fdcebb4 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:49.640035 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8485cff0-adc9-4615-97c3-24bf9fdcebb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:49.659663 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-8485cff0-adc9-4615-97c3-24bf9fdcebb4 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:20:49.660858 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-8485cff0-adc9-4615-97c3-24bf9fdcebb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:20:49.720431 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1423/2872] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:20:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:20:49.731371 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5761b3-0962-4eba-a426-616f970f9da1 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:49.732821 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-bf5761b3-0962-4eba-a426-616f970f9da1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:20:49.794274 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5761b3-0962-4eba-a426-616f970f9da1 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:49.797730 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7c4469-ab92-49c7-a898-36107555533c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16e6a0ca26fc4ef892c188ad89a1e132', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:49.798302 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7c4469-ab92-49c7-a898-36107555533c service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:49.798612 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7c4469-ab92-49c7-a898-36107555533c service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:49.798846 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7c4469-ab92-49c7-a898-36107555533c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:49.810165 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7c4469-ab92-49c7-a898-36107555533c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:49.811634 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7c4469-ab92-49c7-a898-36107555533c service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:49.822642 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1450/2873] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:20:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 01:20:50.117108 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8485cff0-adc9-4615-97c3-24bf9fdcebb4 None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:50.119070 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-8485cff0-adc9-4615-97c3-24bf9fdcebb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:20:50.133233 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8485cff0-adc9-4615-97c3-24bf9fdcebb4 None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:50.138388 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8172cb31-2740-4a2a-9de3-822bfee207c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:50.139184 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8172cb31-2740-4a2a-9de3-822bfee207c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:50.139472 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8172cb31-2740-4a2a-9de3-822bfee207c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:50.139747 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8172cb31-2740-4a2a-9de3-822bfee207c3 admin admin] PATH_INFO: `/v3/projects/bf0f1eb0caad4a8ea554cbdabc1997a5` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:50.140936 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8172cb31-2740-4a2a-9de3-822bfee207c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf0f1eb0caad4a8ea554cbdabc1997a5)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:50.142881 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8172cb31-2740-4a2a-9de3-822bfee207c3 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:50.201324 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-8172cb31-2740-4a2a-9de3-822bfee207c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf0f1eb0caad4a8ea554cbdabc1997a5', 'request_id': 'req-8172cb31-2740-4a2a-9de3-822bfee207c3'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:50.211119 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-8172cb31-2740-4a2a-9de3-822bfee207c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf0f1eb0caad4a8ea554cbdabc1997a5', 'request_id': 'req-8172cb31-2740-4a2a-9de3-822bfee207c3'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:50.220873 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-8172cb31-2740-4a2a-9de3-822bfee207c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf0f1eb0caad4a8ea554cbdabc1997a5', 'request_id': 'req-8172cb31-2740-4a2a-9de3-822bfee207c3'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:50.242130 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-8172cb31-2740-4a2a-9de3-822bfee207c3 admin admin] The token cache is being invalidate because project bf0f1eb0caad4a8ea554cbdabc1997a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81998) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:20:50.242647 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-8172cb31-2740-4a2a-9de3-822bfee207c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:50.244723 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-8172cb31-2740-4a2a-9de3-822bfee207c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:50.246387 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1424/2874] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 30 01:20:50 2022] DELETE /identity/v3/projects/bf0f1eb0caad4a8ea554cbdabc1997a5 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:20:50.252953 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbd0bcc-4fd2-416c-b1ac-471780f4923a None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:50.253470 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbd0bcc-4fd2-416c-b1ac-471780f4923a None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:50.253810 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbd0bcc-4fd2-416c-b1ac-471780f4923a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:50.294733 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-9bbd0bcc-4fd2-416c-b1ac-471780f4923a None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:20:50.296879 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-9bbd0bcc-4fd2-416c-b1ac-471780f4923a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:20:50.320484 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:20:50.390251 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1451/2875] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:20:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:20:50.399716 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af3d2e6-99d3-4caf-8982-58e3750ba4d3 None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:50.400022 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af3d2e6-99d3-4caf-8982-58e3750ba4d3 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:50.400243 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af3d2e6-99d3-4caf-8982-58e3750ba4d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:50.423165 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-8af3d2e6-99d3-4caf-8982-58e3750ba4d3 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:20:50.424398 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-8af3d2e6-99d3-4caf-8982-58e3750ba4d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:20:50.433574 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1425/2876] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:20:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:20:50.438437 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbd0bcc-4fd2-416c-b1ac-471780f4923a None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:50.450236 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbd0bcc-4fd2-416c-b1ac-471780f4923a None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:50.455029 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7a5c3e-997b-4fc1-a1c3-0e1c6a6b5572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:50.455683 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7a5c3e-997b-4fc1-a1c3-0e1c6a6b5572 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:50.455962 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7a5c3e-997b-4fc1-a1c3-0e1c6a6b5572 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:50.456233 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7a5c3e-997b-4fc1-a1c3-0e1c6a6b5572 admin admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:50.456918 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7a5c3e-997b-4fc1-a1c3-0e1c6a6b5572 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:20:50.457219 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7a5c3e-997b-4fc1-a1c3-0e1c6a6b5572 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:50.460243 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7a5c3e-997b-4fc1-a1c3-0e1c6a6b5572 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:50.473255 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1452/2877] 10.222.0.79 () {58 vars in 1153 bytes} [Tue Aug 30 01:20:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:20:50.479055 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af3d2e6-99d3-4caf-8982-58e3750ba4d3 None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:50.491585 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af3d2e6-99d3-4caf-8982-58e3750ba4d3 None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:50.496811 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80efdf01-9e4f-4aed-bb23-06f7c3bf0a13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:50.497432 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80efdf01-9e4f-4aed-bb23-06f7c3bf0a13 admin admin] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:50.497706 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80efdf01-9e4f-4aed-bb23-06f7c3bf0a13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:50.497974 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80efdf01-9e4f-4aed-bb23-06f7c3bf0a13 admin admin] PATH_INFO: `/v3/projects` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:50.498604 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80efdf01-9e4f-4aed-bb23-06f7c3bf0a13 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:50.500611 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80efdf01-9e4f-4aed-bb23-06f7c3bf0a13 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:50.537601 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1426/2878] 10.222.0.79 () {60 vars in 1153 bytes} [Tue Aug 30 01:20:50 2022] POST /identity/v3/projects => generated 385 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:20:50.539167 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7a5c3e-997b-4fc1-a1c3-0e1c6a6b5572 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:50.550255 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7a5c3e-997b-4fc1-a1c3-0e1c6a6b5572 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:50.618268 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e484ba-5015-4020-aa76-3b187cf3d765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:50.618886 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e484ba-5015-4020-aa76-3b187cf3d765 admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:50.619183 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e484ba-5015-4020-aa76-3b187cf3d765 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:50.619456 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e484ba-5015-4020-aa76-3b187cf3d765 admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:50.620108 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e484ba-5015-4020-aa76-3b187cf3d765 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:50.622110 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e484ba-5015-4020-aa76-3b187cf3d765 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:50.645013 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1453/2879] 10.222.0.79 () {60 vars in 1144 bytes} [Tue Aug 30 01:20:50 2022] POST /identity/v3/users => generated 293 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:20:50.649957 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80efdf01-9e4f-4aed-bb23-06f7c3bf0a13 admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:50.662016 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80efdf01-9e4f-4aed-bb23-06f7c3bf0a13 admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:50.666908 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bae401e-0e79-4e2e-b2e3-7c205049f751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:50.667551 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bae401e-0e79-4e2e-b2e3-7c205049f751 admin admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:50.667827 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bae401e-0e79-4e2e-b2e3-7c205049f751 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:50.668095 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bae401e-0e79-4e2e-b2e3-7c205049f751 admin admin] PATH_INFO: `/v3/roles` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:50.668742 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bae401e-0e79-4e2e-b2e3-7c205049f751 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:50.670378 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bae401e-0e79-4e2e-b2e3-7c205049f751 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:50.680966 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1427/2880] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:20:50 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:20:50.685548 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e484ba-5015-4020-aa76-3b187cf3d765 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:50.696616 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e484ba-5015-4020-aa76-3b187cf3d765 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:50.701358 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bce9dbb-0944-43c6-b78a-3b22cf682fc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:50.701961 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bce9dbb-0944-43c6-b78a-3b22cf682fc1 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:50.702235 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bce9dbb-0944-43c6-b78a-3b22cf682fc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:50.702519 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bce9dbb-0944-43c6-b78a-3b22cf682fc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:50.703230 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bce9dbb-0944-43c6-b78a-3b22cf682fc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:50.704752 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bce9dbb-0944-43c6-b78a-3b22cf682fc1 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:50.717873 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1454/2881] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:20:50 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:20:50.722297 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bae401e-0e79-4e2e-b2e3-7c205049f751 admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:50.732982 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bae401e-0e79-4e2e-b2e3-7c205049f751 admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:50.737798 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c390763d-d15b-47b4-9f11-4b9e51300094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:50.738480 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c390763d-d15b-47b4-9f11-4b9e51300094 admin admin] REQUEST_METHOD: `PUT` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:50.738757 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c390763d-d15b-47b4-9f11-4b9e51300094 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:50.739180 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c390763d-d15b-47b4-9f11-4b9e51300094 admin admin] PATH_INFO: `/v3/projects/074e7147d57246b5867bf5ae998a390d/users/a4d6ac637e5f406eb65e2983d8cd722c/roles/c37945a17623465f899d4f217e7af593` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:50.756006 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c390763d-d15b-47b4-9f11-4b9e51300094 admin admin] RBAC: Authorizing `identity:create_grant(project_id=074e7147d57246b5867bf5ae998a390d, user_id=a4d6ac637e5f406eb65e2983d8cd722c, role_id=c37945a17623465f899d4f217e7af593)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:50.758710 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c390763d-d15b-47b4-9f11-4b9e51300094 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:50.773908 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1428/2882] 10.222.0.79 () {60 vars in 1483 bytes} [Tue Aug 30 01:20:50 2022] PUT /identity/v3/projects/074e7147d57246b5867bf5ae998a390d/users/a4d6ac637e5f406eb65e2983d8cd722c/roles/c37945a17623465f899d4f217e7af593 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:20:50.784991 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac86b3a-724c-4836-b3f1-66ae4a58e2be None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:50.785276 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac86b3a-724c-4836-b3f1-66ae4a58e2be None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:50.785550 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac86b3a-724c-4836-b3f1-66ae4a58e2be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:50.818206 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-8ac86b3a-724c-4836-b3f1-66ae4a58e2be None None] MFA Rules not processed for user `a4d6ac637e5f406eb65e2983d8cd722c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:20:50.819585 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-8ac86b3a-724c-4836-b3f1-66ae4a58e2be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:20:50.887799 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1455/2883] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:20:50 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:20:50.900118 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c390763d-d15b-47b4-9f11-4b9e51300094 admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:50.901820 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-c390763d-d15b-47b4-9f11-4b9e51300094 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:20:50.925427 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:20:50.966898 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c390763d-d15b-47b4-9f11-4b9e51300094 admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:50.970602 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cce5c3a-a565-45b9-8d4e-7124a223fec1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f827c7670b74d938ffe066ced88d1c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:50.971245 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cce5c3a-a565-45b9-8d4e-7124a223fec1 service cinder] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:50.971522 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cce5c3a-a565-45b9-8d4e-7124a223fec1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:50.971787 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cce5c3a-a565-45b9-8d4e-7124a223fec1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:50.993642 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cce5c3a-a565-45b9-8d4e-7124a223fec1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:50.995165 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cce5c3a-a565-45b9-8d4e-7124a223fec1 service cinder] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:51.009322 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1429/2884] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:20:50 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:20:53.569974 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac86b3a-724c-4836-b3f1-66ae4a58e2be None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:53.588990 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:20:53.636128 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac86b3a-724c-4836-b3f1-66ae4a58e2be None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:53.640734 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a3b264-8145-465d-8370-0f495c043df7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:53.641372 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a3b264-8145-465d-8370-0f495c043df7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:53.641647 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a3b264-8145-465d-8370-0f495c043df7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:53.641953 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a3b264-8145-465d-8370-0f495c043df7 admin admin] PATH_INFO: `/v3/users/a4d6ac637e5f406eb65e2983d8cd722c` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:53.643154 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a3b264-8145-465d-8370-0f495c043df7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4d6ac637e5f406eb65e2983d8cd722c)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:53.645190 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a3b264-8145-465d-8370-0f495c043df7 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:53.696438 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-59a3b264-8145-465d-8370-0f495c043df7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4d6ac637e5f406eb65e2983d8cd722c'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:53.703521 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-59a3b264-8145-465d-8370-0f495c043df7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4d6ac637e5f406eb65e2983d8cd722c'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:53.712745 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-59a3b264-8145-465d-8370-0f495c043df7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4d6ac637e5f406eb65e2983d8cd722c'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:53.713442 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-59a3b264-8145-465d-8370-0f495c043df7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4d6ac637e5f406eb65e2983d8cd722c'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:53.728912 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-59a3b264-8145-465d-8370-0f495c043df7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4d6ac637e5f406eb65e2983d8cd722c'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:53.735647 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1456/2885] 10.222.0.79 () {58 vars in 1224 bytes} [Tue Aug 30 01:20:53 2022] DELETE /identity/v3/users/a4d6ac637e5f406eb65e2983d8cd722c => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:20:53.743250 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fe3d13-7972-4574-b3fb-a95d8f547424 None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:53.743836 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fe3d13-7972-4574-b3fb-a95d8f547424 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:53.743836 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fe3d13-7972-4574-b3fb-a95d8f547424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:53.764146 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-e5fe3d13-7972-4574-b3fb-a95d8f547424 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:20:53.765408 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-e5fe3d13-7972-4574-b3fb-a95d8f547424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:20:53.835291 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1430/2886] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:20:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:20:53.845313 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a3b264-8145-465d-8370-0f495c043df7 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:53.846782 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-59a3b264-8145-465d-8370-0f495c043df7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:20:53.918007 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a3b264-8145-465d-8370-0f495c043df7 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:53.922579 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dcb79c-fca8-43df-9300-7995c2ff16bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16e6a0ca26fc4ef892c188ad89a1e132', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:53.923222 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dcb79c-fca8-43df-9300-7995c2ff16bf service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:53.923489 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dcb79c-fca8-43df-9300-7995c2ff16bf service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:53.923807 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dcb79c-fca8-43df-9300-7995c2ff16bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:53.935038 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dcb79c-fca8-43df-9300-7995c2ff16bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:53.936481 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dcb79c-fca8-43df-9300-7995c2ff16bf service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:53.949081 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1457/2887] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:20:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:20:54.276556 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fe3d13-7972-4574-b3fb-a95d8f547424 None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:54.278243 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-e5fe3d13-7972-4574-b3fb-a95d8f547424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:20:54.292162 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fe3d13-7972-4574-b3fb-a95d8f547424 None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:54.297098 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cd8a61-43b1-47fb-846b-0fc7a19cc765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:54.297743 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cd8a61-43b1-47fb-846b-0fc7a19cc765 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:54.298010 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cd8a61-43b1-47fb-846b-0fc7a19cc765 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:54.298310 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cd8a61-43b1-47fb-846b-0fc7a19cc765 admin admin] PATH_INFO: `/v3/projects/074e7147d57246b5867bf5ae998a390d` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:54.300648 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cd8a61-43b1-47fb-846b-0fc7a19cc765 admin admin] RBAC: Authorizing `identity:delete_project(project_id=074e7147d57246b5867bf5ae998a390d)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:54.302948 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cd8a61-43b1-47fb-846b-0fc7a19cc765 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:54.367557 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-a8cd8a61-43b1-47fb-846b-0fc7a19cc765 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '074e7147d57246b5867bf5ae998a390d', 'request_id': 'req-a8cd8a61-43b1-47fb-846b-0fc7a19cc765'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:54.376677 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-a8cd8a61-43b1-47fb-846b-0fc7a19cc765 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '074e7147d57246b5867bf5ae998a390d', 'request_id': 'req-a8cd8a61-43b1-47fb-846b-0fc7a19cc765'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:54.384660 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-a8cd8a61-43b1-47fb-846b-0fc7a19cc765 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '074e7147d57246b5867bf5ae998a390d', 'request_id': 'req-a8cd8a61-43b1-47fb-846b-0fc7a19cc765'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:54.398119 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-a8cd8a61-43b1-47fb-846b-0fc7a19cc765 admin admin] The token cache is being invalidate because project 074e7147d57246b5867bf5ae998a390d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81998) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:20:54.398403 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-a8cd8a61-43b1-47fb-846b-0fc7a19cc765 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:54.399089 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-a8cd8a61-43b1-47fb-846b-0fc7a19cc765 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:54.400643 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1431/2888] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 30 01:20:54 2022] DELETE /identity/v3/projects/074e7147d57246b5867bf5ae998a390d => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:20:54.406350 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f47ea5c-936d-460e-a727-cec02684b5c2 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:54.406710 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f47ea5c-936d-460e-a727-cec02684b5c2 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:54.406986 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f47ea5c-936d-460e-a727-cec02684b5c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:54.432113 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-8f47ea5c-936d-460e-a727-cec02684b5c2 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:20:54.433356 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-8f47ea5c-936d-460e-a727-cec02684b5c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:20:54.474148 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:20:54.507955 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1458/2889] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:20:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:20:54.516391 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f8f840-d91b-4d09-8ac2-e22efe192054 None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:54.516691 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f8f840-d91b-4d09-8ac2-e22efe192054 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:54.517019 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f8f840-d91b-4d09-8ac2-e22efe192054 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:54.541519 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-14f8f840-d91b-4d09-8ac2-e22efe192054 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:20:54.542759 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-14f8f840-d91b-4d09-8ac2-e22efe192054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:20:54.551206 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1432/2890] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:20:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:20:54.557297 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f47ea5c-936d-460e-a727-cec02684b5c2 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:54.568202 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f47ea5c-936d-460e-a727-cec02684b5c2 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:54.573144 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96541028-5e8e-4458-aac1-5635a1558932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:54.573760 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96541028-5e8e-4458-aac1-5635a1558932 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:54.574029 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96541028-5e8e-4458-aac1-5635a1558932 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:54.574315 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96541028-5e8e-4458-aac1-5635a1558932 admin admin] PATH_INFO: `/v3/domains` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:54.574972 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96541028-5e8e-4458-aac1-5635a1558932 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:20:54.575317 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96541028-5e8e-4458-aac1-5635a1558932 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:54.576913 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96541028-5e8e-4458-aac1-5635a1558932 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:54.590141 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1459/2891] 10.222.0.79 () {58 vars in 1153 bytes} [Tue Aug 30 01:20:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:20:54.594906 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f8f840-d91b-4d09-8ac2-e22efe192054 None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:54.605453 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f8f840-d91b-4d09-8ac2-e22efe192054 None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:54.611030 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b34c80-e808-407f-8265-f186535a21a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:54.611729 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b34c80-e808-407f-8265-f186535a21a1 admin admin] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:54.612007 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b34c80-e808-407f-8265-f186535a21a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:54.612278 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b34c80-e808-407f-8265-f186535a21a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:54.612954 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b34c80-e808-407f-8265-f186535a21a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:54.615555 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b34c80-e808-407f-8265-f186535a21a1 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:54.647224 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1433/2892] 10.222.0.79 () {60 vars in 1153 bytes} [Tue Aug 30 01:20:54 2022] POST /identity/v3/projects => generated 391 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:20:54.651792 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96541028-5e8e-4458-aac1-5635a1558932 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:54.663792 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96541028-5e8e-4458-aac1-5635a1558932 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:54.730567 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6084c0e-d1ce-4aad-901d-161aad1c58fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:54.731217 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6084c0e-d1ce-4aad-901d-161aad1c58fb admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:54.731502 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6084c0e-d1ce-4aad-901d-161aad1c58fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:54.731789 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6084c0e-d1ce-4aad-901d-161aad1c58fb admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:54.732488 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6084c0e-d1ce-4aad-901d-161aad1c58fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:54.734406 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6084c0e-d1ce-4aad-901d-161aad1c58fb admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:54.757189 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1460/2893] 10.222.0.79 () {60 vars in 1144 bytes} [Tue Aug 30 01:20:54 2022] POST /identity/v3/users => generated 296 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:20:54.761685 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b34c80-e808-407f-8265-f186535a21a1 admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:54.773571 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b34c80-e808-407f-8265-f186535a21a1 admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:54.778541 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01011212-2683-4c73-ae13-c463ee604377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:54.779189 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01011212-2683-4c73-ae13-c463ee604377 admin admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:54.779469 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01011212-2683-4c73-ae13-c463ee604377 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:54.779736 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01011212-2683-4c73-ae13-c463ee604377 admin admin] PATH_INFO: `/v3/roles` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:54.780393 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01011212-2683-4c73-ae13-c463ee604377 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:54.782023 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01011212-2683-4c73-ae13-c463ee604377 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:54.793699 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1434/2894] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:20:54 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:20:54.798027 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6084c0e-d1ce-4aad-901d-161aad1c58fb admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:54.809527 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6084c0e-d1ce-4aad-901d-161aad1c58fb admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:54.814546 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35992696-5c85-4f56-afcb-5eb74a9337c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:54.815194 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35992696-5c85-4f56-afcb-5eb74a9337c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:54.815478 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35992696-5c85-4f56-afcb-5eb74a9337c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:54.815751 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35992696-5c85-4f56-afcb-5eb74a9337c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:54.816411 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35992696-5c85-4f56-afcb-5eb74a9337c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:54.818884 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35992696-5c85-4f56-afcb-5eb74a9337c2 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:54.831464 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1461/2895] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:20:54 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:20:54.836049 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01011212-2683-4c73-ae13-c463ee604377 admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:54.846610 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01011212-2683-4c73-ae13-c463ee604377 admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:54.851822 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc00ce92-512d-4999-aec2-6b0147e33d54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:54.852500 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc00ce92-512d-4999-aec2-6b0147e33d54 admin admin] REQUEST_METHOD: `PUT` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:54.852780 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc00ce92-512d-4999-aec2-6b0147e33d54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:54.853053 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc00ce92-512d-4999-aec2-6b0147e33d54 admin admin] PATH_INFO: `/v3/projects/35e2ce23d1ff4c189c6c966211ddd8ae/users/1cad856a3dfa48eb9085641dce60b5a2/roles/c37945a17623465f899d4f217e7af593` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:54.855537 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:20:54.873083 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc00ce92-512d-4999-aec2-6b0147e33d54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35e2ce23d1ff4c189c6c966211ddd8ae, user_id=1cad856a3dfa48eb9085641dce60b5a2, role_id=c37945a17623465f899d4f217e7af593)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:54.875856 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc00ce92-512d-4999-aec2-6b0147e33d54 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:54.892432 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35992696-5c85-4f56-afcb-5eb74a9337c2 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:54.895554 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-35992696-5c85-4f56-afcb-5eb74a9337c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:20:54.896998 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1435/2896] 10.222.0.79 () {60 vars in 1483 bytes} [Tue Aug 30 01:20:54 2022] PUT /identity/v3/projects/35e2ce23d1ff4c189c6c966211ddd8ae/users/1cad856a3dfa48eb9085641dce60b5a2/roles/c37945a17623465f899d4f217e7af593 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:20:54.916337 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35992696-5c85-4f56-afcb-5eb74a9337c2 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:54.967485 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac945b3-d7b0-4639-bea7-9a0f71d18403 None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:54.967764 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac945b3-d7b0-4639-bea7-9a0f71d18403 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:54.968031 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac945b3-d7b0-4639-bea7-9a0f71d18403 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:54.984949 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048b86fe-a4e5-4caf-b454-087d4d47f977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:54.985576 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048b86fe-a4e5-4caf-b454-087d4d47f977 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:54.985851 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048b86fe-a4e5-4caf-b454-087d4d47f977 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:54.986119 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048b86fe-a4e5-4caf-b454-087d4d47f977 admin admin] PATH_INFO: `/v3/users/cfd08b4d355a42c8841fbc7a11284762` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:54.987268 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048b86fe-a4e5-4caf-b454-087d4d47f977 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cfd08b4d355a42c8841fbc7a11284762)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:54.989902 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048b86fe-a4e5-4caf-b454-087d4d47f977 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:54.997665 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-dac945b3-d7b0-4639-bea7-9a0f71d18403 None None] MFA Rules not processed for user `1cad856a3dfa48eb9085641dce60b5a2`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:20:54.998938 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-dac945b3-d7b0-4639-bea7-9a0f71d18403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:20:55.053823 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-048b86fe-a4e5-4caf-b454-087d4d47f977 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cfd08b4d355a42c8841fbc7a11284762'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:55.055292 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:20:55.062823 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-048b86fe-a4e5-4caf-b454-087d4d47f977 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cfd08b4d355a42c8841fbc7a11284762'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:55.073744 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-048b86fe-a4e5-4caf-b454-087d4d47f977 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cfd08b4d355a42c8841fbc7a11284762'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:55.074697 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-048b86fe-a4e5-4caf-b454-087d4d47f977 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cfd08b4d355a42c8841fbc7a11284762'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:55.075905 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1436/2897] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:20:54 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:20:55.088251 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac945b3-d7b0-4639-bea7-9a0f71d18403 None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:55.090348 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-dac945b3-d7b0-4639-bea7-9a0f71d18403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:20:55.092342 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-048b86fe-a4e5-4caf-b454-087d4d47f977 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cfd08b4d355a42c8841fbc7a11284762'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:55.103774 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1462/2898] 10.222.0.79 () {58 vars in 1224 bytes} [Tue Aug 30 01:20:54 2022] DELETE /identity/v3/users/cfd08b4d355a42c8841fbc7a11284762 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:20:55.108104 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be2813f-d38b-4ed3-b301-50b50a0b7d19 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:55.108387 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be2813f-d38b-4ed3-b301-50b50a0b7d19 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:55.108659 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be2813f-d38b-4ed3-b301-50b50a0b7d19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:55.133991 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-7be2813f-d38b-4ed3-b301-50b50a0b7d19 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:20:55.135739 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-7be2813f-d38b-4ed3-b301-50b50a0b7d19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:20:55.169751 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac945b3-d7b0-4639-bea7-9a0f71d18403 None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:55.212642 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1463/2899] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:20:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:20:55.224108 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be2813f-d38b-4ed3-b301-50b50a0b7d19 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:55.225618 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-7be2813f-d38b-4ed3-b301-50b50a0b7d19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:20:55.231964 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1589d2a-59a6-41f8-874a-45a23f393d9f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f827c7670b74d938ffe066ced88d1c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:55.233204 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1589d2a-59a6-41f8-874a-45a23f393d9f service cinder] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:55.233808 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1589d2a-59a6-41f8-874a-45a23f393d9f service cinder] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:55.234552 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1589d2a-59a6-41f8-874a-45a23f393d9f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:55.236866 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-a1589d2a-59a6-41f8-874a-45a23f393d9f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:20:55.292866 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be2813f-d38b-4ed3-b301-50b50a0b7d19 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:55.294119 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:20:55.296833 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d72b120-eac3-418d-a7d2-2fb5a9f2d743 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16e6a0ca26fc4ef892c188ad89a1e132', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:55.297525 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d72b120-eac3-418d-a7d2-2fb5a9f2d743 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:55.297816 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d72b120-eac3-418d-a7d2-2fb5a9f2d743 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:55.298095 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d72b120-eac3-418d-a7d2-2fb5a9f2d743 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:55.309286 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d72b120-eac3-418d-a7d2-2fb5a9f2d743 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:55.310753 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d72b120-eac3-418d-a7d2-2fb5a9f2d743 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:55.315784 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1589d2a-59a6-41f8-874a-45a23f393d9f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:55.317899 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1589d2a-59a6-41f8-874a-45a23f393d9f service cinder] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:55.321850 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1464/2900] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:20:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 01:20:55.327999 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1437/2901] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:20:55 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 01:20:55.642468 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d72b120-eac3-418d-a7d2-2fb5a9f2d743 service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:55.644148 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-6d72b120-eac3-418d-a7d2-2fb5a9f2d743 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:20:55.668839 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d72b120-eac3-418d-a7d2-2fb5a9f2d743 service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:55.695585 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1a1d93-62b9-4989-ad3e-6eadbdb1e07d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:55.696253 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1a1d93-62b9-4989-ad3e-6eadbdb1e07d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:55.696638 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1a1d93-62b9-4989-ad3e-6eadbdb1e07d admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:55.697038 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1a1d93-62b9-4989-ad3e-6eadbdb1e07d admin admin] PATH_INFO: `/v3/projects/9defd939626541178749656f334ab579` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:55.698789 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1a1d93-62b9-4989-ad3e-6eadbdb1e07d admin admin] RBAC: Authorizing `identity:delete_project(project_id=9defd939626541178749656f334ab579)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:55.701256 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1a1d93-62b9-4989-ad3e-6eadbdb1e07d admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:55.777344 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-1e1a1d93-62b9-4989-ad3e-6eadbdb1e07d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9defd939626541178749656f334ab579', 'request_id': 'req-1e1a1d93-62b9-4989-ad3e-6eadbdb1e07d'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:55.785183 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-1e1a1d93-62b9-4989-ad3e-6eadbdb1e07d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9defd939626541178749656f334ab579', 'request_id': 'req-1e1a1d93-62b9-4989-ad3e-6eadbdb1e07d'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:55.790736 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:20:55.792054 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-1e1a1d93-62b9-4989-ad3e-6eadbdb1e07d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9defd939626541178749656f334ab579', 'request_id': 'req-1e1a1d93-62b9-4989-ad3e-6eadbdb1e07d'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:55.806548 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-1e1a1d93-62b9-4989-ad3e-6eadbdb1e07d admin admin] The token cache is being invalidate because project 9defd939626541178749656f334ab579 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:20:55.806838 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-1e1a1d93-62b9-4989-ad3e-6eadbdb1e07d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:55.807515 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-1e1a1d93-62b9-4989-ad3e-6eadbdb1e07d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:55.808989 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1465/2902] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 30 01:20:55 2022] DELETE /identity/v3/projects/9defd939626541178749656f334ab579 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:21:05.323298 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=8 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:21:05.555851 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1589d2a-59a6-41f8-874a-45a23f393d9f service cinder] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:21:05.557294 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-a1589d2a-59a6-41f8-874a-45a23f393d9f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:21:05.637829 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1589d2a-59a6-41f8-874a-45a23f393d9f service cinder] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:21:05.701716 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fd0f4a-a5f6-4bcb-ab30-843a224ef077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:21:05.702338 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fd0f4a-a5f6-4bcb-ab30-843a224ef077 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:21:05.702635 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fd0f4a-a5f6-4bcb-ab30-843a224ef077 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:21:05.702926 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fd0f4a-a5f6-4bcb-ab30-843a224ef077 admin admin] PATH_INFO: `/v3/users/1cad856a3dfa48eb9085641dce60b5a2` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:21:05.704085 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fd0f4a-a5f6-4bcb-ab30-843a224ef077 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1cad856a3dfa48eb9085641dce60b5a2)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:21:05.705956 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fd0f4a-a5f6-4bcb-ab30-843a224ef077 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:21:05.763254 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-54fd0f4a-a5f6-4bcb-ab30-843a224ef077 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1cad856a3dfa48eb9085641dce60b5a2'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:21:05.771626 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-54fd0f4a-a5f6-4bcb-ab30-843a224ef077 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1cad856a3dfa48eb9085641dce60b5a2'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:21:05.785251 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-54fd0f4a-a5f6-4bcb-ab30-843a224ef077 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1cad856a3dfa48eb9085641dce60b5a2'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:21:05.785911 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-54fd0f4a-a5f6-4bcb-ab30-843a224ef077 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1cad856a3dfa48eb9085641dce60b5a2'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:21:05.794671 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-54fd0f4a-a5f6-4bcb-ab30-843a224ef077 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1cad856a3dfa48eb9085641dce60b5a2'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:21:05.802759 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1438/2903] 10.222.0.79 () {58 vars in 1224 bytes} [Tue Aug 30 01:21:05 2022] DELETE /identity/v3/users/1cad856a3dfa48eb9085641dce60b5a2 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:21:05.803449 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=4 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:21:05.807377 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9947ef8f-14b2-4aa2-b696-6d6ca6e027b6 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:21:05.807662 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9947ef8f-14b2-4aa2-b696-6d6ca6e027b6 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:21:05.808186 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9947ef8f-14b2-4aa2-b696-6d6ca6e027b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:21:05.839733 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-9947ef8f-14b2-4aa2-b696-6d6ca6e027b6 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:21:05.841305 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-9947ef8f-14b2-4aa2-b696-6d6ca6e027b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:21:05.904770 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1466/2904] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:21:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:21:05.915933 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fd0f4a-a5f6-4bcb-ab30-843a224ef077 admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:21:05.917385 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-54fd0f4a-a5f6-4bcb-ab30-843a224ef077 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:21:05.939522 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:21:05.999811 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fd0f4a-a5f6-4bcb-ab30-843a224ef077 admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:21:06.003564 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9eede7-ea57-42ee-8639-99fed488947f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16e6a0ca26fc4ef892c188ad89a1e132', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:21:06.004170 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9eede7-ea57-42ee-8639-99fed488947f service neutron] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:21:06.004446 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9eede7-ea57-42ee-8639-99fed488947f service neutron] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:21:06.004717 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9eede7-ea57-42ee-8639-99fed488947f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:21:06.014304 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9eede7-ea57-42ee-8639-99fed488947f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:21:06.015783 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9eede7-ea57-42ee-8639-99fed488947f service neutron] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:21:06.025991 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1439/2905] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:21:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:21:06.314482 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9947ef8f-14b2-4aa2-b696-6d6ca6e027b6 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:21:06.316142 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-9947ef8f-14b2-4aa2-b696-6d6ca6e027b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:21:06.332354 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9947ef8f-14b2-4aa2-b696-6d6ca6e027b6 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:21:06.338979 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15326cb2-77f1-4d42-adf4-e281a5e6aade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:21:06.339723 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15326cb2-77f1-4d42-adf4-e281a5e6aade admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:21:06.340027 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15326cb2-77f1-4d42-adf4-e281a5e6aade admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:21:06.340321 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15326cb2-77f1-4d42-adf4-e281a5e6aade admin admin] PATH_INFO: `/v3/projects/35e2ce23d1ff4c189c6c966211ddd8ae` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:21:06.341631 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15326cb2-77f1-4d42-adf4-e281a5e6aade admin admin] RBAC: Authorizing `identity:delete_project(project_id=35e2ce23d1ff4c189c6c966211ddd8ae)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:21:06.343626 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15326cb2-77f1-4d42-adf4-e281a5e6aade admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:21:06.392842 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-15326cb2-77f1-4d42-adf4-e281a5e6aade admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35e2ce23d1ff4c189c6c966211ddd8ae', 'request_id': 'req-15326cb2-77f1-4d42-adf4-e281a5e6aade'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:21:06.401810 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-15326cb2-77f1-4d42-adf4-e281a5e6aade admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35e2ce23d1ff4c189c6c966211ddd8ae', 'request_id': 'req-15326cb2-77f1-4d42-adf4-e281a5e6aade'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:21:06.407554 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-15326cb2-77f1-4d42-adf4-e281a5e6aade admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35e2ce23d1ff4c189c6c966211ddd8ae', 'request_id': 'req-15326cb2-77f1-4d42-adf4-e281a5e6aade'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:21:06.418797 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-15326cb2-77f1-4d42-adf4-e281a5e6aade admin admin] The token cache is being invalidate because project 35e2ce23d1ff4c189c6c966211ddd8ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:21:06.419085 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-15326cb2-77f1-4d42-adf4-e281a5e6aade admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:21:06.419740 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-15326cb2-77f1-4d42-adf4-e281a5e6aade admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:21:06.421206 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1467/2906] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 30 01:21:06 2022] DELETE /identity/v3/projects/35e2ce23d1ff4c189c6c966211ddd8ae => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:21:06.426133 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6400ad1-9e77-4336-be85-13902de63aaa None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:21:06.426600 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6400ad1-9e77-4336-be85-13902de63aaa None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:21:06.426697 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6400ad1-9e77-4336-be85-13902de63aaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:21:06.476387 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-a6400ad1-9e77-4336-be85-13902de63aaa None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:21:06.477579 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-a6400ad1-9e77-4336-be85-13902de63aaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:21:06.536848 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1440/2907] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:21:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:21:06.544616 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7c7b4d-bb16-4a49-a53d-b157c3b235a1 None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:21:06.544895 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7c7b4d-bb16-4a49-a53d-b157c3b235a1 None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:21:06.545173 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7c7b4d-bb16-4a49-a53d-b157c3b235a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:21:06.565950 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-ad7c7b4d-bb16-4a49-a53d-b157c3b235a1 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:21:06.567337 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-ad7c7b4d-bb16-4a49-a53d-b157c3b235a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:21:06.576428 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1468/2908] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:21:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:21:06.581248 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6400ad1-9e77-4336-be85-13902de63aaa None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:21:06.592581 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6400ad1-9e77-4336-be85-13902de63aaa None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:21:06.597936 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7145e9-fc33-41fe-aa36-9c1b31520741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:21:06.598587 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7145e9-fc33-41fe-aa36-9c1b31520741 admin admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:21:06.598863 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7145e9-fc33-41fe-aa36-9c1b31520741 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:21:06.599164 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7145e9-fc33-41fe-aa36-9c1b31520741 admin admin] PATH_INFO: `/v3/domains` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:21:06.599813 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7145e9-fc33-41fe-aa36-9c1b31520741 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:21:06.600117 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7145e9-fc33-41fe-aa36-9c1b31520741 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:21:06.602564 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7145e9-fc33-41fe-aa36-9c1b31520741 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:21:06.615979 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1441/2909] 10.222.0.79 () {58 vars in 1153 bytes} [Tue Aug 30 01:21:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:21:06.621608 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7c7b4d-bb16-4a49-a53d-b157c3b235a1 None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:21:06.631325 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7c7b4d-bb16-4a49-a53d-b157c3b235a1 None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:21:06.638517 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90235e6-fd9f-4136-9539-cfcd18eb82cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:21:06.639548 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90235e6-fd9f-4136-9539-cfcd18eb82cd admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:21:06.640186 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90235e6-fd9f-4136-9539-cfcd18eb82cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:21:06.640845 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90235e6-fd9f-4136-9539-cfcd18eb82cd admin admin] PATH_INFO: `/v3/projects` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:21:06.641775 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90235e6-fd9f-4136-9539-cfcd18eb82cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:21:06.644277 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90235e6-fd9f-4136-9539-cfcd18eb82cd admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:21:06.678863 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1469/2910] 10.222.0.79 () {60 vars in 1153 bytes} [Tue Aug 30 01:21:06 2022] POST /identity/v3/projects => generated 371 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:21:06.680694 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7145e9-fc33-41fe-aa36-9c1b31520741 admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:21:06.690722 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7145e9-fc33-41fe-aa36-9c1b31520741 admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:21:06.750391 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f29c566-49b8-4f64-9c4a-5a1986b839da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:21:06.750990 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f29c566-49b8-4f64-9c4a-5a1986b839da admin admin] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:21:06.751343 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f29c566-49b8-4f64-9c4a-5a1986b839da admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:21:06.751613 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f29c566-49b8-4f64-9c4a-5a1986b839da admin admin] PATH_INFO: `/v3/users` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:21:06.752232 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f29c566-49b8-4f64-9c4a-5a1986b839da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:21:06.754129 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f29c566-49b8-4f64-9c4a-5a1986b839da admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:21:06.770651 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:21:06.777758 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1442/2911] 10.222.0.79 () {60 vars in 1144 bytes} [Tue Aug 30 01:21:06 2022] POST /identity/v3/users => generated 286 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:21:06.782146 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90235e6-fd9f-4136-9539-cfcd18eb82cd admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:21:06.793104 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90235e6-fd9f-4136-9539-cfcd18eb82cd admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:21:06.797613 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2f6948-4109-4186-a5da-c19cefcb377b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:21:06.798207 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2f6948-4109-4186-a5da-c19cefcb377b admin admin] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:21:06.798468 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2f6948-4109-4186-a5da-c19cefcb377b admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:21:06.798734 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2f6948-4109-4186-a5da-c19cefcb377b admin admin] PATH_INFO: `/v3/roles` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:21:06.799395 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2f6948-4109-4186-a5da-c19cefcb377b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:21:06.800968 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2f6948-4109-4186-a5da-c19cefcb377b admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:21:06.811757 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1470/2912] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:21:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:21:06.815757 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f29c566-49b8-4f64-9c4a-5a1986b839da admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:21:06.826629 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f29c566-49b8-4f64-9c4a-5a1986b839da admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:21:06.831041 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd630de0-0e2e-445d-babd-88704f4d2d5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:21:06.831655 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd630de0-0e2e-445d-babd-88704f4d2d5c admin admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:21:06.831928 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd630de0-0e2e-445d-babd-88704f4d2d5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:21:06.832193 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd630de0-0e2e-445d-babd-88704f4d2d5c admin admin] PATH_INFO: `/v3/roles` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:21:06.832822 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd630de0-0e2e-445d-babd-88704f4d2d5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:21:06.834389 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd630de0-0e2e-445d-babd-88704f4d2d5c admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:21:06.845008 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1443/2913] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:21:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:21:06.849546 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2f6948-4109-4186-a5da-c19cefcb377b admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:21:06.860814 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2f6948-4109-4186-a5da-c19cefcb377b admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:21:06.865780 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafb5bd1-b156-4c57-ad94-632b9ca02eba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:21:06.866454 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafb5bd1-b156-4c57-ad94-632b9ca02eba admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:21:06.866737 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafb5bd1-b156-4c57-ad94-632b9ca02eba admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:21:06.867510 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafb5bd1-b156-4c57-ad94-632b9ca02eba admin admin] PATH_INFO: `/v3/projects/52b9a097a88f4aba893b0c6ad8cf9a0a/users/aae6ad7feedc4b2f85b010a0540c013d/roles/c37945a17623465f899d4f217e7af593` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:21:06.884735 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafb5bd1-b156-4c57-ad94-632b9ca02eba admin admin] RBAC: Authorizing `identity:create_grant(project_id=52b9a097a88f4aba893b0c6ad8cf9a0a, user_id=aae6ad7feedc4b2f85b010a0540c013d, role_id=c37945a17623465f899d4f217e7af593)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:21:06.887425 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafb5bd1-b156-4c57-ad94-632b9ca02eba admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:21:06.901359 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1471/2914] 10.222.0.79 () {60 vars in 1483 bytes} [Tue Aug 30 01:21:06 2022] PUT /identity/v3/projects/52b9a097a88f4aba893b0c6ad8cf9a0a/users/aae6ad7feedc4b2f85b010a0540c013d/roles/c37945a17623465f899d4f217e7af593 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:21:06.906755 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83bcadf-ac8c-4a5d-b979-67506101ebd4 None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:21:06.907038 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83bcadf-ac8c-4a5d-b979-67506101ebd4 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:21:06.907357 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83bcadf-ac8c-4a5d-b979-67506101ebd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:21:06.926718 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-d83bcadf-ac8c-4a5d-b979-67506101ebd4 None None] MFA Rules not processed for user `54c77b2049f04525ac7b6806a553b84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:21:06.927910 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-d83bcadf-ac8c-4a5d-b979-67506101ebd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:21:06.989582 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1444/2915] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:21:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:21:07.000290 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafb5bd1-b156-4c57-ad94-632b9ca02eba admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:21:07.002087 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-fafb5bd1-b156-4c57-ad94-632b9ca02eba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:21:07.016397 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:21:07.066900 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafb5bd1-b156-4c57-ad94-632b9ca02eba admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:21:07.071549 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e72ecd3-6a0e-445d-a3ec-fa2795435a26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16e6a0ca26fc4ef892c188ad89a1e132', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:21:07.072161 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e72ecd3-6a0e-445d-a3ec-fa2795435a26 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:21:07.072436 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e72ecd3-6a0e-445d-a3ec-fa2795435a26 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:21:07.072702 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e72ecd3-6a0e-445d-a3ec-fa2795435a26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:21:07.082655 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e72ecd3-6a0e-445d-a3ec-fa2795435a26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:21:07.084031 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e72ecd3-6a0e-445d-a3ec-fa2795435a26 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:21:07.094692 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1472/2916] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:21:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:21:07.409789 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83bcadf-ac8c-4a5d-b979-67506101ebd4 None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:21:07.411523 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-d83bcadf-ac8c-4a5d-b979-67506101ebd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:21:07.536466 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83bcadf-ac8c-4a5d-b979-67506101ebd4 None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:21:07.543730 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0ff393-112a-46ae-9c13-775cca3f19a8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd68e91e4259e449797fb83de548aec1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:21:07.544543 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0ff393-112a-46ae-9c13-775cca3f19a8 service placement] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:21:07.544820 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0ff393-112a-46ae-9c13-775cca3f19a8 service placement] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:21:07.545088 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0ff393-112a-46ae-9c13-775cca3f19a8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:21:07.546868 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-7e0ff393-112a-46ae-9c13-775cca3f19a8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:21:07.559645 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0ff393-112a-46ae-9c13-775cca3f19a8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:21:07.561243 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0ff393-112a-46ae-9c13-775cca3f19a8 service placement] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:21:07.576721 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1445/2917] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:21:07 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:21:12.150593 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16bad62-9314-41ea-8b2d-84a3f735f3ef None None] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:21:12.151322 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16bad62-9314-41ea-8b2d-84a3f735f3ef None None] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:21:12.151322 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16bad62-9314-41ea-8b2d-84a3f735f3ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:21:12.186181 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.auth.core [None req-c16bad62-9314-41ea-8b2d-84a3f735f3ef None None] MFA Rules not processed for user `aae6ad7feedc4b2f85b010a0540c013d`. Rule list: `[]` (Enabled: `True`). {{(pid=81999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:21:12.187469 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-c16bad62-9314-41ea-8b2d-84a3f735f3ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:21:12.290430 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1473/2918] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:21:12 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:21:12.291705 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0ff393-112a-46ae-9c13-775cca3f19a8 service placement] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:21:12.303330 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0ff393-112a-46ae-9c13-775cca3f19a8 service placement] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:21:12.308845 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c69b752-0415-4b05-87b3-2629a8742ef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:21:12.309459 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c69b752-0415-4b05-87b3-2629a8742ef8 admin admin] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:21:12.309735 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c69b752-0415-4b05-87b3-2629a8742ef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:21:12.310000 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c69b752-0415-4b05-87b3-2629a8742ef8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:21:12.310634 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c69b752-0415-4b05-87b3-2629a8742ef8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:21:12.312598 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c69b752-0415-4b05-87b3-2629a8742ef8 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:21:12.352206 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1446/2919] 10.222.0.79 () {60 vars in 1153 bytes} [Tue Aug 30 01:21:12 2022] POST /identity/v3/projects => generated 371 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:21:12.353426 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16bad62-9314-41ea-8b2d-84a3f735f3ef None None] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:21:12.367201 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16bad62-9314-41ea-8b2d-84a3f735f3ef None None] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:21:12.430039 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1072caf-2687-4068-89b7-777926b798bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:21:12.430618 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1072caf-2687-4068-89b7-777926b798bd admin admin] REQUEST_METHOD: `POST` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:21:12.430890 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1072caf-2687-4068-89b7-777926b798bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:21:12.431188 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1072caf-2687-4068-89b7-777926b798bd admin admin] PATH_INFO: `/v3/users` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:21:12.431822 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1072caf-2687-4068-89b7-777926b798bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:21:12.433715 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1072caf-2687-4068-89b7-777926b798bd admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:21:12.455773 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1474/2920] 10.222.0.79 () {60 vars in 1144 bytes} [Tue Aug 30 01:21:12 2022] POST /identity/v3/users => generated 292 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:21:12.460077 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c69b752-0415-4b05-87b3-2629a8742ef8 admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:21:12.471637 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c69b752-0415-4b05-87b3-2629a8742ef8 admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:21:12.477563 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb7d3b6-40d7-443e-bb7d-6ba7aa9d7125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:21:12.478204 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb7d3b6-40d7-443e-bb7d-6ba7aa9d7125 admin admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:21:12.478478 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb7d3b6-40d7-443e-bb7d-6ba7aa9d7125 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:21:12.478746 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb7d3b6-40d7-443e-bb7d-6ba7aa9d7125 admin admin] PATH_INFO: `/v3/roles` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:21:12.479472 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb7d3b6-40d7-443e-bb7d-6ba7aa9d7125 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:21:12.481024 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb7d3b6-40d7-443e-bb7d-6ba7aa9d7125 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:21:12.493103 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1447/2921] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:21:12 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:21:12.497519 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1072caf-2687-4068-89b7-777926b798bd admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:21:12.507913 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1072caf-2687-4068-89b7-777926b798bd admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:21:12.512712 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c9c458-e3d5-4e63-9107-598191049c8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:21:12.513366 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c9c458-e3d5-4e63-9107-598191049c8d admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:21:12.513644 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c9c458-e3d5-4e63-9107-598191049c8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:21:12.513915 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c9c458-e3d5-4e63-9107-598191049c8d admin admin] PATH_INFO: `/v3/projects/f6c91bedb8544a9eb5e4cb534fa3ef19/users/b5a9e04c06294cd9af667e74aa99a50d/roles/d14c3070c9184d76a7b23df69bd3db07` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:21:12.528703 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c9c458-e3d5-4e63-9107-598191049c8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6c91bedb8544a9eb5e4cb534fa3ef19, user_id=b5a9e04c06294cd9af667e74aa99a50d, role_id=d14c3070c9184d76a7b23df69bd3db07)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:21:12.531377 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c9c458-e3d5-4e63-9107-598191049c8d admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:21:12.544722 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1475/2922] 10.222.0.79 () {60 vars in 1483 bytes} [Tue Aug 30 01:21:12 2022] PUT /identity/v3/projects/f6c91bedb8544a9eb5e4cb534fa3ef19/users/b5a9e04c06294cd9af667e74aa99a50d/roles/d14c3070c9184d76a7b23df69bd3db07 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:21:12.548892 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb7d3b6-40d7-443e-bb7d-6ba7aa9d7125 admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:21:12.559426 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb7d3b6-40d7-443e-bb7d-6ba7aa9d7125 admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:21:12.579565 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:21:12.615626 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408e68d3-3e3c-4aaa-b01b-1b38f8622e3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:21:12.616224 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408e68d3-3e3c-4aaa-b01b-1b38f8622e3e admin admin] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:21:12.616499 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408e68d3-3e3c-4aaa-b01b-1b38f8622e3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:21:12.617373 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408e68d3-3e3c-4aaa-b01b-1b38f8622e3e admin admin] PATH_INFO: `/v3/roles` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:21:12.618008 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408e68d3-3e3c-4aaa-b01b-1b38f8622e3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:21:12.619610 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408e68d3-3e3c-4aaa-b01b-1b38f8622e3e admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:21:12.629192 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1448/2923] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 30 01:21:12 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:21:12.633482 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c9c458-e3d5-4e63-9107-598191049c8d admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:21:12.643734 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c9c458-e3d5-4e63-9107-598191049c8d admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:21:12.649186 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8ef7e6-95bb-4b4d-84bd-d611b725e716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:21:12.649606 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8ef7e6-95bb-4b4d-84bd-d611b725e716 admin admin] REQUEST_METHOD: `PUT` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:21:12.649877 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8ef7e6-95bb-4b4d-84bd-d611b725e716 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:21:12.650145 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8ef7e6-95bb-4b4d-84bd-d611b725e716 admin admin] PATH_INFO: `/v3/projects/f6c91bedb8544a9eb5e4cb534fa3ef19/users/b5a9e04c06294cd9af667e74aa99a50d/roles/d14c3070c9184d76a7b23df69bd3db07` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:21:12.652083 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8ef7e6-95bb-4b4d-84bd-d611b725e716 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6c91bedb8544a9eb5e4cb534fa3ef19, user_id=b5a9e04c06294cd9af667e74aa99a50d, role_id=d14c3070c9184d76a7b23df69bd3db07)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:21:12.654673 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8ef7e6-95bb-4b4d-84bd-d611b725e716 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:21:12.660277 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:21:12.666537 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1476/2924] 10.222.0.79 () {60 vars in 1483 bytes} [Tue Aug 30 01:21:12 2022] PUT /identity/v3/projects/f6c91bedb8544a9eb5e4cb534fa3ef19/users/b5a9e04c06294cd9af667e74aa99a50d/roles/d14c3070c9184d76a7b23df69bd3db07 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:21:17.061974 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4826ef0f-c03b-49eb-a2a2-95861aeca1db None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:21:17.062851 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4826ef0f-c03b-49eb-a2a2-95861aeca1db None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:21:17.063332 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4826ef0f-c03b-49eb-a2a2-95861aeca1db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:21:17.099376 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-4826ef0f-c03b-49eb-a2a2-95861aeca1db None None] MFA Rules not processed for user `b5a9e04c06294cd9af667e74aa99a50d`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:21:17.101494 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-4826ef0f-c03b-49eb-a2a2-95861aeca1db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:21:17.204854 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1449/2925] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:21:17 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:21:17.225251 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8ef7e6-95bb-4b4d-84bd-d611b725e716 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:21:17.227965 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-ab8ef7e6-95bb-4b4d-84bd-d611b725e716 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:21:17.357800 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8ef7e6-95bb-4b4d-84bd-d611b725e716 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:21:17.364404 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b36aec-9014-4676-9b10-8e997bd9deb9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6480b2f14c37474c89df9fba48f7cd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:21:17.365361 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b36aec-9014-4676-9b10-8e997bd9deb9 service nova] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:21:17.365655 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b36aec-9014-4676-9b10-8e997bd9deb9 service nova] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:21:17.365929 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b36aec-9014-4676-9b10-8e997bd9deb9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:21:17.436572 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b36aec-9014-4676-9b10-8e997bd9deb9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:21:17.438222 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b36aec-9014-4676-9b10-8e997bd9deb9 service nova] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:21:17.449559 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1477/2926] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:21:17 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:21:18.787443 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95352d7-13cf-4e7e-8a43-11fe3b6843b9 None None] REQUEST_METHOD: `POST` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:21:18.788086 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95352d7-13cf-4e7e-8a43-11fe3b6843b9 None None] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:21:18.788086 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95352d7-13cf-4e7e-8a43-11fe3b6843b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:21:18.813329 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.auth.core [None req-f95352d7-13cf-4e7e-8a43-11fe3b6843b9 None None] MFA Rules not processed for user `aae6ad7feedc4b2f85b010a0540c013d`. Rule list: `[]` (Enabled: `True`). {{(pid=81998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:21:18.814545 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-f95352d7-13cf-4e7e-8a43-11fe3b6843b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:21:18.822157 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1450/2927] 10.222.0.79 () {58 vars in 958 bytes} [Tue Aug 30 01:21:18 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:21:27.444001 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=69 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:21:28.807109 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=55 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:21:46.049871 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b36aec-9014-4676-9b10-8e997bd9deb9 service nova] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:21:46.118886 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b36aec-9014-4676-9b10-8e997bd9deb9 service nova] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:21:46.125777 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a1f0b1-fcfb-4f27-818e-527da3f656d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16e6a0ca26fc4ef892c188ad89a1e132', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:21:46.126589 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a1f0b1-fcfb-4f27-818e-527da3f656d3 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:21:46.126905 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a1f0b1-fcfb-4f27-818e-527da3f656d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:21:46.127231 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a1f0b1-fcfb-4f27-818e-527da3f656d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:21:46.143605 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a1f0b1-fcfb-4f27-818e-527da3f656d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:21:46.145209 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a1f0b1-fcfb-4f27-818e-527da3f656d3 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:21:46.156763 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1478/2928] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:21:46 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 01:21:56.151061 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=30 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:23:37.050386 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95352d7-13cf-4e7e-8a43-11fe3b6843b9 None None] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:23:37.060489 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95352d7-13cf-4e7e-8a43-11fe3b6843b9 None None] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:23:37.064094 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042815b0-b387-4070-ade7-655a37732373 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16e6a0ca26fc4ef892c188ad89a1e132', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:23:37.064696 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042815b0-b387-4070-ade7-655a37732373 service neutron] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:23:37.064972 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042815b0-b387-4070-ade7-655a37732373 service neutron] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:23:37.065242 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042815b0-b387-4070-ade7-655a37732373 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:23:37.067212 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-042815b0-b387-4070-ade7-655a37732373 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:23:37.082870 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042815b0-b387-4070-ade7-655a37732373 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:23:37.084328 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042815b0-b387-4070-ade7-655a37732373 service neutron] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:23:37.096778 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1451/2929] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:23:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:23:38.285815 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a1f0b1-fcfb-4f27-818e-527da3f656d3 service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:23:38.287254 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-e8a1f0b1-fcfb-4f27-818e-527da3f656d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:23:38.311680 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a1f0b1-fcfb-4f27-818e-527da3f656d3 service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:23:38.315349 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa120e9b-4f54-430a-b0af-27598b9d9d5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16e6a0ca26fc4ef892c188ad89a1e132', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:23:38.315937 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa120e9b-4f54-430a-b0af-27598b9d9d5b service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:23:38.316488 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa120e9b-4f54-430a-b0af-27598b9d9d5b service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:23:38.316752 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa120e9b-4f54-430a-b0af-27598b9d9d5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:23:38.318424 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-fa120e9b-4f54-430a-b0af-27598b9d9d5b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:23:38.332130 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa120e9b-4f54-430a-b0af-27598b9d9d5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:23:38.333542 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa120e9b-4f54-430a-b0af-27598b9d9d5b service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:23:38.345441 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1479/2930] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:23:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:23:47.091371 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=6 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:23:47.181919 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042815b0-b387-4070-ade7-655a37732373 service neutron] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:23:47.191277 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042815b0-b387-4070-ade7-655a37732373 service neutron] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:23:47.194951 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea0d63d-46b3-4aaf-83dd-66c2ee79ebe7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16e6a0ca26fc4ef892c188ad89a1e132', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:23:47.195593 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea0d63d-46b3-4aaf-83dd-66c2ee79ebe7 service neutron] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:23:47.195874 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea0d63d-46b3-4aaf-83dd-66c2ee79ebe7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:23:47.196164 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea0d63d-46b3-4aaf-83dd-66c2ee79ebe7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:23:47.197893 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-3ea0d63d-46b3-4aaf-83dd-66c2ee79ebe7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:23:47.208257 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea0d63d-46b3-4aaf-83dd-66c2ee79ebe7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:23:47.209724 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea0d63d-46b3-4aaf-83dd-66c2ee79ebe7 service neutron] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:23:47.218664 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1452/2931] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:23:47 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:23:48.340231 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=11 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:23:50.306185 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa120e9b-4f54-430a-b0af-27598b9d9d5b service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:23:50.315820 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa120e9b-4f54-430a-b0af-27598b9d9d5b service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:23:50.319796 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd96b43f-16fd-47d6-84b4-0f5a4ad04ab3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16e6a0ca26fc4ef892c188ad89a1e132', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:23:50.320394 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd96b43f-16fd-47d6-84b4-0f5a4ad04ab3 service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:23:50.320799 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd96b43f-16fd-47d6-84b4-0f5a4ad04ab3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:23:50.321066 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd96b43f-16fd-47d6-84b4-0f5a4ad04ab3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:23:50.322910 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-cd96b43f-16fd-47d6-84b4-0f5a4ad04ab3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:23:50.333824 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd96b43f-16fd-47d6-84b4-0f5a4ad04ab3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:23:50.335321 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd96b43f-16fd-47d6-84b4-0f5a4ad04ab3 service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:23:50.344436 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1480/2932] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:23:50 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:23:50.472689 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea0d63d-46b3-4aaf-83dd-66c2ee79ebe7 service neutron] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:23:50.481718 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea0d63d-46b3-4aaf-83dd-66c2ee79ebe7 service neutron] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:23:50.486030 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b453aa72-c4b1-41c6-a4eb-8d3ea53bf9a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16e6a0ca26fc4ef892c188ad89a1e132', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:23:50.486701 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b453aa72-c4b1-41c6-a4eb-8d3ea53bf9a2 service neutron] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:23:50.487052 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b453aa72-c4b1-41c6-a4eb-8d3ea53bf9a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:23:50.487445 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b453aa72-c4b1-41c6-a4eb-8d3ea53bf9a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:23:50.489468 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-b453aa72-c4b1-41c6-a4eb-8d3ea53bf9a2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:23:50.500617 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b453aa72-c4b1-41c6-a4eb-8d3ea53bf9a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:23:50.502026 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b453aa72-c4b1-41c6-a4eb-8d3ea53bf9a2 service neutron] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:23:50.510371 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1453/2933] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:23:50 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:23:50.585056 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd96b43f-16fd-47d6-84b4-0f5a4ad04ab3 service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:23:50.593724 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd96b43f-16fd-47d6-84b4-0f5a4ad04ab3 service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:23:50.597535 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd889ea-f20e-4340-af5d-153add01180e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16e6a0ca26fc4ef892c188ad89a1e132', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:23:50.598140 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd889ea-f20e-4340-af5d-153add01180e service neutron] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:23:50.598544 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd889ea-f20e-4340-af5d-153add01180e service neutron] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:23:50.598815 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd889ea-f20e-4340-af5d-153add01180e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:23:50.600560 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-afd889ea-f20e-4340-af5d-153add01180e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:23:50.615240 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd889ea-f20e-4340-af5d-153add01180e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:23:50.616818 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd889ea-f20e-4340-af5d-153add01180e service neutron] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:23:50.629170 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1481/2934] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:23:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:23:50.690618 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b453aa72-c4b1-41c6-a4eb-8d3ea53bf9a2 service neutron] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:23:50.760928 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b453aa72-c4b1-41c6-a4eb-8d3ea53bf9a2 service neutron] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:23:50.766359 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf94622c-7959-4b21-9eb8-61a8b6b84995 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd68e91e4259e449797fb83de548aec1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:23:50.766990 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf94622c-7959-4b21-9eb8-61a8b6b84995 service placement] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:23:50.767385 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf94622c-7959-4b21-9eb8-61a8b6b84995 service placement] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:23:50.767655 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf94622c-7959-4b21-9eb8-61a8b6b84995 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:23:50.769551 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-bf94622c-7959-4b21-9eb8-61a8b6b84995 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:23:50.782146 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf94622c-7959-4b21-9eb8-61a8b6b84995 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:23:50.783807 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf94622c-7959-4b21-9eb8-61a8b6b84995 service placement] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:23:50.794820 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1454/2935] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:23:50 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:23:57.953626 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd889ea-f20e-4340-af5d-153add01180e service neutron] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:23:57.955401 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-afd889ea-f20e-4340-af5d-153add01180e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:23:57.976399 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd889ea-f20e-4340-af5d-153add01180e service neutron] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:23:57.982723 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b2bf6e-6bef-4c83-9602-9ccd7bc2b753 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6480b2f14c37474c89df9fba48f7cd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:23:57.983469 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b2bf6e-6bef-4c83-9602-9ccd7bc2b753 service nova] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:23:57.983813 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b2bf6e-6bef-4c83-9602-9ccd7bc2b753 service nova] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:23:57.984217 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b2bf6e-6bef-4c83-9602-9ccd7bc2b753 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:23:57.986499 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-57b2bf6e-6bef-4c83-9602-9ccd7bc2b753 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:23:58.001268 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b2bf6e-6bef-4c83-9602-9ccd7bc2b753 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:23:58.002921 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b2bf6e-6bef-4c83-9602-9ccd7bc2b753 service nova] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:23:58.017862 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1482/2936] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:23:57 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:24:00.789738 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=44 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:24:08.010635 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=18 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:25:13.129689 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf94622c-7959-4b21-9eb8-61a8b6b84995 service placement] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:25:13.149419 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf94622c-7959-4b21-9eb8-61a8b6b84995 service placement] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:25:13.157440 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec371ac-616e-4389-a147-95de73346afa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6480b2f14c37474c89df9fba48f7cd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:25:13.157440 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec371ac-616e-4389-a147-95de73346afa service nova] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:25:13.157440 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec371ac-616e-4389-a147-95de73346afa service nova] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:25:13.157440 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec371ac-616e-4389-a147-95de73346afa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:25:13.159318 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-cec371ac-616e-4389-a147-95de73346afa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:25:13.173226 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec371ac-616e-4389-a147-95de73346afa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:25:13.174850 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec371ac-616e-4389-a147-95de73346afa service nova] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:25:13.188396 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1455/2937] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:25:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:25:21.388005 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b2bf6e-6bef-4c83-9602-9ccd7bc2b753 service nova] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:25:21.390575 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-57b2bf6e-6bef-4c83-9602-9ccd7bc2b753 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:25:21.414516 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b2bf6e-6bef-4c83-9602-9ccd7bc2b753 service nova] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:25:21.423975 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31359635-3023-416e-96e3-0ad70f8ec95b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd68e91e4259e449797fb83de548aec1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:25:21.424839 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31359635-3023-416e-96e3-0ad70f8ec95b service placement] REQUEST_METHOD: `GET` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:25:21.426094 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31359635-3023-416e-96e3-0ad70f8ec95b service placement] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:25:21.426579 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31359635-3023-416e-96e3-0ad70f8ec95b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:25:21.429498 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-31359635-3023-416e-96e3-0ad70f8ec95b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:25:21.453205 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31359635-3023-416e-96e3-0ad70f8ec95b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:25:21.460941 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31359635-3023-416e-96e3-0ad70f8ec95b service placement] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:25:21.475812 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1483/2938] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:25:21 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:25:23.181719 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=6 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:25:24.902672 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec371ac-616e-4389-a147-95de73346afa service nova] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:25:24.990538 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec371ac-616e-4389-a147-95de73346afa service nova] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:25:24.995120 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c05ae7d-9f4c-41e7-883a-775bfe4281b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:25:24.995795 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c05ae7d-9f4c-41e7-883a-775bfe4281b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:25:24.996074 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c05ae7d-9f4c-41e7-883a-775bfe4281b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:25:24.996342 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c05ae7d-9f4c-41e7-883a-775bfe4281b4 admin admin] PATH_INFO: `/v3/users/aae6ad7feedc4b2f85b010a0540c013d` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:25:24.998154 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c05ae7d-9f4c-41e7-883a-775bfe4281b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aae6ad7feedc4b2f85b010a0540c013d)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:25:25.000140 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c05ae7d-9f4c-41e7-883a-775bfe4281b4 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:25:25.054182 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-3c05ae7d-9f4c-41e7-883a-775bfe4281b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aae6ad7feedc4b2f85b010a0540c013d'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:25:25.062993 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-3c05ae7d-9f4c-41e7-883a-775bfe4281b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aae6ad7feedc4b2f85b010a0540c013d'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:25:25.076392 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-3c05ae7d-9f4c-41e7-883a-775bfe4281b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aae6ad7feedc4b2f85b010a0540c013d'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:25:25.077138 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-3c05ae7d-9f4c-41e7-883a-775bfe4281b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aae6ad7feedc4b2f85b010a0540c013d'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:25:25.085775 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-3c05ae7d-9f4c-41e7-883a-775bfe4281b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aae6ad7feedc4b2f85b010a0540c013d'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:25:25.092857 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1456/2939] 10.222.0.79 () {58 vars in 1224 bytes} [Tue Aug 30 01:25:24 2022] DELETE /identity/v3/users/aae6ad7feedc4b2f85b010a0540c013d => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:25:25.285301 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31359635-3023-416e-96e3-0ad70f8ec95b service placement] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:25:25.298308 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31359635-3023-416e-96e3-0ad70f8ec95b service placement] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:25:25.368145 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ebae43-c66b-4ad7-8fbe-d6c4470f1c75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:25:25.368808 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ebae43-c66b-4ad7-8fbe-d6c4470f1c75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:25:25.369094 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ebae43-c66b-4ad7-8fbe-d6c4470f1c75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:25:25.369358 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ebae43-c66b-4ad7-8fbe-d6c4470f1c75 admin admin] PATH_INFO: `/v3/projects/52b9a097a88f4aba893b0c6ad8cf9a0a` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:25:25.370554 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ebae43-c66b-4ad7-8fbe-d6c4470f1c75 admin admin] RBAC: Authorizing `identity:delete_project(project_id=52b9a097a88f4aba893b0c6ad8cf9a0a)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:25:25.373008 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ebae43-c66b-4ad7-8fbe-d6c4470f1c75 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:25:25.423657 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b3ebae43-c66b-4ad7-8fbe-d6c4470f1c75 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52b9a097a88f4aba893b0c6ad8cf9a0a', 'request_id': 'req-b3ebae43-c66b-4ad7-8fbe-d6c4470f1c75'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:25:25.431266 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b3ebae43-c66b-4ad7-8fbe-d6c4470f1c75 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52b9a097a88f4aba893b0c6ad8cf9a0a', 'request_id': 'req-b3ebae43-c66b-4ad7-8fbe-d6c4470f1c75'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:25:25.437033 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b3ebae43-c66b-4ad7-8fbe-d6c4470f1c75 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52b9a097a88f4aba893b0c6ad8cf9a0a', 'request_id': 'req-b3ebae43-c66b-4ad7-8fbe-d6c4470f1c75'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:25:25.448374 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b3ebae43-c66b-4ad7-8fbe-d6c4470f1c75 admin admin] The token cache is being invalidate because project 52b9a097a88f4aba893b0c6ad8cf9a0a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:25:25.448661 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b3ebae43-c66b-4ad7-8fbe-d6c4470f1c75 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:25:25.449305 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-b3ebae43-c66b-4ad7-8fbe-d6c4470f1c75 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:25:25.451145 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1484/2940] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 30 01:25:25 2022] DELETE /identity/v3/projects/52b9a097a88f4aba893b0c6ad8cf9a0a => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:25:25.455278 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c05ae7d-9f4c-41e7-883a-775bfe4281b4 admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:25:25.456722 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-3c05ae7d-9f4c-41e7-883a-775bfe4281b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:25:25.470643 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c05ae7d-9f4c-41e7-883a-775bfe4281b4 admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:25:25.530208 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f247bc1f-8966-4d52-b3f2-a8f62155f2e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:25:25.530757 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f247bc1f-8966-4d52-b3f2-a8f62155f2e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:25:25.531079 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f247bc1f-8966-4d52-b3f2-a8f62155f2e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:25:25.531322 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f247bc1f-8966-4d52-b3f2-a8f62155f2e9 admin admin] PATH_INFO: `/v3/users/b5a9e04c06294cd9af667e74aa99a50d` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:25:25.532483 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f247bc1f-8966-4d52-b3f2-a8f62155f2e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5a9e04c06294cd9af667e74aa99a50d)` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:25:25.534386 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f247bc1f-8966-4d52-b3f2-a8f62155f2e9 admin admin] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:25:25.558344 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:25:25.588932 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-f247bc1f-8966-4d52-b3f2-a8f62155f2e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5a9e04c06294cd9af667e74aa99a50d'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:25:25.597170 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-f247bc1f-8966-4d52-b3f2-a8f62155f2e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5a9e04c06294cd9af667e74aa99a50d'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:25:25.609381 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-f247bc1f-8966-4d52-b3f2-a8f62155f2e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5a9e04c06294cd9af667e74aa99a50d'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:25:25.610119 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-f247bc1f-8966-4d52-b3f2-a8f62155f2e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5a9e04c06294cd9af667e74aa99a50d'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:25:25.618747 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.notifications [None req-f247bc1f-8966-4d52-b3f2-a8f62155f2e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5a9e04c06294cd9af667e74aa99a50d'} {{(pid=81998) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:25:25.626886 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1457/2941] 10.222.0.79 () {58 vars in 1224 bytes} [Tue Aug 30 01:25:25 2022] DELETE /identity/v3/users/b5a9e04c06294cd9af667e74aa99a50d => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:25:25.823233 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ebae43-c66b-4ad7-8fbe-d6c4470f1c75 admin admin] Authenticating user token {{(pid=81999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:25:25.826264 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.fernet_utils [None req-b3ebae43-c66b-4ad7-8fbe-d6c4470f1c75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:25:25.842815 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ebae43-c66b-4ad7-8fbe-d6c4470f1c75 admin admin] Validating token access rules against request {{(pid=81999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:25:25.908958 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47aa7471-8845-4fc6-8bad-c7b632086524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c77b2049f04525ac7b6806a553b84c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7112c39aad764cbc9493ab829d1c571c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:25:25.909945 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aa7471-8845-4fc6-8bad-c7b632086524 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:25:25.910228 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aa7471-8845-4fc6-8bad-c7b632086524 admin admin] SCRIPT_NAME: `/identity` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:25:25.910499 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aa7471-8845-4fc6-8bad-c7b632086524 admin admin] PATH_INFO: `/v3/projects/f6c91bedb8544a9eb5e4cb534fa3ef19` {{(pid=81999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:25:25.911706 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47aa7471-8845-4fc6-8bad-c7b632086524 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6c91bedb8544a9eb5e4cb534fa3ef19)` {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:25:25.913622 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47aa7471-8845-4fc6-8bad-c7b632086524 admin admin] RBAC: Authorization granted {{(pid=81999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:25:25.959166 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:25:25.998196 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-47aa7471-8845-4fc6-8bad-c7b632086524 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6c91bedb8544a9eb5e4cb534fa3ef19', 'request_id': 'req-47aa7471-8845-4fc6-8bad-c7b632086524'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:25:26.005587 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-47aa7471-8845-4fc6-8bad-c7b632086524 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6c91bedb8544a9eb5e4cb534fa3ef19', 'request_id': 'req-47aa7471-8845-4fc6-8bad-c7b632086524'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:25:26.011350 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-47aa7471-8845-4fc6-8bad-c7b632086524 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6c91bedb8544a9eb5e4cb534fa3ef19', 'request_id': 'req-47aa7471-8845-4fc6-8bad-c7b632086524'} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:25:26.023875 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-47aa7471-8845-4fc6-8bad-c7b632086524 admin admin] The token cache is being invalidate because project f6c91bedb8544a9eb5e4cb534fa3ef19 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81999) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:25:26.024161 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-47aa7471-8845-4fc6-8bad-c7b632086524 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:25:26.024827 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG keystone.notifications [None req-47aa7471-8845-4fc6-8bad-c7b632086524 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81999) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:25:26.026706 dv-cinder-819667-6-smb devstack@keystone.service[81999]: [pid: 81999|app: 0|req: 1485/2942] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 30 01:25:25 2022] DELETE /identity/v3/projects/f6c91bedb8544a9eb5e4cb534fa3ef19 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:25:35.622448 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:DELETE=7,keystone:SELECT=20,keystone:INSERT=1 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:25:36.020777 dv-cinder-819667-6-smb devstack@keystone.service[81999]: DEBUG dbcounter [-] [81999] Writing DB stats keystone:SELECT=16,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:26:15.391480 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f247bc1f-8966-4d52-b3f2-a8f62155f2e9 admin admin] Authenticating user token {{(pid=81998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:26:15.392895 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-f247bc1f-8966-4d52-b3f2-a8f62155f2e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:26:15.463920 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f247bc1f-8966-4d52-b3f2-a8f62155f2e9 admin admin] Validating token access rules against request {{(pid=81998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:26:15.526050 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51ed293-9619-419d-8e16-117e1f626def service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd68e91e4259e449797fb83de548aec1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eec3a73673e45dc881de586b9b0fbbb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:26:15.526565 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51ed293-9619-419d-8e16-117e1f626def service placement] REQUEST_METHOD: `GET` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:26:15.526834 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51ed293-9619-419d-8e16-117e1f626def service placement] SCRIPT_NAME: `/identity` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:26:15.527098 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51ed293-9619-419d-8e16-117e1f626def service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:26:15.528838 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.fernet_utils [None req-c51ed293-9619-419d-8e16-117e1f626def service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:26:15.539847 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51ed293-9619-419d-8e16-117e1f626def service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:26:15.541403 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51ed293-9619-419d-8e16-117e1f626def service placement] RBAC: Authorization granted {{(pid=81998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:26:15.551933 dv-cinder-819667-6-smb devstack@keystone.service[81998]: [pid: 81998|app: 0|req: 1458/2943] 10.222.0.79 () {60 vars in 1365 bytes} [Tue Aug 30 01:26:15 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:26:25.547678 dv-cinder-819667-6-smb devstack@keystone.service[81998]: DEBUG dbcounter [-] [81998] Writing DB stats keystone:SELECT=58 {{(pid=81998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}